Comments (16)
That's a good question :( I usually only see that when my git endpoint goes down, otherwise I don't really see that error.
How many helm repos are you loading up?
from argo-cd-helmfile.
I have around 50 helm repos and 60 apps
its happens usually when im changing the values or adding new charts
when the system is static, its not occurs that much
from argo-cd-helmfile.
Hello,
Could be that helm/helmfile build/template takes a long time, so I think you can fix this with:
"!!! important If your sidecar CMP command runs too long, the command will be killed, and the UI will show an error. The CMP server respects the timeouts set by the server.repo.server.timeout.seconds and controller.repo.server.timeout.seconds items in argocd-cm. Increase their values from the default of 60s.
Each CMP command will also independently timeout on the ARGOCD_EXEC_TIMEOUT
set for the CMP sidecar. The default
is 90s. So if you increase the repo server timeout greater than 90s, be sure to set ARGOCD_EXEC_TIMEOUT
on the
sidecar."
from argo-cd-helmfile.
I have set this values in argocd chart:
controller:
args:
statusProcessors: "40"
operationProcessors: "20"
selfHealTimeout: "10"
repoServerTimeoutSeconds: "600"
and env var ARGOCD_EXEC_TIMEOUT
to 10m in reposerver
i will test it and inform if its helped
from argo-cd-helmfile.
How many argo apps do those 60 repos and 50 apps span?
from argo-cd-helmfile.
How many argo apps do those 60 repos and 50 apps span?
What do you mean by span ?
I have set this values in argocd chart:
controller: args: statusProcessors: "40" operationProcessors: "20" selfHealTimeout: "10" repoServerTimeoutSeconds: "600"
and env var
ARGOCD_EXEC_TIMEOUT
to 10m in reposerveri will test it and inform if its helped
No it doesnt helped
from argo-cd-helmfile.
Mabye I will try to setup helm chart proxy (e.g. harbor)
And point any repository to the proxy
What do you think ?
from argo-cd-helmfile.
I mean how many instances of argocd app are in the cluster? Is it all 1 giant app in the same ns or are there 50 argocd apps?
from argo-cd-helmfile.
There are 50 argocd apps across around 25 namespaces
Each namespace have exactly 2 argocd apps , one for helmfile and one for manifests (e.g. namespace , resource quotas etc..)
Each helmfile have around 1-5 helm charts (depends what the namespace does)
In this cluster we have around 60+ helm charts releases, 50 argocd apps and 25 namespaces
from argo-cd-helmfile.
Ok that helps! Do you put all the helm repos in a base that all helmfiles use? Or does each helmfile only pull down the repos it actually uses?
Said differently, does each argo app end up refreshing/syncing all 50 repos?
from argo-cd-helmfile.
no it is separated , theres no base for the repos
each helmfile have his own repos
from argo-cd-helmfile.
Hmm, then the number shouldn’t impact you too much. I’m not sure what would be taking so long. Do they take a long time to render/template locally on your workstation?
You may try bumping the number of repo server pods to alleviate the pressure and scale out a little bit.
from argo-cd-helmfile.
I have set the replicas of repo server to 2 instead 1
Will check how its works now and update
from argo-cd-helmfile.
@travisghansen
The unknown sync issue is still exists unforthently
Somehow, only when I change values in some app (no matter which one), other apps getting the unknown sync problem
Its seems like argocd is trying to sync the apps no matter if they unchanged in the git
They also cant download the charts for some period of time:
/tmp/helmfile3211379699/dex-dex-values-6487f67968 (49 bytes) 346: --kube-version=1.23 (19 bytes) 347: --api-versions=acme.cert-manager.io/v1 (38 bytes) ERROR: exit status 1 EXIT STATUS 1 STDERR: Error: failed to download "dex/dex" at version "0.9.0" COMBINED OUTPUT: Error: failed to download "dex/dex" at version
Mabye caching the helm charts in repo server could solve it ?
from argo-cd-helmfile.
Any luck figuring this out?
from argo-cd-helmfile.
I haven’t yet set up and tried proxy helm repositories
I have set the monitoring treshold to an hour(not ideal) but it ignores it for now until i’ll test it deeper
from argo-cd-helmfile.
Related Issues (20)
- Helmfile is moved HOT 2
- Error: unknown flag: --skip-crds HOT 10
- Passing args to helm HOT 11
- Issues related to sidecar CMP mode HOT 13
- Autodiscover with apps in app HOT 10
- Helm repository not found HOT 13
- adding kustomize transformers: causes breakage HOT 3
- helmfile/vals integration HOT 7
- Namespaces not taken into account HOT 11
- Not allow helm valuesFiles path or Values file as block file with plugin helmfile
- Create Application per Helmfile Release HOT 1
- argo-cd-helmfile.sh discover` failed exit status 1 HOT 1
- Fail to fetch OCI private Helm registry HOT 1
- Integrated ArgoCD plugin parameters support ? HOT 3
- Setting --skip-deps as optional HOT 2
- Not installing crds in folder of helm chart HOT 2
- What about ExternalSecrets instead of sops? HOT 1
- Not able to use secretref+k8s to fetch secrets from Kubernetes Secret object HOT 2
- kubectl context support HOT 3
- Pass helm values from separate repo HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from argo-cd-helmfile.