Comments (18)
Documenting my single command workaround based on comments above (make sure to replace the host with your ACS master node)
ssh [email protected] sudo sed -i s/'2.5.1'/'2.6.0'/g /etc/kubernetes/addons/kube-tiller-deployment.yaml && helm init --upgrade
from acs.
Any update on this? Cluster in Southeast Asia still can't upgrade with helm init --upgade
now.
from acs.
@berndverst I tried your example and it worked, however I would suggest restarting the kube-addon-manager pod by deleting it from the kube-system namespace, e.g.
$ kubectl -n kube-system delete po kube-addon-manager-k8s-master-a637ed6-0
This will force a new addon-manager pod to boot and reconcile all the resources managed by the addon manager... Including tiller. This will force a fresh tiller v2.6.0 instance to be deployed.
from acs.
This appears to be because of how we are defining our tiller addon. We have it marked as a cluster service. Which means Kuberentes doesn't want to allow updates to it through the kubernetes api. Instead it wants the updates to happen on the file in the master. We could change to using addonmanager.kubernetes.io/mode=EnsureExists . @anhowe @seanknox @jackfrancis thoughts?
relevant Kubernetes documentation
https://github.com/kubernetes/kubernetes/blob/master/cluster/addons/addon-manager/README.md
from acs.
It will be in the v2 regions in a week or two if it isn't already. In the v1 regions it will be next month.
from acs.
Definetly in ACSv2. V1 is still a ways out we have had a deployment having other issues that is delaying this some.
from acs.
Iām going to reopen this for visibility. Iām still making weekly references to this ticket in #helm-users. :)
from acs.
addonmanager.kubernetes.io/mode=EnsureExists
appears to be right call here. Agree @lachie83?
from acs.
Also what do we think about doing this for dashboard, heapster, and the storage classes addons? Do we want them static or do we want customers to be able to modify them through the api server
from acs.
Good call for dashboard and heapster, though my hunch without thinking through much is that we should err on the more prescriptive end with storage classes.
from acs.
I think I agree on not letting people shoot themselves in the foot with storage classes. Mostly I was wanting to look at all the extensions and decide if we want to update them while doing this.
from acs.
@bacongobbler if it wasn't clear there is a work around by updating the add-on file for tiller, /etc/kubernetes/addons/kube-tiller-deployment.yaml, to be the newer spec for tiller on each master.
from acs.
Confirming everything @JackQuincy @seanknox have said.
from acs.
I was able to work around this by deploying a hacked up acs-engine cluster with Tiller v2.6.0 but I'll keep that in mind for next time. Thanks @JackQuincy @seanknox @lachie83 for your help!
from acs.
JFYI we have the long-term fix for this slated to go into acs-engine soon: Azure/acs-engine#1319
from acs.
What is the timeline for this being fixed in ACS?
from acs.
Any updates on this?
from acs.
@lrills I manually had to update the add on definition on the Kubernetes master again as a workaround. Like so:
ssh [email protected] sudo sed -i s/'2.6.0'/'2.7.0'/g /etc/kubernetes/addons/kube-tiller-deployment.yaml && helm init --upgrade
No other method has reliably worked for me.
from acs.
Related Issues (20)
- How upgrade Kubernetes version to 1.8.x in ACS HOT 3
- Very different Kubernetes clusters in different locations HOT 3
- ETA for Japan availability of --orchestrator-version
- Cluster broken after upgrade to K8s 1.8.9 HOT 1
- PersistantVolumeClaims changing to Read-only file system suddenly. HOT 6
- Commas in NSG rules break the ability to create services in ACS K8S clusters HOT 2
- BadHostKeyException when attempting az acs kubernetes get-credentials HOT 1
- Standard NC_6 VM shows 0 GPUs
- kubectl cluster-info not showing "kubernetes-dashboard is running at"
- AttachDetach Failing for k8s 1.7.7 HOT 3
- Volume mount with Kubernetes fails HOT 8
- docker stack deploy requires API version 1.25
- get hpa
- How do I upgrade a cluster in Azure ACS HOT 1
- [enhancement] Find nearby stations HOT 2
- Azure acs error HOT 1
- System.AggregateException, (Docker API responded with status code=BadRequest, response={"message":"network HOT 8
- AKS cluster nor getting created HOT 2
- Azure Container Instance in Terminated State, but Status is Running HOT 1
- This repo is missing important files
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
š Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ššš
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ā¤ļø Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from acs.