Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multiple Node Pool Support #287

Closed
derekperkins opened this issue Apr 3, 2018 · 44 comments
Closed

Multiple Node Pool Support #287

derekperkins opened this issue Apr 3, 2018 · 44 comments
Assignees
Labels
AzChina Azure China cloud support AzGov Azure Government cloud support nodepools

Comments

@derekperkins
Copy link
Contributor

This is a tracking issue for node pool support as mentioned by @slack in #79. Node pools are shown in the UI, but without a way to add new ones. I'm wanting to add some L series nodes to my cluster to run a database, but keep using D series machines for the bulk of my workers. When are multiple node pools expected to be supported?

image

@sauryadas
Copy link
Contributor

In the roadmap, about 6 months

@derekperkins
Copy link
Contributor Author

Thanks for the heads up.

@ghost
Copy link

ghost commented Apr 8, 2018

We are planning to move our cloudservices to a container environment. I was very impressed with the ease of use of AKS while testing it. However, the impossibility to scale the size of the VMs is a blocker at the moment (#79).

Do I understand it correctly that with the future possibility of adding different nodepools it would be possible to add a new nodepool and then delete the old one without service interruption?

@ghost
Copy link

ghost commented May 15, 2018

@sauryadas Could you tell us if it will be possible to remove Nodepools?
thank you!

@sauryadas
Copy link
Contributor

sauryadas commented May 15, 2018 via email

@judy-zz
Copy link

judy-zz commented Jun 15, 2018

+1 for this. I'm also interested in using different node pools for security reasons, like single tenancy for Vault.

@marcel-dempers
Copy link

Hi all, any update on this ? Based on this thread we are 2 months away from node pool support ?

@agolomoodysaada
Copy link
Contributor

agolomoodysaada commented Aug 10, 2018

This is a deal breaker for us as we require running most workloads on standard VMs while CPU intensive workloads require special CPU hardware like the F series VMs.
It's also critical for migrating to VMs with larger OS disks. Otherwise, when disks are too small, the kubelet starts evicting pods due to the nodefs.available signal.

@agolomoodysaada
Copy link
Contributor

Can we at least open up preview versions? 😭

@kvolkovich-sc
Copy link

kvolkovich-sc commented Aug 13, 2018

I made a manual temporary hack)

Just change single node size manually to increase RAM (need more for one pod).

Looks like it works normally.

But I don't know what to expect after next time horizontal scaling.

@agolomoodysaada
Copy link
Contributor

@kvolkovich-sc that doesn't work with horizontal scaling unfortunately. I tried asking Azure support for help but they said we have to wait for node pool support for this to work

@ellieayla
Copy link

ellieayla commented Aug 13, 2018

It also doesn't work for mixing node types (eg, one node pool has GPUs).

@gabrielmcf
Copy link

Any new on this issue? Is there a beta version already? Still planned to october?

@kitgary
Copy link

kitgary commented Sep 1, 2018

Any update on this? I really need it for production.

@sauryadas
Copy link
Contributor

End of Oct is still the ETA .. Thanks for your patience.

@ormico
Copy link

ormico commented Sep 25, 2018

T - 36 days and counting

@ormico
Copy link

ormico commented Oct 1, 2018

cool. k8 v1.12 released with Azure Scale Set support. must be getting close.
https://kubernetes.io/blog/2018/09/27/kubernetes-1.12-kubelet-tls-bootstrap-and-azure-virtual-machine-scale-sets-vmss-move-to-general-availability/

@jmajoor
Copy link

jmajoor commented Oct 5, 2018

Will support for multiple node pools also include the ability to have one pool of Linux nodes and another pool of Windows nodes. Currently the only option for windows containers on AKS is through virtual-kubelets, which uses ACI. There are too many limitations in using ACI and windows containers. These restrictions shouldn't be necessary if you can setup a pool of windows nodes.

@sauryadas
Copy link
Contributor

the eventual goal is to support hybrid clusters but there is no ETA yet for windows support in AKS. Sorry.

@arwkmd
Copy link

arwkmd commented Oct 22, 2018

There is a problem with iteration over pools in all templates used to generate ARM templates. See Azure/acs-engine#3102. AKS uses ACS-Engine under hood.

@btok
Copy link

btok commented Oct 28, 2018

Hi @sauryadas ! Can you please give us current status of the ETA of node pools ?
Would REALLY appriciate planning according to ETA on my end as its an urgent update for production env.
Thanks a lot !

@sauryadas
Copy link
Contributor

node pools has been delayed by a quarter and will now come in the 1st quarter of 2019. Apologies for the delay. I will keep you posted if we get it in earlier.

@przemolb
Copy link

@sauryadas can you please tell us what is the reason to delay it ?

@sauryadas
Copy link
Contributor

@przemolb Currently we are focused on fixing any existing issues and keep the QoS high before we roll out new features ...

@przemolb
Copy link

@sauryadas hire more people ;-)

@Azure Azure locked as too heated and limited conversation to collaborators Feb 21, 2019
@jnoller
Copy link
Contributor

jnoller commented Apr 4, 2019

Multiple node pool support is on track for 1H2019 delivery.

Reopening to track this as a roadmap top-level item. Please remember this repository is operated under the Microsoft code of conduct (https://opensource.microsoft.com/codeofconduct/) and comments not adhering to it will be removed.

@jnoller jnoller reopened this Apr 4, 2019
@jnoller jnoller moved this from Public Preview to Done (GA, Shipped) in Azure Kubernetes Service Roadmap (Public) May 6, 2019
@jnoller jnoller removed this from Done (GA, Shipped) in Azure Kubernetes Service Roadmap (Public) May 6, 2019
@jnoller jnoller changed the title Add Node Pool Support Multiple Node Pool Support May 6, 2019
@jnoller jnoller added the feature label May 6, 2019
@jnoller
Copy link
Contributor

jnoller commented May 10, 2019

Multiple node pools are now in public preview: https://github.com/Azure/AKS/blob/master/previews.md#multiple-node-pools

@jluk jluk self-assigned this Aug 6, 2019
@jluk
Copy link
Contributor

jluk commented Aug 20, 2019

This feature is set to GA in Q4CY19.

@jluk jluk moved this from Public Preview to Done (GA, Shipped) in Azure Kubernetes Service Roadmap (Public) Nov 4, 2019
@jluk
Copy link
Contributor

jluk commented Nov 4, 2019

This feature is now generally available, thank you everyone for your patience and feedback on this important feature. Documentation can be found at aka.ms/aks/nodepools. Closing.

@jluk jluk closed this as completed Nov 4, 2019
@thomas1206 thomas1206 added AzGov Azure Government cloud support AzChina Azure China cloud support and removed AzGov Azure Government cloud support AzChina Azure China cloud support labels Dec 24, 2019
@fseldow fseldow added AzGov Azure Government cloud support AzChina Azure China cloud support and removed AzGov Azure Government cloud support labels Dec 24, 2019
@palma21 palma21 moved this from Generally Available (Done) to Archive in Azure Kubernetes Service Roadmap (Public) Aug 12, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
AzChina Azure China cloud support AzGov Azure Government cloud support nodepools
Projects
Azure Kubernetes Service Roadmap (Pub...
Archive (GA older than 1 month)
Development

No branches or pull requests