Comments (4)
@akryvko thanks for clarifying. I realized that we only do es node scaling without looking at CPU metrics, but we don't do any index scaling without considering the CPU metrics, even when the config has changed.
I would consider this a bug (probably we didn't implement it as it wasn't needed in the past).
from es-operator.
Right now you should be able to "enable" autoscaling and just set min and max settings to the same value such that it can't autoscale. It's a bit of a hack, but could work as a workaround.
from es-operator.
Not sure that it will help. Let me describe the case:
- we had 12 pods and each index configured with 3 replicas, so
minIndexReplicas=3
- since our traffic is very spiky we wanted to be prepared for morning peak by increasing pods count and index replicas beforehand.
- so we updated pods to 18 and
minIndexReplicas=5
- we expected that es-operator immediately change replica count right after configuration apply, but this not happened.
- so we had to manually update each index with "number_of_replicas" : 5 which is not quite convenient
- as we understood es operator applies
minIndexReplicas
only on "scale trigger", e.g. high cpu consumption. Which does not work for cases when we want to be pre-scaled.
So we do not mind to have autoscaling, but also it would be good to applyminIndexReplicas
to all indices immediately using config.
Here is our config:
https://github.bus.zalan.do/Phoenix/lounge-elasticsearch/blob/master/deploy/prod/apply/eds.yaml
from es-operator.
Closed via #157. Thank you for the contribution.
from es-operator.
Related Issues (20)
- Handling for system indices HOT 2
- Interest in contributing to OpenSearch HOT 12
- Unable to create "Persistent Volume Claims" HOT 3
- Infinite loop while updating EDS HOT 1
- Deprecation Warning "policy/v1beta1 PodDisruptionBudget is deprecated"
- Document spec.excludeSystemIndices
- Elasticsearch data pods don't come up HOT 7
- Document runbook in case of emergency
- Pod stuck in migration HOT 2
- Could it be used with the eck operator? HOT 1
- Auto-scaling does not work HOT 3
- Using Zalando's ScalingSchedule to Scale EDS Instances HOT 2
- Elastic8 - security HOT 3
- Calculate and set total_shards_per_node per index
- Logging Configuration to set log format to json
- Does it not support automatic increase in the number of primary shards? HOT 2
- operator stuck in scale down loop HOT 4
- Enable Interruption of Node Drain Retries by New Operations in es-operator HOT 1
- Unify draining parameters
- exec /es-operator: exec format error
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from es-operator.