Comments (3)
We run this in either AWS ECS or EKS, so Kubernetes with multiple pods and a load balancer in front.
Have a look at these projects Waggle Dance is a part of them they focus on the deployment you might find some pointers in there:
https://github.com/ExpediaGroup/apiary-federation
https://github.com/ExpediaGroup/apiary-data-lake
Load balancing MySQL: Waggle Dance doesn't use any RDS, so I think you mean the connection from Hive to an MySQL DB that's outside of the scope of this project.
from waggle-dance.
We run this in either AWS ECS or EKS, so Kubernetes with multiple pods and a load balancer in front. Have a look at these projects Waggle Dance is a part of them they focus on the deployment you might find some pointers in there: https://github.com/ExpediaGroup/apiary-federation https://github.com/ExpediaGroup/apiary-data-lake
Load balancing MySQL: Waggle Dance doesn't use any RDS, so I think you mean the connection from Hive to an MySQL DB that's outside of the scope of this project.
Sorry for replay later.
There are many HMSs in our scenario, and we plan to deploy many waggle instances as well. If one of the waggle instances hangs, the client can automatically switch to another waggle instance. How can we achieve this? Our environment has nothing to do with the cloud, it's all physical machines.
from waggle-dance.
@flaming-archer Are you trying to play multiple HMS service in a single connection? like:
thrift://wd-service-1:48869;wd-service-2:48869
Or you are looking for WD accept multiple HMS endpoint when you have HA enabled ?
from waggle-dance.
Related Issues (20)
- Hive 3 support HOT 6
- Support Presto views
- add support for single char dot wildcard in like queries
- Delete database failed
- improve metrics by tagging the call and metastore.
- mvn clean package failed HOT 7
- Hiveserver2 uses the metastore url service of the waggle dance. Operating to modify the table partition in the same session will change the ugi permission of the session
- CloseableThriftHiveMetastoreIfaceClientFactory new instance get blocked HOT 1
- Hive default database fails to pass the verification HOT 2
- how to disable spring actuator HOT 5
- Waggle-dance does not support DIGEST protocol HOT 2
- Connecting WD via Beeline HOT 4
- Tesing WD with CDH 3.x version HOT 2
- Kerberos Issue HOT 12
- Hive3.x get_table_meta null pointer exception HOT 6
- Add configuration to enable exposing all monitoring data through Prometheus" HOT 3
- General Enquires on WD HOT 2
- The `waggle-dance-federation.yml` file is updated when Waggledance is stopped. HOT 1
- Use different tokens instead of forcing WD and all HMS to use the same delegatetoken in the kerberos environment HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from waggle-dance.