Comments (4)
Zk operator is not a hard req. I recommend disabling it and instead run a zk ensemble with bitnamiβs zk helm chart which also has more up to date zk images.
from solr-operator.
@mmoscher We run on arm64 graviton machines on AWS and the default zookeeper-operator image shipped with it, does not support running on graviton for us. It does on m1/m2/m3 because of rosetta (I think) but on a "just arm64" cloud instance we cannot get it to run.
You are right that this is more of an issue on the zookeeper-operator but as that ships as a hard dependency of the solr-operator and as there are no alternatives available other than running some amd64 machines, I do think this is related to the solr operator itself as a project too.
Did you manage to get the zookeeper-operator build for arm64 working? Because I'd love to use your branch as I don't expect any upstream fixes to be merged any time soon as the zookeeper-operator maintenance seem to have stalled a bit.
from solr-operator.
@fliphess yes ya totally right. We're running the zookeeper-operator as well.
Just double-checked our local deployment. Colima spawns - when running with k3s - an aarch64 instance as default (which should be the same as arm64). However the mac virtualization does some magic as well. Zookeeper itself claims to be running in amd64:
Didn't know this yet, learned something new today π . Need to double-check this tomorrow. This, however, explains why we do not have any issues running our deployment locally on m1/m2 macs.
Nevertheless, 2 years ago - when prepping for the macs to arrive - I managed to get up and running our local deployment on a GCP Tau T2A instance.
Thus, I was able to run the zookeeper-operator on ARM. So you should be able to use my branch/fork for it.
Feel free to contribute back any changes/fixers you need to make on the way. Maybe it will be merged upstream any time soon. Keep in mind that need to build both, the operator and the zookeeper image itself. Furthermore, keep in mind that you need to have buildx with qmeu in-place or you have to run your builds directly in the graviton machines.
My wrapper script to perform the build was the following:
#!/usr/bin/env bash
set -e
pushd "/tmp"
echo "[INFO] Building zookeeper operator ..."
git clone [email protected]:mmoscher/zookeeper-operator.git && pushd "zookeeper-operator"
TAG=0.2.14
REPO=your-repo/zookeeper
docker buildx build \
--push \
--build-arg VERSION=$TAG \
--platform=linux/amd64,linux/arm64 \
-t ${REPO}-operator:$TAG \
.
docker buildx build \
--push \
--build-arg VERSION=$TAG \
--platform=linux/amd64,linux/arm64 \
-t ${REPO}:$TAG \
./docker
popd
rm -rf zookeeper-operator
echo "[INFO] zookeeper operator done ..."
Hf π»
from solr-operator.
@fliphess what issue do face in particular?
We've currently 5 developers on Mac M1 or M2 (arm64) using colima for local development, and they are able to use the solr-operator smoothly. For setup we use Zookeeper as dependency only and do not, for some time past, deploy the operator separately.
Using the Zookeepers CRDs got use covered:
# Install all Solr CRDs as well as the dependency CRDS (ZookeeperCluster) for the given version of the Solr Operator
kubectl create -f "https://solr.apache.org/operator/downloads/crds/<solr operator version>/all-with-dependencies.yaml"
cf. https://apache.github.io/solr-operator/docs/running-the-operator#the-zookeepercluster-crd
However, if you prefer to using the operator, you can try to get the following PR merged. I started to implement arm64 support 2 years ago, but didn't had (and not have) the time to get it finished yet:
pravega/zookeeper-operator#504
One way or another, this (your) issue is IMHO not related to the solr-operator.
from solr-operator.
Related Issues (20)
- Support replicaPlacementFactory in solr.xml HOT 2
- Liveness probe failing for Prometheus Exporter connected to a large SolrCloud
- Disabling PodDisruptionBudgets for both zk pods and solr pods HOT 3
- adding automountServiceAccountToken HOT 1
- Replica allocation after Node is DisabledScheduling HOT 1
- zkHost and zkServer generated incorrectly - helm templates HOT 2
- Solr 8.11 with SolrMetrics produces duplicate samples with prometheus v2.52 HOT 12
- Scale down operation fails and is never requeued if `getReplicasForPod` fails transiently HOT 2
- Configure Resources for zookeeper operator HOT 1
- Allow resizing (expanding) of persistent data PVCs
- Upgrade from Kubebuilder 3 to 4
- SolrOperator leads to 404 HOT 1
- Facing trouble while restoring solr in 8.11.3 HOT 1
- Job Solr-operator-zookeeper-operator-pre-delete without limits
- Unable to pass shareProcessNamespace to PodOptions
- It is impossible to setup TLS between Solr and Zookeeper HOT 1
- Cannot specify an imagePullSecret for solr-operator Helm chart
- Configuration of Solr MultiAuthplugin with JWT and basic auth gives the error of PKI authentication on creating cores. HOT 9
- [Regression] security.json is not uploaded during the first initialization of SolrCloud HOT 1
- How to keep the configsets directiory in solr pods with deployed with helm chart
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from solr-operator.