Comments (2)
Hi, could you please gather Events
section from kubectl describe
command for your automation job pod, when the issue occurred?
kubectl -n awx describe pod automation-job-3583-shdjp
Maybe you can get some events at the bottom of the output like this:
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 37s default-scheduler Successfully assigned awx/automation-job-1-vc4c4 to kuro-c9s01.krkb.lab
Normal Pulling 37s kubelet Pulling image "quay.io/ansible/awx-ee:latest"
Normal Pulled 8s kubelet Successfully pulled image "quay.io/ansible/awx-ee:latest" in 29.325s (29.326s including waiting)
Normal Created 8s kubelet Created container worker
Normal Started 8s kubelet Started container worker
I suspect that your pod takes much time to pulling image from container registry. In above example, pulling image takes 29 seconds (see the Message
column for the line Pulled
, or calculate difference between the Age
for Pulling
(37s) and Pulled
(8s)).
You can see which events takes much time until Created
event is recorded.
If the pulling image is taking a long time, there is not much that can be done.
- Reduce the chances to pull container image by changing pull policy to
Missing
for your EE for your Job Template - Speed up the connection to the container registry
- Increase K3s storage capacity
/var/lib/rancher
to reduce the removal cached images by garbage collection by kubelet (see this official docs) - Store your EE images on the private container registry in the same network, or on the same K3s host and make AWX to use EE image from container registry
from awx-on-k3s.
Hello Mr. Kurokobo, spot on, it was indeed the pulling of awx-ee:latest
Normal Pulling 2m7s kubelet Pulling image "quay.io/ansible/awx-ee:latest"
I am going to change the pull policy to Missing. I will also add some space to /var/lib/rancher
I really appreciate the advice and help. I will close this and thank you once again.
from awx-on-k3s.
Related Issues (20)
- TODO: Bump Galaxy Operator version to 2024.5.8
- awx-web pod going into CrashLoopBackoff with Operator 2.16.1 HOT 2
- how to enable ipv6? HOT 8
- TODO: Bump AWX Operator version to 2.17.0
- Frontend doesn't work HOT 6
- Yet another IPv6 question, dual stack k3s cluster, unable to route traffic to remote node HOT 5
- AWX tower URL redirection HOT 1
- Unable to send stdout from AWX to pod instance HOT 1
- TODO: Bump AWX Operator version to 2.18.0
- Authentication failed for Git repository - azure DevOps HOT 1
- How to use dynamic inventory from Netbox into AWX UI? HOT 10
- Possibility of execution instance(worker node) on another node/host/agent HOT 7
- TODO: Bump AWX Operator version to 2.19.0
- TODO: Bump AWX Operator version to 2.19.1
- Reverse proxy from docker traefik to AWX on same host HOT 2
- Change tls crt and key HOT 3
- How can I deploy a awx-on-k3s on many nodes HOT 2
- Where can files be stored so that they can be used in playbooks? HOT 6
- How to install awx on microk8s? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from awx-on-k3s.