Comments (10)
I think this is a race condition with how the resources in examples/quickstart
are created... we create 2 configmaps, one with /etc/sonobuoy/config.json
, and one with /etc/sonobuoy/plugins.d/*
... it's possible the pod launched after the config.json was available but before the plugins.d files were.
If you do kubectl -n heptio-sonobuoy delete pod sonobuoy
and re-run the kubectl apply -f ./examples/quickstart
, does it work for you then?
from sonobuoy.
thanks a lot @kensimon ! it worked this time after I have deleted pod!
from sonobuoy.
I am still getting this issue : Configured plugin systemd_logs does not exist
I tried the work around as described above but no joy after two attempts.
Environment is :
heptio-sonobuoy Pods
No resources found, use --show-all to see completed objects.
heptio-sonobuoy Services
NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
sonobuoy-master 10.31.243.189 <none> 8080/TCP 57m
Nodes
NAME STATUS AGE VERSION EXTERNAL-IP OS-IMAGE KERNEL-VERSION
gke-heptio-sonobuoy-default-pool-d1297397-7ztn Ready 1h v1.6.7 35.198.193.241 Container-Optimized OS from Google 4.4.52+
gke-heptio-sonobuoy-default-pool-d1297397-cwkf Ready 1h v1.6.7 35.198.210.119 Container-Optimized OS from Google 4.4.52+
gke-heptio-sonobuoy-default-pool-d1297397-k001 Ready 1h v1.6.7 35.198.215.38 Container-Optimized OS from Google 4.4.52+
Error is :
jamesb@Surface:~/sonobuoy$ kubectl logs -f sonobuoy --namespace=heptio-sonobuoy
I0818 08:09:05.243769 1 loader.go:47] Scanning plugins in ./plugins.d (pwd: /)
I0818 08:09:05.243991 1 loader.go:47] Scanning plugins in /etc/sonobuoy/plugins.d (pwd: /)
I0818 08:09:05.244059 1 loader.go:47] Scanning plugins in ~/sonobuoy/plugins.d (pwd: /)
E0818 08:09:05.244103 1 master.go:50] Configured plugin systemd_logs does not exist
from sonobuoy.
reopening, @kensimon could you please verify.
from sonobuoy.
I've seen this when I have an invalid configuration in my plugin. @jamesbuckett If you provide your plugin we can at least rule that out.
from sonobuoy.
I'm seeing this issue as well. It happens about every third time I start a test.
My environment:
core@ip-10-223-11-108 ~ $ kubectl get svc --all-namespaces
NAMESPACE NAME CLUSTER-IP EXTERNAL-IP PORT(S) AGE
default default-http-backend 10.233.211.83 <none> 80/TCP 4d
default kubernetes 10.233.0.1 <none> 443/TCP 4d
heptio-sonobuoy sonobuoy-master 10.233.18.18 <none> 8080/TCP 21m
kube-system heapster 10.233.156.200 <none> 80/TCP 4d
kube-system kubedns 10.233.0.3 <none> 53/UDP,53/TCP 4d
kube-system kubernetes-dashboard 10.233.134.41 <none> 9090/TCP 4d
kube-system monitoring-grafana 10.233.150.152 <none> 80/TCP 4d
kube-system monitoring-influxdb 10.233.161.142 <none> 8083/TCP,8086/TCP 4d
kube-system nginx-ingress-lb 10.233.138.40 <nodes> 80:31103/TCP,443:30755/TCP,442:30146/TCP 4d
core@ip-10-223-11-108 ~ $ kubectl get no
NAME STATUS AGE VERSION
ip-10-223-11-108.us-west-2.compute.internal Ready,SchedulingDisabled 4d v1.6.4+coreos.0
ip-10-223-11-70.us-west-2.compute.internal Ready 4d v1.6.4+coreos.0
ip-10-223-3-100.us-west-2.compute.internal Ready 4d v1.6.4+coreos.0
ip-10-223-3-106.us-west-2.compute.internal Ready,SchedulingDisabled 4d v1.6.4+coreos.0
ip-10-223-5-189.us-west-2.compute.internal Ready 4d v1.6.4+coreos.0
The error
core@ip-10-223-11-108 ~ $ kubectl logs -f sonobuoy --namespace=heptio-sonobuoy
I0924 10:56:52.828142 1 loader.go:47] Scanning plugins in ./plugins.d (pwd: /)
I0924 10:56:52.828261 1 loader.go:47] Scanning plugins in /etc/sonobuoy/plugins.d (pwd: /)
I0924 10:56:52.828292 1 loader.go:47] Scanning plugins in ~/sonobuoy/plugins.d (pwd: /)
E0924 10:56:52.828366 1 master.go:50] Configured plugin systemd_logs does not exist
from sonobuoy.
Thx for reporting, I'll start investigating early this week.
from sonobuoy.
So I'll add more verbose logging to try and help diagnose, but I wonder if there was a config map mount race that exists in 1.6?
from sonobuoy.
So I'm traipsing through the control flow and nothing stands out atm. I'll have a PR to add more logging so we should get better visibility when the condition occurs, but I'm still leaning that this is a race condition on config map mounting.
from sonobuoy.
I'm going to untag this release and wait on feedback from testing. I've added more logging so if the issue occurs again we should have a better bead on whether it's a race condition or not.
from sonobuoy.
Related Issues (20)
- Sonoboy status returns incorrect information
- Notice of K8s Release
- namespace already exists error HOT 1
- sonobuoy status is still running when Remaining: 0
- gojson processing passes failing tests
- Notice of K8s Release
- Notice of K8s Release
- Notice of K8s Release
- Running conformance test on 1.29.0-alpha.3 cluster with sonobuoy fails HOT 2
- Use `debug.BuildInfo` instead of stamping SHA
- Notice of K8s Release
- Custom junit plugin - failures in result file, but sonobuoy says it passed HOT 1
- Notice of K8s Release
- `sonobuoy wait` requires `--wait` flag to be functional
- Notice of K8s Release
- Kubernetes 1.28.6 E2E tests are not running due to unschedulable master node HOT 2
- Node selector / Node affinity behavior is inconsistent with Kubernetes Scheduler
- Notice of K8s Release
- Sonobuoy is still built within Golang 1.19
- Sonobuoy library v0.57.1 has wrong version in pkg/buildinfo/version.go
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sonobuoy.