Comments (5)
@Nils98Ar correct, only pods that use hostNetwork (e. g. cilium-agent) will be tracked, which causes mis-attribution. All other pod traffic won't be tracked at all.
from features-bugs.
Thanks for the enhancement request here. It seems worthwhile to add specific support for Cilium, perhaps via a container flag which can be configured via a Helm value. The current version of network costs doesn't actually use conntrack any longer and instead requires on sys calls to gather the traffic flows.
Instead of using conntrack tools, the conntrack information can be listed using
cilium bpf ct list
global in the Cilium agent, which runs in privilged mode as a DaemonSet on every node. As far as I know, the information is stored on the host in/sys/fs/bpf/tc/globals/cilium_ct4_global
.
So when it comes to adding support for Cilium in network costs, would its Pods be able to simply parse this file or would they need to possibly exec
into Cilium's agent Pods as well (or in place of)? Trying to understand the level of effort required to support Cilium here.
from features-bugs.
Hi @chipzoller, thanks for your response.
As far as I know, it is possible to programmatically read the ebpf information from any program running on the same host as the Cilium agent. I know that this was done by other people already. An example can be found in the linked project in my original post.
While it's possible to "exec" into the Cilium agent pod, I'd say you want to gather the information directly from the host system.
from features-bugs.
@fstr So the network cost feature does not currently work correctly if cilium kubeProxyReplacement is enabled?
from features-bugs.
@fstr @chipzoller Using the Kubernetes node's traffic flow information also does not work with the Cilium default routing mode encapsulation/tunnel (vxlan/geneve) regardless of wether you run Cilium kube-proxy-less or not. I think Ciliums conntrack information needs to be used here as well.
When pod p1
on node 1
communicates with a pod p2
on node 2
you only see a connection from pod p1
IP to node 2
IP ("remote node") in the traffic flows (at least in the conntrack table) on node 1
. You do not see the IP pod p2
there.
So you cannot use the traffic classification by destination (internet
, in-zone
, in-region
, etc.) for Pod-IPs within the Cluster. E.g. we wanted to add the Ingress Controllers Pod IPs to the internet destinations.
from features-bugs.
Related Issues (20)
- [Feature] Support `LOG_FORMAT` and `LOG_LEVEL` in cluster controller and network costs
- [Bug] network monitoring is empty HOT 5
- [Bug] cloud integration - spot datafeed - no datas HOT 2
- [Bug] full diagnostics cannot access (No change from "Running Diagnostics...") HOT 9
- [Bug] Turndown schedule deleted a few seconds after being deployed HOT 2
- [Feature] - Add ability to aggregate allocations by Provider ID HOT 1
- [Bug] Duckdb corruption after 2.2.5 upgrade HOT 7
- Request Right Sizing action created via Helm shows incorrect in UI HOT 13
- [Bug] cost-model image not available on aws ecr for release 2.3.2 HOT 1
- [Bug] Aggregator panics on QueryAssetCTE HOT 7
- [Bug] Cluster Controller stopped targeting namespace level annotations HOT 1
- [Bug] Alibaba Instance Price Error HOT 1
- [Bug] Allocation query fails due to a max concurrency semaphore error HOT 1
- You found an enterprise feature! HOT 1
- [Feature] Provide a configuration to restrict out of cluster cost dashboard HOT 1
- [Bug] Operation error Organizations: ListAccounts HOT 3
- [Bug] No data HOT 1
- [Feature] Support Kubernetes 1.30 in AWS Marketplace listing HOT 2
- [Bug] Crash Aggregator container HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from features-bugs.