http experiments finish the pod service not recovery

[howtosolveit]

http experiments finish the pod service not recovery

[STRRL]

HI @howtosolveit , could you provide the log of chaos-daemon? it could help a lot for profiling.

[howtosolveit]

Sorry for providing the logs very late ; here is the log

Chaos-daemon Version: version.Info{GitVersion:"chart-2.6.3", GitCommit:"b159d1c5a361ca350ca7789c9eb7fc917479db39", BuildDate:"2024-01-23T15:04:55Z", GoVersion:"go1.19.7", Compiler:"gc", Platform:"linux/amd64"}
2024-03-11T02:23:38.372Z INFO chaos-daemon.daemon-server chaos-daemon/main.go:80 grant access to /dev/fuse
2024-03-11T02:23:38.373Z INFO chaos-daemon.daemon-server chaos-daemon/main.go:86 remount /sys with read-write permission
2024-03-11T02:23:38.381Z INFO chaos-daemon.daemon-server runtime/asm_amd64.s:1594 Starting grpc endpoint {"address": "0.0.0.0:31767", "runtime": "containerd"}
2024-03-11T02:23:38.381Z INFO chaos-daemon.daemon-server runtime/asm_amd64.s:1594 Starting http endpoint {"address": "0.0.0.0:31766"}
2024-03-11T02:31:10.410Z INFO chaos-daemon.daemon-server chaosdaemon/server.go:187 applying http chaos {"namespacedName": "default/httpd-756b6cd6cb-nt2lp"}
2024-03-11T02:31:10.413Z INFO chaos-daemon.daemon-server.background-process-manager.process-builder chaosdaemon/httpchaos_server.go:93 build command {"namespacedName": "default/httpd-756b6cd6cb-nt2lp", "command": "/usr/local/bin/nsexec -l -n /proc/6966/ns/net -p /proc/6966/ns/pid -- /usr/local/bin/tproxy -i -vv"}
2024-03-11T02:31:10.415Z INFO chaos-daemon.daemon-server pb/chaosdaemon.pb.go:4376 the length of actions {"namespacedName": "default/httpd-756b6cd6cb-nt2lp", "length": 1}
2024-03-11T02:31:10.415Z INFO chaos-daemon.daemon-server pb/chaosdaemon.pb.go:4376 ready to apply {"namespacedName": "default/httpd-756b6cd6cb-nt2lp", "config": "{"proxy_ports":[80],"rules":[{"target":"Request","selector":{"port":80,"path":"","method":"GET"},"actions":{"abort":true}}]}"}
�[2m2024-03-11T02:31:10.428362Z�[0m �[32m INFO�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::exec�[0m�[2m:�[0m transferring proxy raw config RawConfig { proxy_ports: Some("80"), listen_port: 1025, safe_mode: false, interface: None, rules: [RawRule { target: Request, selector: RawSelector { port: Some(80), path: Some(""), method: Some("GET"), code: None, request_headers: None, response_headers: None }, actions: RawActions { abort: Some(true), delay: None, replace: None, patch: None } }], tls: None }
�[2m2024-03-11T02:31:10.428394Z�[0m �[32m INFO�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::uds_server�[0m�[2m:�[0m Uds listener try binding "/tmp/e53b05cf-3331-48b0-90c1-00b88520cf38.sock"
�[2m2024-03-11T02:31:10.428572Z�[0m �[32m INFO�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::exec�[0m�[2m:�[0m Network device name eth0
�[2m2024-03-11T02:31:10.460445Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.conf.367ff703-7ce0b1.arp_filter = 1

�[2m2024-03-11T02:31:10.611521Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.ip_forward = 1

�[2m2024-03-11T02:31:10.613536Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.ip_nonlocal_bind = 1

�[2m2024-03-11T02:31:10.615575Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.conf.367ff703-7ce0b2.rp_filter = 0

�[2m2024-03-11T02:31:10.617931Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.conf.veth0.rp_filter = 0

�[2m2024-03-11T02:31:10.620383Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.conf.veth1.rp_filter = 0

�[2m2024-03-11T02:31:10.622649Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.conf.lo.rp_filter = 0

�[2m2024-03-11T02:31:10.624745Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::bridge�[0m�[2m:�[0m stdout : net.ipv4.conf.all.rp_filter = 0

�[2m2024-03-11T02:31:10.632004Z�[0m �[32m INFO�[0m �[2mchaos_tproxy::proxy::uds_server�[0m�[2m:�[0m Uds listener listening on "/tmp/e53b05cf-3331-48b0-90c1-00b88520cf38.sock"
�[2m2024-03-11T02:31:10.747560Z�[0m �[34mDEBUG�[0m �[1mhandle�[0m�[1m{�[0m�[3mproxy�[0m�[2m=�[0mProxy { opt: ProxyOpt { ipc_path: "/tmp/338cb870-f144-43c8-927b-fd056a885b7f.sock", verbose: 2 }, net_env: NetEnv { netns: "05f42e28-e91ens", device: "eth0", ip: "targetip/32", bridge1: "05f42e28-e91eb1", bridge2: "05f42e28-e91eb2", veth1: "05f42e28-e91ev1", veth2: "veth0", veth3: "veth1", veth4: "05f42e28-e91ev4", save_routes: [RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 32, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 253, kind: 1, flags: (empty) }, nlas: [Table(254), Destination([169, 254, 1, 1]), Oif(3)] }, RouteMessage { header: RouteHeader { address_family: 2, destination_prefix_length: 0, source_prefix_length: 0, tos: 0, table: 254, protocol: 3, scope: 0, kind: 1, flags: (empty) }, nlas: [Table(254), Gateway([169, 254, 1, 1]), Oif(3)] }] }, rtnl_handle: Handle(ConnectionHandle { requests_tx: UnboundedSender(Some(UnboundedSenderInner { inner: UnboundedInner { state: 9223372036854775808, message_queue: Queue { head: 0x55b8c57ea220, tail: UnsafeCell { .. } }, num_senders: 1, recv_task: AtomicWaker } })) }), sender: Some(Sender { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), rx: Some(Receiver { inner: Some(Inner { state: State { is_complete: false, is_closed: false, is_rx_task_set: false, is_tx_task_set: false } }) }), task: None } �[3mrequest�[0m�[2m=�[0mRequest { method: PUT, uri: /, version: HTTP/1.1, headers: {"host": "", "user-agent": "Go-http-client/1.1", "content-length": "125"}, body: Body(Streaming) }�[1m}�[0m�[2m:�[0m �[2mchaos_tproxy::proxy::net::ping�[0m�[2m:�[0m ping gateway 169.254.1.1
�[2m2024-03-11T02:31:10.747875Z�[0m �[32m INFO�[0m �[2mchaos_tproxy::proxy::exec�[0m�[2m:�[0m Proxy executor Starting proxy.
2024-03-11T02:31:10.748Z INFO chaos-daemon.daemon-server pb/chaosdaemon.pb.go:4376 http chaos applied {"namespacedName": "default/httpd-756b6cd6cb-nt2lp"}
�[2m2024-03-11T02:31:10.748799Z�[0m �[32m INFO�[0m �[2mchaos_tproxy::proxy::exec�[0m�[2m:�[0m Proxy executor Proxy is running.
�[2m2024-03-11T02:31:10.754147Z�[0m �[32m INFO�[0m �[2mchaos_tproxy_proxy�[0m�[2m:�[0m Proxy get uds path "/tmp/e53b05cf-3331-48b0-90c1-00b88520cf38.sock"
�[2m2024-03-11T02:31:10.754174Z�[0m �[34mDEBUG�[0m �[2mchaos_tproxy_proxy::uds_client�[0m�[2m:�[0m try connect path : "/tmp/e53b05cf-3331-48b0-90c1-00b88520cf38.sock"
�[2m2024-03-11T02:31:10.754275Z�[0m �[32m INFO�[0m �[2mchaos_tproxy::proxy::uds_server�[0m�[2m:�[0m Uds server Config successfully transferred.
�[2m2024-03-11T02:31:10.754438Z�[0m �[34mDEBUG�[0m �[2mchaos_tproxy_proxy::uds_client�[0m�[2m:�[0m Read data successfully.
�[2m2024-03-11T02:31:10.754486Z�[0m �[34mDEBUG�[0m �[2mchaos_tproxy_proxy::uds_client�[0m�[2m:�[0m Deserialize data successfully.
�[2m2024-03-11T02:31:10.754648Z�[0m �[32m INFO�[0m �[2mchaos_tproxy_proxy�[0m�[2m:�[0m Proxy Starting
�[2m2024-03-11T02:31:10.754757Z�[0m �[32m INFO�[0m �[2mchaos_tproxy_proxy::proxy::http::server�[0m�[2m:�[0m Proxy Listening
�[2m2024-03-11T02:31:19.400683Z�[0m �[34mDEBUG�[0m �[2mchaos_tproxy_proxy::proxy::http::server�[0m�[2m:�[0m {remote = remoteip:60727, target = targetip:80 } : Proxy is handling http requet
�[2m2024-03-11T02:31:19.400708Z�[0m �[34mDEBUG�[0m �[2mchaos_tproxy_proxy::proxy::http::server�[0m�[2m:�[0m {remote = remoteip:60727, target = targetip:80 } : request matched, rule(Rule { target: Request, selector: Selector { port: Some(80), path: Some(WildMatch { pattern: [State { next_char: None, has_wildcard: true }] }), method: Some(GET), code: None, request_headers: None, response_headers: None }, actions: Actions { abort: true, delay: None, replace: None, patch: None } })
�[2m2024-03-11T02:31:19.400881Z�[0m �[32m INFO�[0m �[2mchaos_tproxy_proxy::proxy::http::server�[0m�[2m:�[0m fail to serve http: error from user's Service: Abort applied
2024-03-11T02:32:10.038Z INFO chaos-daemon.daemon-server chaosdaemon/server.go:187 applying http chaos {"namespacedName": "default/httpd-756b6cd6cb-nt2lp"}
2024-03-11T02:32:10.038Z INFO chaos-daemon.daemon-server pb/chaosdaemon.pb.go:4376 the length of actions {"namespacedName": "default/httpd-756b6cd6cb-nt2lp", "length": 0}
2024-03-11T02:32:10.038Z INFO chaos-daemon.daemon-server pb/chaosdaemon.pb.go:4376 ready to apply {"namespacedName": "default/httpd-756b6cd6cb-nt2lp", "config": "{"rules":[]}"}
�[2m2024-03-11T02:32:10.147760Z�[0m �[32m INFO�[0m �[2mchaos_tproxy::proxy::exec�[0m�[2m:�[0m Proxy executor killing sub process
2024-03-11T02:32:10.149Z INFO chaos-daemon.daemon-server pb/chaosdaemon.pb.go:4376 http chaos applied {"namespacedName": "default/httpd-756b6cd6cb-nt2lp"}