Cloudhub Start quic server only

[SherlockShemol]

Cloudhub Start quic server only

[wbc6080]

This article may help you with this question. https://mp.weixin.qq.com/s/P0pG8FoMgZsNcbVargK2gg

[wbc6080]

[SherlockShemol]

Thank you a lot!

[SherlockShemol]

I follow the instruction to start quic server only and the edgecore is successfully deployed.But I think the edge side can't communicate with the cloud side because I run kubectl get nodes there is no edge-side node. and the journal at edge side is

Mar 15 10:35:33 myarch edgecore[2060488]: I0315 10:35:33.293769 2060488 watcher.go:200] get storage revision:66352
Mar 15 10:35:33 myarch edgecore[2060488]: E0315 10:35:33.816299 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:37 myarch edgecore[2060488]: E0315 10:35:37.365614 2060488 storage.go:200] [metaserver/reststorage] failed to generate application: connecti
on lost between EdgeCore and CloudCore
Mar 15 10:35:37 myarch edgecore[2060488]: E0315 10:35:37.365662 2060488 storage.go:218] [metaserver/reststorage] failed to get a approved application for
 watch(/apis/networking.istio.io/v1alpha3/destinationrules) from cloud application center, connection lost between EdgeCore and CloudCore
Mar 15 10:35:37 myarch edgecore[2060488]: W0315 10:35:37.365686 2060488 watcher.go:93] base storage now only support rev == 0, but get rev == 6036, force
 set to 0!
Mar 15 10:35:37 myarch edgecore[2060488]: I0315 10:35:37.365827 2060488 watcher.go:230] start watching, rev:0
Mar 15 10:35:37 myarch edgecore[2060488]: I0315 10:35:37.365871 2060488 imitator.go:176] networking.istio.io/v1alpha3, Resource=destinationrules,,
Mar 15 10:35:37 myarch edgecore[2060488]: I0315 10:35:37.366152 2060488 watcher.go:200] get storage revision:66352
Mar 15 10:35:39 myarch edgecore[2060488]: E0315 10:35:39.225607 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"upgrade-ipam\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=upgrade-ipam pod=calico-node-fr2df_kube-system(6b8f5f3a-2ad6-
4593-aa62-475405b51ea2)\"" pod="kube-system/calico-node-fr2df" podUID="6b8f5f3a-2ad6-4593-aa62-475405b51ea2"
Mar 15 10:35:39 myarch edgecore[2060488]: E0315 10:35:39.226405 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"kube-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.k8s.io/kube-proxy:v1.28.3\\\"\"" pod="kube-system/kube-proxy-mvhht" p
odUID="12f5d503-0cce-44a9-9d0a-ea783ad0e14e"
Mar 15 10:35:40 myarch edgecore[2060488]: E0315 10:35:40.828021 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236281 2060488 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc erro
r: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\": plugin type=\"calico
\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]" podSandboxID="a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7
e9"
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236343 2060488 kuberuntime_manager.go:1305] "Failed to stop sandbox" podSandboxID={"Type":"conta
inerd","ID":"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9"}
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236401 2060488 kubelet.go:1851] failed to "KillPodSandbox" for "4b69473d-5044-4fa7-b944-46e11366
11e4" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f
7d8640cfad941e7e9\": plugin type=\"calico\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]"
Mar 15 10:35:41 myarch edgecore[2060488]: E0315 10:35:41.236435 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"KillPodSandbo
x\" for \"4b69473d-5044-4fa7-b944-46e1136611e4\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"a
954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\\\": plugin type=\\\"calico\\\" failed (delete): failed to find plugin \\\"calico\\\" in 
path [/opt/cni/bin]\"" pod="kube-system/calico-kube-controllers-558d465845-p52fm" podUID="4b69473d-5044-4fa7-b944-46e1136611e4"
Mar 15 10:35:47 myarch edgecore[2060488]: E0315 10:35:47.840379 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:53 myarch edgecore[2060488]: E0315 10:35:53.226135 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"kube-proxy\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.k8s.io/kube-proxy:v1.28.3\\\"\"" pod="kube-system/kube-proxy-mvhht" p
odUID="12f5d503-0cce-44a9-9d0a-ea783ad0e14e"
Mar 15 10:35:54 myarch edgecore[2060488]: E0315 10:35:54.225585 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"StartContaine
r\" for \"upgrade-ipam\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=upgrade-ipam pod=calico-node-fr2df_kube-system(6b8f5f3a-2ad6-
4593-aa62-475405b51ea2)\"" pod="kube-system/calico-node-fr2df" podUID="6b8f5f3a-2ad6-4593-aa62-475405b51ea2"
Mar 15 10:35:54 myarch edgecore[2060488]: E0315 10:35:54.851274 2060488 controller.go:146] "Failed to ensure lease exists, will retry" err="unmarshal mes
sage to lease failed, err: json: cannot unmarshal array into Go value of type client.LeaseResp" interval="7s"
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235006 2060488 remote_runtime.go:205] "StopPodSandbox from runtime service failed" err="rpc erro
r: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\": plugin type=\"calico
\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]" podSandboxID="a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7
e9"
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235066 2060488 kuberuntime_manager.go:1305] "Failed to stop sandbox" podSandboxID={"Type":"conta
inerd","ID":"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9"}
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235122 2060488 kubelet.go:1851] failed to "KillPodSandbox" for "4b69473d-5044-4fa7-b944-46e11366
11e4" with KillPodSandboxError: "rpc error: code = Unknown desc = failed to destroy network for sandbox \"a954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f
7d8640cfad941e7e9\": plugin type=\"calico\" failed (delete): failed to find plugin \"calico\" in path [/opt/cni/bin]"
Mar 15 10:35:55 myarch edgecore[2060488]: E0315 10:35:55.235158 2060488 pod_workers.go:1294] "Error syncing pod, skipping" err="failed to \"KillPodSandbo
x\" for \"4b69473d-5044-4fa7-b944-46e1136611e4\" with KillPodSandboxError: \"rpc error: code = Unknown desc = failed to destroy network for sandbox \\\"a
954a8c2bcb9a3893571d832ec2e4a24d6859fac490b59f7d8640cfad941e7e9\\\": plugin type=\\\"calico\\\" failed (delete): failed to find plugin \\\"calico\\\" in 
path [/opt/cni/bin]\"" pod="kube-system/calico-kube-controllers-558d465845-p52fm" podUID="4b69473d-5044-4fa7-b944-46e1136611e4"

Does this mean I have to use the calico plugin or am I doing something wrong? Can I use edgemesh to replace CNI plugin in quic condition as here said?

[SherlockShemol]

Problem solved.
I set the wrong iptable rules.
Before

sudo iptables -I DOCKER-USER 1 ! -i docker0 -o docker0 -p tcp -j ACCEPT -d $(minikube ip) --dport 10001
sudo iptables -t nat -A DOCKER ! -i docker0 -p tcp -j DNAT --dport 10001 --to-destination $(minikube ip):10001

After

sudo iptables -I DOCKER-USER 1 ! -i docker0 -o docker0 -p udp -j ACCEPT -d $(minikube ip) --dport 10001
sudo iptables -t nat -A DOCKER ! -i docker0 -p udp -j DNAT --dport 10001 --to-destination $(minikube ip):10001

UDP ,not TCP.