Local strategy fails on port forwarding in our case of cross-cluster migration (error upgrading connection: Unauthorized)

[lgyurci]

Local strategy fails on port forwarding in our case of cross-cluster migration (error upgrading connection: Unauthorized)

[utkuozdemir]

Thanks for the detailed report.

Can you retry with the args --log-level=debug --log-format=json? It might shed some light on the underlying error.

[lgyurci]

Sure. I don't see any extra info in it unfortunately.

{"dest":"vol-claim","dest_ns":"testns","level":"info","msg":":bulb: PVC vol-claim is mounted to node cluster1-node2, ignoring...","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:55+02:00"}
{"dest":"vol-claim","dest_ns":"testns","level":"info","msg":":bulb: PVC vol-claim is mounted to node cluster2-node1, ignoring...","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:55+02:00"}
{"dest":"vol-claim","dest_ns":"testns","level":"info","msg":":thought_balloon: Will attempt 1 strategies: local","source":"vol-claim","source_ns":"testns","strategies":"local","time":"2023-08-21T09:15:55+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"info","msg":":helicopter: Attempting strategy: local","source":"vol-claim","source_ns":"testns","strategy":"local","time":"2023-08-21T09:15:55+02:00"}
{"dest":"vol-claim","dest_ns":"testns","level":"info","msg":":key: Generating SSH key pair","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:55+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"creating 4 resource(s)","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:57+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"beginning wait for 4 resources with timeout of 1m0s","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:57+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Deployment is not ready: testns/pv-migrate-daeec-src-sshd. 0 out of 1 expected pods are ready","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:57+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Deployment is not ready: testns/pv-migrate-daeec-src-sshd. 0 out of 1 expected pods are ready","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:15:59+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Deployment is not ready: testns/pv-migrate-daeec-src-sshd. 0 out of 1 expected pods are ready","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:16:01+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"creating 4 resource(s)","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:16:05+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"beginning wait for 4 resources with timeout of 1m0s","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:16:05+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Deployment is not ready: testns/pv-migrate-daeec-dest-sshd. 0 out of 1 expected pods are ready","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:16:05+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Deployment is not ready: testns/pv-migrate-daeec-dest-sshd. 0 out of 1 expected pods are ready","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:16:07+02:00"}
{"dest":"vol-claim","dest_ns":"testns","error":"error upgrading connection: Unauthorized","level":"error","msg":":cross_mark: Error on port-forward","name":"pv-migrate-daeec-src-sshd-76b7f4556-2rm7w","ns":"testns","port":36935,"source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:09+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"info","msg":":broom: Cleaning up","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:39+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"uninstall: Deleting pv-migrate-daeec-src","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:39+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"uninstall: given cascade value: , defaulting to delete propagation background","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-src-sshd\" Service","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-src-sshd\" Deployment","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-src-sshd\" Secret","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-src-sshd\" ServiceAccount","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"beginning wait for 4 resources to be deleted with timeout of 1m0s","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"purge requested for pv-migrate-daeec-src","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:40+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"uninstall: Deleting pv-migrate-daeec-dest","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:41+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"uninstall: given cascade value: , defaulting to delete propagation background","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-dest-sshd\" Service","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-dest-sshd\" Deployment","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-dest-sshd\" Secret","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"Starting delete for \"pv-migrate-daeec-dest-sshd\" ServiceAccount","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"beginning wait for 4 resources to be deleted with timeout of 1m0s","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"debug","msg":"purge requested for pv-migrate-daeec-dest","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","id":"daeec","level":"info","msg":":sparkles: Cleanup done","source":"vol-claim","source_ns":"testns","time":"2023-08-21T09:17:42+02:00"}
{"dest":"vol-claim","dest_ns":"testns","error":"timed out waiting for port-forward to be ready","id":"daeec","level":"warning","msg":":large_orange_diamond: Migration failed with this strategy, will try with the remaining strategies","source":"vol-claim","source_ns":"testns","strategy":"local","time":"2023-08-21T09:17:42+02:00"}```