Validators cannot discover P2P peers when running as `StatefulSet` in k8s

[mazzy89]

Validators cannot discover P2P peers when running as `StatefulSet` in k8s

[mazzy89]

The code

gno/tm2/pkg/p2p/switch.go

Line 495 in 90aa89c

if _, ok := err.(NetAddressLookupError); ok {

suggests that DNS lookup errors are actually ignored and skipped. However the final result is that

2024-06-18T09:29:44.285Z	DEBUG	Blockpool has no peers	{"module": "blockchain"}

there are no peers added.

[mazzy89]

A workaround adopted by many upstream similar services which rely on bootstrap to discover other peers is to introduce publishNotReadyAddresses: true. This solves the problem.

[mazzy89]

Reopening the issue. Seems that even introducing publishNotReadyAddresses: true in the Service does not help. Some nodes gets up properly, while some other fails. The overall bootstrap mechanism is not deterministic. I would wonder whether a retry in the DNS lookup would help.l

[mazzy89]

Gave it another try and seems that after few seconds that node retries to correct to the peers which at that point have DNS available and the lookup succedeed. We can close this.