Cannot open 10.5.0.2:8080 spark-master

[mvillarrealb]

Cannot open 10.5.0.2:8080 spark-master

[alonsoir]

Ok, running docker ps command, i see that i can log in to spark-master through 0.0.0.0:8080

aironman@MacBook-Pro-Retina-de-Alonso ~/s/docker-spark-cluster> docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
078f68413ff8 spark-worker:2.4.0 "/bin/bash /start-wo…" 24 minutes ago Up 24 minutes 0.0.0.0:8081->8081/tcp spark-worker-1
54e5de895719 spark-worker:2.4.0 "/bin/bash /start-wo…" 24 minutes ago Up 24 minutes 0.0.0.0:8083->8081/tcp spark-worker-3
6674435b67fc spark-worker:2.4.0 "/bin/bash /start-wo…" 24 minutes ago Up 24 minutes 0.0.0.0:8082->8081/tcp spark-worker-2
0fba81be71b1 spark-master:2.4.0 "/bin/bash /start-ma…" 24 minutes ago Up 24 minutes 0.0.0.0:7077->7077/tcp, 6066/tcp, 0.0.0.0:8080->8080/tcp spark-master

[alonsoir]

I think I have to reopen it because spark-master tells me that workers are in those ip directions when they are pointing all at the same ip only at different ports. I'm testing it on a 16GB laptop.

[alonsoir]

There are three workers in the same external ip, 0.0.0.0:8081. It should be differents ips using different ports, isnt?

[mvillarrealb]

Every port binding is forwarded internally to 8081(spark-worker port) however the external port(your host machine) is pointing to different ports 8080(master-ui),7070(master-spark-submit),8081(worker1),8082(worker2),8083(worker3)

[mvillarrealb]

you can check the spark-ui on the brower:
http://localhost:8080/
http://localhost:8081/
http://localhost:8082/
http://localhost:8083/

You cannot access the ip addresses 10.0.x.x directly(Those are the container networking addresses)

[alonsoir]

Yes, i can see it, but, So why when I try to enter a worker from the localhost:8080 driver, try to enter using the internal ips?