`RUN apk ...` in a Dockerfile can succeed while failing to install packages

[gliderlabs]

`RUN apk ...` in a Dockerfile can succeed while failing to install packages

[dpicky]

Python needs adding to Dockerfile in order for it to build

RUN apk --update add python

[chriswessels]

As an update, I've found that if you set the contents of the /etc/apk/repositories file to a list of mirrors, apk add is much more fault tolerant.

http://nl.alpinelinux.org/alpine/v3.1/main
http://nl.alpinelinux.org/alpine/v3.1/main
http://dl-2.alpinelinux.org/alpine/v3.1/main
http://dl-3.alpinelinux.org/alpine/v3.1/main
http://dl-4.alpinelinux.org/alpine/v3.1/main
http://dl-5.alpinelinux.org/alpine/v3.1/main
http://mirror.yandex.ru/mirrors/alpine/v3.1/main
http://repos.lax-noc.com/alpine/v3.1/main
http://distrib-coffee.ipsl.jussieu.fr/pub/linux/alpine/alpine/v3.1/main

Then run apk update and apk add ...

[kalak451]

I'm currently seeing exactly this same problem running in VirtualBox on a Ubuntu 14.04 image (using vagrants ubutntu/trusty64 box)

[kalak451]

I tracked down the cause of the "Resource temporarily unavailable" errors to intermittent DNS errors. I pointed the vagrant box straight to google's DNS servers and now everything is fine.

[andyshinn]

I think this might be an upstream issue with apk. I'm trying to find a good way to reproduce it so I can try and locate the bug.

[philm]

It looks like an issue with one of the mirrors. When using this image, the error pops up when http://dl-4.alpinelinux.org is called (set in

docker-alpine/versions/gliderlabs-3.1/options

Line 2 in 1845dc5

export MIRROR="http://dl-4.alpinelinux.org/alpine"

).

I discovered this when I switched over to https://github.com/mini-containers/base as the base image, which pulls from http://nl.alpinelinux.org.

[ifduyue]

I'm seeing this, too. It's dns errors like @kalak451 said.
But, if there are errors, apk add should fail.

I've submitted an issue to the upstream issue tracker. http://bugs.alpinelinux.org/issues/4019

[andyshinn]

It would likely be helpful to have steps for them to reproduce the issue outside of Docker. This would separate any dependency on Docker. I'm guessing that apk isn't failing correctly on bad DNS responses (which sometimes happen with the VirtualBox DNS proxy). But I haven't thought of a good way to reproduce this outside of Docker to eliminate that part of the chain for them.

[andyshinn]

It looks like @ncopa might have fixed this in http://git.alpinelinux.org/cgit/apk-tools/commit/?id=944eae4b27d039608dd72b1d7b3ed015c20bdcc0 and http://git.alpinelinux.org/cgit/apk-tools/commit/?id=7e3f4c3d7996811a37393514d6f0eaacae7178e2. Can someone who was experiencing the issue try manually installing http://dl-4.alpinelinux.org/alpine/edge/main/x86_64/apk-tools-2.6.0_rc1-r1.apk first and see if the issue persists?

[chriswessels]

I'm having the same problem. It's good that this has been fixed upstream (apk add emitting a failure code), but it's still not great to be pulling from a flaky mirror. Is there a way to switch the the pull location to http://nl.alpinelinux.org?

@andyshinn the apk link you reference is 404ing.

[ifduyue]

I can confirm that upstream has fixed this problem. However, it doesn't work in an exit-on-error way, you've to wait for the apk add to finish. Better than nothing.

@chriswessels +1
@andyshinn please consider adding more mirrors to /etc/apk/repositories

[andyshinn]

Can someone open a separate issue for more mirrors? I wasn't aware it would
do automatic fail over if one is down. Definitely something I'll test.
On Apr 29, 2015 8:51 PM, "Yue Du" [email protected] wrote:

I can confirm that upstream has fixed this problem. However, it doesn't
work in an exit-on-error way, you've to wait for the apk add to finish.
Better than nothing.

@chriswessels https://github.com/chriswessels +1
@andyshinn https://github.com/andyshinn please consider adding more
mirrors to /etc/apk/repositories

—
Reply to this email directly or view it on GitHub
#15 (comment)
.

[andyshinn]

I just pushed new gliderlabs/alpine:edge image which has the latest apk-tools with the exit on error fixes. I`m going to close this issue as the fixes should be available upstream in 3.2. Re-open this issue if it is still not erroring properly during build.

I'll work on the separate issue of multiple repositories for fail over separately.

[Dannyad84]

Python needs adding to Dockerfile in order for it to build

RUN apk --update add python

THANK YOU!