How to leverage caching?

[lambci]

How to leverage caching?

[mhart]

And another thing I could suggest would be to setup a Dockerfile that uses lambci/lambda:build-python2.7 as a base and do your build in steps – that way you can leverage the caching that Docker layers provide you

[mhart]

If you're using the build image, then why not just put the cache directory in the current directory and save the extra -v call? Does that work for you?

[mhart]

Btw – this sounds like a pip error? Like, because it's being executed by root. Is there not some pip configuration you can change to ignore that error?

Other ppl run into similar issues in Docker here: pypa/pip#3596

[josegonzalez]

$ docker run --rm -v "$PWD":/var/task lambci/lambda:build-python2.7 pip install -r requirements.txt --cache-dir /var/task/.cache -t env
The directory '/var/task/.cache/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
The directory '/var/task/.cache' or its parent directory is not owned by the current user and caching wheels has been disabled. check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.

[mhart]

A few other things I could suggest:

1. Try a different directory that's not /tmp or /var/task – like /root/.cache
2. Change ownership of the directory, like:

docker run --rm -v "$PWD":/var/task lambci/lambda:build-python2.7 bash -c \
  'chown -R root /var/task/.cache && pip install -r requirements.txt --cache-dir /var/task/.cache -t env'

[josegonzalez]

I have this which seems to work:

docker run --rm -v \"$PWD\":/var/task lambci/lambda:build-python2.7 bash -c \
    'rsync -a /var/task/.cache/ /root/.cache/ || true && chown -R root /root/.cache && pip install -r requirements.txt -t env && rsync -a /root/.cache/ /var/task/.cache/'

Not sure on how to make this more approachable, but definitely a step in the right direction!