Vagrant test environment missing cryptography method

[istresearch]

Vagrant test environment missing cryptography method

[madisonb]

@anderfjord Unfortunately sometimes apache changes the archive repos and it goes un noticed until someone like you tries to use them. I think the dev branch has the correct archive urls, would you mind destroying your VM and rebuilding from that branch? I just tried it and it worked. In the future this will be mitigated by #45 and then at some point #48.

As for your python package dependencies. The current VM is not set up to install Scrapy natively, you need to use the conda environment which is outlined here around step 7.

I agree that the master branch should be updated to the newest urls so you can follow that documentation nicely.

[madisonb]

After further testing I have verified that both the dev and master branches are broken with the way we provision the quick start environment. I don't know what has happened to cause this but my guess is that conda has changed the way that they do things.

While I continue testing, you have the core products scrapy cluster needs running at scdev (or use the IP address). You can use a virtualenv to install the pip requirements, or another linux flavored machine as long as your code can talk to the kafka and zookeeper hosts located at scdev.

[anderfjord]

Okay, I will revisit it soon. Thanks very much for the prompt and detailed response.

[madisonb]

I am going to close this soon as the PR above fixes this and demonstrates the whole stack in the virtual machine.

[anderfjord]

Sounds good. Thanks.

[madisonb]

Both dev and master branches successfully run all unit and integration tests. Closing.

https://travis-ci.org/istresearch/scrapy-cluster/branches