Comments (8)
@LagartoSeb - tried to find you online. Please e-mail me to see what's not working on your system.
from scrapybook.
Hi @lookfwd, glad to have your answer, I have the commented behaviour trying to access the box after running vagrant up --no-parallel
, I can't access through localhost:port, 0.0.0.0:port, nor http://web:port, the whole book is based on the Vagrant content to do the exercises and properly the content, so I don't how to continue with the book.
I'm not very happy using BeautifulSoup, that's why I wanted to read the book (:
from scrapybook.
Hello @LagartoSeb, I understand. Yes, Scrapy will give you a more complete framework than BeautifulSoup. You can see a comparison of the two frameworks here.
What I see from the output and commands you've provided is that everything went fine with the installation and there's probably some small operational problem e.g. using incorrect host/port. From "outside the VM" you would be using the following ports.
With Vagrant I give you 9 virtual servers pre-setup and although it might seem confusing, installing all this software properly would be close to impossible. As soon as you login to the system, all the examples will be working fine and you will have a system that you can operate in a similar way to a real production system.
Let's find out how to login though. Just send me an e-mail so we can chat, otherwise it will take too much time, figuring out if you use Windows, Mac etc. potentially going through putty settings... we will save time this way.
Cheers.
from scrapybook.
@lookfwd you're right, I very appreciate your attention, let's talk on Gitter
from scrapybook.
As far as I can tell, from our chat, this case is similar to this i.e. linux and native run with docker. In your case, upgrading docker to a more recent version worked like charm.
from scrapybook.
seems that I have the same problem:
root@ubuntu:/home/junjiyang/scrapybook# vagrant up --no-parallel
Bringing machine 'web' up with 'docker' provider...
Bringing machine 'spark' up with 'docker' provider...
Bringing machine 'es' up with 'docker' provider...
Bringing machine 'redis' up with 'docker' provider...
Bringing machine 'mysql' up with 'docker' provider...
Bringing machine 'scrapyd1' up with 'docker' provider...
Bringing machine 'scrapyd2' up with 'docker' provider...
Bringing machine 'scrapyd3' up with 'docker' provider...
Bringing machine 'dev' up with 'docker' provider...
==> web: Provisioners will not be run since container doesn't support SSH.
==> spark: Provisioners will not be run since container doesn't support SSH.
==> es: Provisioners will not be run since container doesn't support SSH.
==> redis: Provisioners will not be run since container doesn't support SSH.
==> mysql: Provisioners will not be run since container doesn't support SSH.
==> scrapyd1: Provisioners will not be run since container doesn't support SSH.
==> scrapyd2: Provisioners will not be run since container doesn't support SSH.
==> scrapyd3: Provisioners will not be run since container doesn't support SSH.
==> dev: Provisioners will not be run since container doesn't support SSH.
I searched the web but not come to a solution.
I tried vagrant ssh-config
somehow, and it send back to me like this:
Host web
HostName 172.17.0.2
User root
Port 22
UserKnownHostsFile /dev/null
StrictHostKeyChecking no
PasswordAuthentication no
IdentityFile /home/junjiyang/scrapybook/insecure_key
IdentitiesOnly yes
LogLevel FATAL
Host spark
HostName 172.17.0.3
User root
Port 22
UserKnownHostsFile /dev/null
StrictHostKeyChecking no
PasswordAuthentication no
IdentityFile /home/junjiyang/scrapybook/insecure_key
IdentitiesOnly yes
LogLevel FATAL
Host es
HostName 172.17.0.4
User root
Port 22
UserKnownHostsFile /dev/null
StrictHostKeyChecking no
PasswordAuthentication no
IdentityFile /home/junjiyang/scrapybook/insecure_key
IdentitiesOnly yes
LogLevel FATAL
.......................................
the hostname (172.17.0.*) of each host(web, spark, etc.) are diffirent from the book's table, which @lookfwd has already posted on this web-page earlier.
seems like I'm very close to a victory, But at this moment, I don't know what to do
P.S. I'm useing Ubuntu 14.03 under your suggestion. Only my Ubuntu is grow up on VMware12
from scrapybook.
Hello @withkarlkarl , you are running under Windows or Linux? Could you try this to see if it solves the problem? #5 (comment) . If you're on linux, the command is: export SCRAPYBOOK_FORCE_HOST_VM=TRUE
from scrapybook.
THANK YOU VERY MUCH for your help!! @lookfwd
but after I followed your advice it still not working:
and I tried download visualbox and install
after which I retried vagrant up --no-parallel
, but a new problem come out:
from scrapybook.
Related Issues (20)
- The index in the xpath doesn't work HOT 2
- vagrant up error HOT 1
- can't access http://scrapybook.s3.amazonaws.com/properties/ 403 forbidden HOT 1
- there is an Syntax Error on page 16
- is it because of socks5?
- seems that I have the same problem: HOT 1
- install panda
- OpenSSL SSL_connect: SSL_ERROR_SYSCALL in connection to d1kby793vfk4bq.cloudfront.net:443 HOT 1
- Virtual machine has terminated unexpectedly during startup with exit code 1 (0x1) HOT 1
- Can't deploy 'properties' spider to scrapinghub.com from the docker container (chapter 6)
- Vagrant up --no-parallel You are trying to forward a host IP that does not exist. HOT 1
- package 'openssh-server' is not installed
- The problem of setting up the environment HOT 1
- Cloning into 'algo-cs503'... fatal: unable to access 'https://github.com/saqibutm/algo-cs503.git/': error setting certificate verify locations: CAfile: D:/4th semster/ds/Git/mingw64/ssl/certs/ca-bundle.crt CApath: none this is the issue can plzz solve the issue
- Vagrant Setup - Resolving port conflicts on Mac HOT 1
- !!
- can't visit http://web:9312/ HOT 1
- how to connect local github with github id
- VAGRANT UP ERROR 2022
- vagrant up --no-parallel command not working
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from scrapybook.