Comments (5)
Seems to be working fine in
https://github.com/stewartmckee/cobweb/pulls
from cobweb.
I'm having the same issue, but within Rails. The error reads:
"\xEF" from ASCII-8BIT to UTF-8
The exception is:
Encoding::UndefinedConversionError
Any thoughts?
from cobweb.
This is usually because the charater encoding specified by the server (either in the headers or content itself) does not match the content that is actually on the page. We should probably add in a bit more logic around how this state is handled. Is the url you are requesting public, could you post it for me to have a look at?
from cobweb.
Sounds great. I'll send you a link via email. It is a public site.
from cobweb.
I'm getting this too:
"\xC3" from ASCII-8BIT to UTF-8
for the URL
http://www.segurocontraroubo.com.br/wp-content/themes/segurocontraroubo/javascripts/add.js
from cobweb.
Related Issues (20)
- Improve connection handling
- Standalone Crawler gives error for redis HOT 6
- `require': cannot load such file -- resque (LoadError) HOT 3
- Should be possible to use Ruby's URI implementation instead of Addressable::URI HOT 3
- Should it be possible to add "depth" in the data hash ? HOT 3
- Inbound links are not normalized when stored
- Code organization HOT 1
- Binary not installed HOT 1
- Redirect Limit causing crawl to stop
- LoadError with version 1.0.26 HOT 2
- error while installing cobweb-1.0.28.gem: Invalid argument @ rb_sysopen HOT 5
- Cobweb gem causes Rails app to run 10x slower HOT 9
- How can I start stop crawling website HOT 1
- Should depend on slop 3.6.0 or update cobweb bin HOT 1
- Error on first run HOT 2
- undefined method `banner' for main:Object (NoMethodError) on calling from command line HOT 1
- Falling into Crawl Traps HOT 10
- Feature request: Stop crawl at time HOT 3
- Error raised when there's a valid <base> tag in <head> HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cobweb.