Comments (5)
This would probably just need a process.browser
switch to create an XHR transport with credentials enabled in the browser (not tested, but I'm sure it'd just be caused by cookies not being attached). This would deviate from how node requests it but that's how it'd be fixed if you wanted it fixed.
from metascraper.
yeah -- I don't know how else to get the meta from other websites otherwise. :-\
from metascraper.
You can start with https://github.com/ianstormtaylor/metascraper/blob/27340b24e463397ad18aedb15f43546c0626b07e/lib/index.js#L26-L37 and replace the request mechanism. E.g.
function scrape (url, rules) {
return popsicle.get({
url: url,
transport: popsicle.createTransport({ withCredentials: true })
}).then(res => scrapeMetadata(res.body, url, rules))
}
from metascraper.
this solution is not working.
i replace this code but popsiscle.createTrasnport is not function error....
help me...
from metascraper.
Hello,
I'm going to close this because new 2.0.0 iteration doesn't handle HTTP layer anymore!
from metascraper.
Related Issues (20)
- Is there a package for grabbing just the domain? HOT 1
- Wrong Typescript declared types HOT 5
- Not scrapping the correct date HOT 1
- JSDOM dependency is not compatible with node v14 HOT 7
- Missing 'logo' in Metadata interface when using metascraper-logo plugin HOT 1
- Instagram Scraping Give me null at some field HOT 1
- Crash on `metascraper-audio` HOT 4
- Incorrect metadata types HOT 4
- Specific pages lead to crash of nodejs HOT 1
- Specific pages crash NodeJS with the usage of metascraper-audio or metascraper-video HOT 3
- New version causes breaks in Definitely Typed packages HOT 9
- Cannot use in Defer because of re2 HOT 1
- Add types for metascraper packages
- metascraper-date typing errors HOT 2
- [metascraper-clearbit] Typescript build error from `keyvOpts` HOT 1
- Any issues with a memory leak, particularly metascraperDescription() HOT 1
- High memory usage HOT 9
- `author` is not recognized for YouTube HOT 1
- Make JSDOM opt-in HOT 4
- [metascraper-image] ability to pick desired image HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from metascraper.