Comments (8)
NEJM needed its own fetcher -- I wrote and tested with the one you listed, but let me know if it doesnt work for other NEJM articles you have.
For the other two, they are part of Oxford Academic journals it looks like. I meant to document that I haven't yet found a way to get around either EconReset errors or BadStatusLine errors from Oxford Academic, but its a known problem. From cursory research online, BadStatusLines look to be problems on the journals end, potentially through blocking robots on purpose.
If you have any thoughts let me know, otherwise, you need to grab those yourself. Pushed a new version
from pubmed-batch-download.
Some new google searching yielded a fix, which is great! I am updating code now
from pubmed-batch-download.
Updated to version 2.3.0, and should be fixed
from pubmed-batch-download.
HI Bill, just to say thanks for doing this, and sorry for the delay. I am away from the office and need direct access to my work network (ie not just VPN) to run the code. I'll let you know how I get on.
Only other thought I have had is (more generally) whether it would be possible to make use of the Zotero translators (https://github.com/zotero/translators). It would require calling the javascript code from python once your script has found the journal's page. This is not something I know anything about (as I mostly work in R) - just an idea. Apologies if you have already considered it.
from pubmed-batch-download.
I haven't used Zotero before, but can read up on it. Can you clarify how/what you are thinking/would like it to be used it for?
from pubmed-batch-download.
I probably don't need this now, as I have downloaded the rest of the papers I need manually, but what I was thinking of was this:-
- Pubmed-Batch-Download finds website where paper is held
- Zotero translator used to download it
Zotero is an open source reference manager tool. It has an SQLite database as a back-end. It has a standalone browser for the database, and an extension inside a web-browser.
The extension within the web-browser is used to download metadata, html files and any pdfs associated with an article. Many "translators" have been written for this purpose.
I wondered if it would be possible for Pubmed-Batch-Download to run the translator script.
Just a thought, as I say, I am probably not going to need this function.
from pubmed-batch-download.
I'm going to mark this as an enhancement for the future.
from pubmed-batch-download.
Thanks Bill.
from pubmed-batch-download.
Related Issues (20)
- Errors downloading articles HOT 18
- Same error message HOT 2
- use pmf with Ruby version? HOT 2
- failed to fetch HOT 7
- Trouble with Elsevier articles HOT 7
- Error with Physiology Free articles
- fetching error HOT 3
- PMID extraction in bulk! HOT 1
- Download fails: NoneType object has no attribute.. HOT 1
- Error: Invalid URL 'DirectEmailBox-inPage'
- Error:
- "failed from error Invalid URL" HOT 1
- Files are downloaded successfully, but they seem corrupt.
- Invalid URL, no scheme supplied. HOT 2
- License HOT 2
- Update to avoid known mechanize error HOT 2
- Damaged PDF & fetching stops HOT 10
- index out of range error HOT 7
- Trying to fetch pmid 30374447 ** fetching of reprint 30374447 failed from error ('Connection aborted.', BadStatusLine("''",)) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pubmed-batch-download.