Comments (3)
Ah, I didn't notice that. The services are on different domains so I didn't realize they were the same project, but now I see the "User Guide" link.
I guess the next step would be to find alternative sources of retraction metadata with persistent identifiers (eg, DOI or PubMed identifier). Some sources I can think of are:
- PubMed/MEDLINE itself (we already have a parser for this, could update the import pipeline to allow "updates" to existing entries when the
publication_stage
does not match or has changed to "retracted") - publisher-specific corpuses, like SciGraph
- heristics, like finding publications with the title "Retraction of TITLE", then finding the prior publication from the same journal ("container") and the given title
from fatcat.
I would like to work on this. Could you provide some more details? What kind of mechanism can be used to fetch the data from their database? They have clearly mentioned that scraping the website is prohibited (https://retractionwatch.com/retraction-watch-database-user-guide/).
from fatcat.
Here is an open corpus of ~100k retractions: http://openretractions.com/
we only know about retractions and other updates that publishers have properly reported to CrossRef or PubMed. That's currently 114596 papers.
I see only a couple thousand retracted "releases" in fatcat today. We do import from crossref and pubmed, so in theory we should have comparable numbers, but we don't run updates automatically yet, so if most of these are from the past couple years we are probably missing them. Also there might be bugs in our crossref and pubmed importers. I don't think we have tests for that code path, so a good first contribution would be adding tests for both crossref and pubmed retractions.
from fatcat.
Related Issues (20)
- release search links from preservation summary tables
- CEUR container has only 140 releases HOT 3
- There is no way to delete/expire a stale editgroup HOT 1
- "Diff" view for reviewing editgroups HOT 1
- "Graph" view for reviewing editgroups
- Edit workflow improvements
- Recent bugs: creator linkage and JSON API links HOT 1
- many file webarchive (wayback) URLs have only 12 of 14 timestamp digits HOT 1
- non-lowercase DOIs HOT 1
- match old-style arxiv identifiers in references HOT 1
- array sort order stability (file URLs, etc) HOT 1
- release abstracts mimetype uses less-popular JATS XML type
- `fatcat_tools` should not import from `fatcat_web` HOT 1
- Support National Bibliography Number as external id (NBN URN) HOT 2
- re-edit results in error 400 HOT 3
- notifications feed
- arXiv work missing HOT 3
- language on releases HOT 3
- editgroup diff view fails on some short strings in refs, via TOML
- Release type speech not supported by graphical editor
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fatcat.