Comments (4)
I had a look at this a long time ago, but, whilst detecting the dates is quite straightforward, segregating them into date published / date generated is quite tricky, especially if the article contains other dates. You've got several options:
- Use an heuristic: e.g. "first date"
- Modify the UI to show a range of possible dates or be deliberately vague, gmail-style ("about a week ago")
- Try to induce rules like these people at my old university to generate per-site selectors. Regrettably, I don't think this approach really scales very well and it hides its heavily-supervised nature.
- Google's recommendation is to include a date between the article title and its content and lots of sites site should follow this advise, which restricts the range in which you need to look. They also (apparently) use sitemaps.
from cosr-back.
Interesting links! The PDF seems to be down, is it this one? http://www2013.org/companion/p73.pdf
from cosr-back.
That's it
On Thursday, 24 March 2016, Sylvain Zimmer [email protected] wrote:
Interesting links! The PDF seems to be down, is it this one?
http://www2013.org/companion/p73.pdf—
You are receiving this because you commented.
Reply to this email directly or view it on GitHub
#4 (comment)
Sent from my iPhone
from cosr-back.
I think we will end up using as many sources/methods as possible for this to cover all cases so it would be okay to begin implementing the simple ones!
from cosr-back.
Related Issues (20)
- Structure of ES clusters HOT 9
- Questions on deployment HOT 1
- Spark-submit uses only 1 core. HOT 4
- Errors During Installation HOT 3
- Speed up Travis builds HOT 1
- Improve host-level PageRanks HOT 1
- Investigate MyHTML parser
- Add GDELT document source
- Add a Github document source HOT 2
- Add a Reddit data source
- Add Stack Overflow document source HOT 1
- Add new Malware/Phishing Blacklists HOT 1
- Advertising Lists HOT 2
- Add Makefile commands to save/load elasticsearch snapshots
- PageRank & other jobs: check if output directory already exists
- Integrate the new Common Crawl News dataset HOT 1
- Add docker-compose for the local tests
- Deduplicate URLs in backlinks plugin results
- Investigate annotating all the code with mypy
- Getting error running 'make virtualenv' HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cosr-back.