youtux/pagecounts-search

Search through ordered wikimedia pagecounts

pagecounts-search

Search through ordered wikimedia pagecounts

Pre-requisites

This project has been tested only with Python 3.5. It may work with Python 3.4, too.

Installation

pip install git+https://github.com/youtux/pagecounts-search.git

Usage

As a library

import pagecountssearch

f = pagecountssearch.Finder(source_dir='/path/to/sorted/counts/folder')
print(f.search('en', 'Albert_Einstein'))

As a command line tool

$ pagecounts-search /path/to/sorted/counts/folder search en Albert_Einstein
20140101-000000 300 25645681
20140101-010000 246 21173395
20140101-020000 276 23558819
20140101-030000 234 17418623
20140101-040000 283 21449007
20140101-050000 289 23254304
20140101-060000 331 27369512
[...]

Known issues

• Wrong/partial result when retrieving statistics for a page that appears across different partial files #1

pagecounts-search's Issues

Wrong/partial result when retrieving statistics for a page that appears across different partial files

Counting pageviews of a page that is split between two partial files yields to a partial result (only the last file is considered)