jkroll20/tlgbackend

WMDE Article List Generator Backend

Article List Generator for Wikipedia - Backend

(c) Wikimedia Deutschland

Author: Johannes Kroll

The Article List Generator makes it possible to search categories and compile article lists using different criteria. The query may consist of a one or more categories, the intersection or the difference of categories. The user is able to determine the depth of the search and a set of filters shown on the righthand side allows further refinement of the result. The combination of these filters is also possible.

The ALG backend uses graphserv and the SQL database to search and filter pages. It can be used with the front end or stand-alone.

tlgbackend's Issues

OperationalError: User 's51222' has exceeded the 'max_user_connections' resource

The query https://tools.wmflabs.org/render/tlgbe/tlgwsgi.py?action=query&flaws=ALL&format=json&lang=commons&query=Axamer+Lizum&querydepth=3 fails with

Error: Traceback (most recent call last):
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/tlgbackend.py", line 336, in generateQuery
    self.pagesToTest= self.evalQueryString(queryString, queryDepth)
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/tlgbackend.py", line 271, in evalQueryString
    result|= set(self.evalQueryToken(category, depth))
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/tlgbackend.py", line 199, in evalQueryToken
    res= self.cg.getPagesInCategory(string.replace(' ', '_'), int(defaultdepth)-1, )
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/tlgcatgraph.py", line 22, in getPagesInCategory
    catID= getCategoryID(self.wikiname, category)
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/cache.py", line 572, in cached
    return cache[0].get_value(cache_key, createfunc=go)
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/cache.py", line 305, in get
    return self._get_value(key, **kw).get_value()
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/container.py", line 385, in get_value
    v = self.createfunc()
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/cache.py", line 570, in go
    return func(*args)
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/utils.py", line 190, in getCategoryID
    page= getPageByTitle(wiki, catTitle, NS_CATEGORY)
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/cache.py", line 572, in cached
    return cache[0].get_value(cache_key, createfunc=go)
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/cache.py", line 305, in get
    return self._get_value(key, **kw).get_value()
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/container.py", line 385, in get_value
    v = self.createfunc()
  File "/data/project/render/.local/lib/python2.7/site-packages/Beaker-1.6.4-py2.7.egg/beaker/cache.py", line 570, in go
    return func(*args)
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/utils.py", line 169, in getPageByTitle
    cur= getCursors()[wiki]
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/utils.py", line 303, in __missing__
    newvalue= self.createEntry(key)
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/utils.py", line 148, in createEntry
    conn= getConnections()[ckey]
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/utils.py", line 303, in __missing__
    newvalue= self.createEntry(key)
  File "/mnt/nfs/labstore-secondary-tools-project/render/public_html/tlgbe/utils.py", line 312, in createEntry
    return MySQLdb.connect( read_default_file=GetSQLDefaultFile(), host=key, use_unicode=False, cursorclass=MySQLdb.cursors.DictCursor )
  File "/usr/lib/python2.7/dist-packages/MySQLdb/__init__.py", line 81, in Connect
    return Connection(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 187, in __init__
    super(Connection, self).__init__(*args, **kwargs2)
OperationalError: (1226, "User 's51222' has exceeded the 'max_user_connections' resource (current value: 10)")

Enable cross-origin resource sharing

Please set the Access-Control-Allow-Origin HTTP header to enable cross-origin resource sharing and allow JavaScript websites to use https://tools.wmflabs.org/render/tlgbe/tlgwsgi.py

Use case: simon04/locator-tool#22 (comment)