fnielsen/cvrminer

Data mining of CVR

CVR miner

Data mining of CVR

Examples

>>> from cvrminer.cvrfile import CvrFile
>>> from cvrminer.virksomhed import Virksomhed
>>> filename = '/home/fnielsen/data/cvr/cvr-permanent.json'  # or whatever
>>> data = next(CvrFile(filename))
>>> virksomhed = Virksomhed(data)
>>> virksomhed.antal_ansatte
0
>>> cvr_file = CvrFile(filename)
>>> cvr_file.write_virksomhed_features_file()   # and wait

cvrminer's Issues

CVR file iterator raise ValueError at the end of the file

This is the value error:

ValueError: No JSON object could be decoded in line 1001

Move to Kubernetes

Error message may be wrong

This error message may be wrong https://github.com/fnielsen/cvrminer/blob/master/cvrminer/cvrfile.py#L136

Exchange aspect

Exchange aspect

SELECT ?company ?companyLabel ?symbol 
WITH {
  SELECT ?company ?symbol WHERE {
    ?company p:P414 ?exchange_statement .
    ?exchange_statement ps:P414 wd:Q1019983 . 
    optional { ?exchange_statement pq:P249 ?symbol . }
    
  }
} AS %result
WHERE {
  INCLUDE %result .
  SERVICE wikibase:label { bd:serviceParam wikibase:language "da,en" . } 
}

Change SPARQL for control graph with path queries instead of graph queries

This query uses more properties.

#defaultView:Graph
PREFIX gas: <http://www.bigdata.com/rdf/gas#>

SELECT ?from ?from_image ?fromLabel ?to ?to_image ?toLabel
WITH {
  SELECT DISTINCT ?from ?to {
    { wd:Q66619204 (wdt:P1830 | ^wdt:P127 | ^wdt:P1037 | ^wdt:P169 | ^wdt:P3320 )* ?to . }
    UNION 
    { ?from (wdt:P1830 | ^wdt:P127 | ^wdt:P1037 | ^wdt:P169 | ^wdt:P3320 )* wd:Q66619204 . }
    ?from (wdt:P1830 | ^wdt:P127 | ^wdt:P1037 | ^wdt:P169 | ^wdt:P3320 ) ?to
  }
} AS %result 
WHERE {
  INCLUDE %result  
  OPTIONAL { ?from wdt:P18 ?from_image . }
  OPTIONAL { ?to wdt:P18 ?to_image . }
  SERVICE wikibase:label { bd:serviceParam wikibase:language "da,en" .  } 
}    

Extend Financial statement table

Extend Financial statement table

• Link to PDF
• Date of publication

Add information to footer

Add information to footer, e.g., code version