zmjones/untreaties

scrapes, cleans, transforms, and searches United Nations treaty data

untreaties's Issues

xml reading fails

scraper is currently broken. treaties.un.org changed the xml links.

Consider contributing to Wikidata?

Would it be feasible to have some of this data flow into Wikipedia's Wikidata project?

There are some treaties in there already but lacking detail - e.g. see https://query.wikidata.org/#SELECT%20%3Fitem%20%3FitemLabel%20%3Fwhere%20%3FwhereLabel%0AWHERE%0A%7B%0A%09%3Fitem%20wdt%3AP31%20wd%3AQ131569%20.%0AOPTIONAL%20%7B%20%3Fitem%20wdt%3AP1001%20%3Fwhere%20.%20%7D%0A%09SERVICE%20wikibase%3Alabel%20%7B%20bd%3AserviceParam%20wikibase%3Alanguage%20%22%5BAUTO_LANGUAGE%5D%2Cen%22%20%7D%0A%7D

(Council of Europe's list also looks easy to scrape - https://www.coe.int/en/web/conventions/full-list)

column expander switches entries

Via Daniel HIll:

cedaw.dat<-loadData(chap="4", treaty="8", expand=T, panel=T, syear="1979", eyear="2012")

to produce ratification dates for CEDAW, I get some bad dates. The .csv files in the "treaties" folder look correct, but the data frame the function produces is bad. For the first 12 countries I get a mix of good and bad dates.

afghanistan is fine

96 for albania (should be 94)
97 for algeria (should be 96)
86 for andorra (should be 97)
89 for angola (should be 86)
93 for antigua (should be 89)

argentina is fine
armenia fine
australia fine
austria is fine

96 for azerbaijan (should be 95)
06 for bahamas (should be 93)

expansion bug(s)

Sorry to report I've found another snag w/ the treaty utility. It's still producing some errors. Mostly this is happening for treaties that have options for the second column besides accession, ratification, and succession. These other options include acceptance (A), approval (AA), and formal confirmation (c). E.g., the air pollution treaty (chapter 27, treaty 1), ozone treaty (treaty 2) and climate change convention (treaty 7), conventions on conventional and chemical weapons (chapter 26, treaties 2 and 3) and landmines (treaty 5). I also noticed one which had no other options for the second column but was switching accession and succession; the convention on consent to marriage (chapter 16, treaty 3).

via Danny Hill