The last number in the link represents the school id. There are 4 schools: 15,25,3

Data sources from 1996 to present, HTML format: <a href="https://web

Collected all the available links from the Web Archive here: <a href="https://stor

Need to gather all of working links. Link example: <div class="snippet-clipboard-c

Data Scraping all years about unam-data HOT 3 OPEN

lopezpedres commented on September 13, 2024

Data Scraping all years

from unam-data.

Comments (3)

mate-h commented on September 13, 2024

Data sources from 1996 to present, HTML format:

https://web.archive.org/web/19970329111029/http://www.dgae.unam.mx/
https://www.dgae.unam.mx/admision/
https://web.archive.org/web/*/http://www.dgae.unam.mx*

Archival statistical agenda data source from 1959 to present, PDF format:
http://agendas.planeacion.unam.mx/

from unam-data.

mate-h commented on September 13, 2024

Collected all the available links from the Web Archive here:
https://storage.googleapis.com/mate-h.appspot.com/archive-links.csv

from unam-data.

mate-h commented on September 13, 2024

Need to gather all of working links. Link example:

https://www.dgae.unam.mx/Licenciatura2021/resultados/1/10400035.html

Schematic link:

https://www.dgae.unam.mx/:term/resultados/:areaId/:facultyId:buildingId.html
https://servicios.dgae.unam.mx/:term/resultados/:areaId/:facultyId:buildingId.html

step one is to scrape all of the identifiers for:

Terms
Areas
Facilties
Buildings

Construct all of the possible URLs using the ids and the link schema above. Link schema version depends on the term.
Download the one by one using lynx and discard the documents that were not resolved. Take all of the tags into account (Special link in 1996 and Archive links, Servicio subdomain, etc.)
Write scripts to process that data.

from unam-data.

Recommend Projects