markusrobertjonsson/timelines

Human Timelines

Setup & Installation

Make sure you have the latest version of Python installed.

git clone <repo-url>

pip install -r requirements.txt

Running The App

python main.py

Viewing The App

Go to http://127.0.0.1:5000

timelines's Issues

Add possibility to re-scale data to desired unit

Add possibility to re-scale data to desired unit. For example, if a dataset has unit kg and another tonnes, it should be possible to compare them with the same unit.

This can possibly be accomplished by adding a scaling feature for each dataset, either multiplying by any number, or re-scale from a hard-wired list of available units (for example mm, cm, dm, m, feet, km, miles, ...)

Add routine for database migration

Do not recreate all charts for each click

When, for example, just adding one timeline, all previous ones need not be re-rendered. Only re-render new stuff.

Consider making it more obvious for the user that legends can be clicked to toggle visibility

It is not obvious that the legends are interactive: clicking them toggles visibility of the corresponding line.

Consider making it more obvious for the user that legends can be clicked to toggle visibility.

Add search strings to each timeline and make them searchable

Add search strings to each timeline and make them searchable.

Investigate these archeological databases

GENERELLA INFRASTRUKTURER: Sidor som samlar ihop data från individuella repositorier och gör dom sökbara.

• Riksantikvarieämbetets tjänster Fornsök (fornlämningar och monument med en sökbar karta), K-Samsök (kulturarvsdata från svenska museer) och Kringla (information om föremål, byggnader osv. från svenska kulturarvsinstitutioner). RAÄs Kringla kommer bli integrerad i SweDigArch.

  https://app.raa.se/open/fornsok/
  https://www.raa.se/hitta-information/k-samsok/
  https://www.raa.se/hitta-information/kringla/

• SweDigArch: en tjänst under uppbyggnad som kommer att samla ihop en stor del svenska resurser inom arkeologi, bl.a. RAÄs Kringla.
  http://swedigarch.se/

• SEAD: en tjänst under uppbyggnad som kommer att samla ihop en flertal resurser inom området miljöarkeologi.
  https://www.sead.se/

• Ariadne: en stor internationell (fast europacentrerad) infrastruktur för arkeologiska forskningsdata.
  https://portal.ariadne-infrastructure.eu/

• iDAI: en stor dataportal med massa bilder, information om objekt, osv. Sidan drivs av tyska arkeologiska institutet och är (mest) tyskspråkig.
  https://idai.world/

INTERNATIONELLA REPOSITORIER: Repositorier med internationellt fokus.

• Open Context: Internationell repositorium med data från ung. 50 forskningsprojekt. Tar emot ny forskningsdata också.
  https://opencontext.org/
• tDAR The Digital Archaeological Record: stor repositorium med forskningsdata men också annat forskningsmaterial. Amerikacentrerad men internationell. Tar emot data mot betalning.
  https://core.tdar.org/
• Pandora: repositorium med datasets (uppdelad i olika ”communities”) mest i området bioarkeologi.
  https://pandora.earth/

NATIONELLA OCH LOKALA REPOSITORIER: Repositorier som framförallt har data från ett land eller en universitet.

• Digital archive of the archaeological map of the Czech Republic: forskningsdata om fyndplatser i Tjeckien med sökbar karta.
  https://digiarchiv.aiscr.cz/
• IANUS-Datenportal: Tysk (och tyskspråkig) repositorium med forskningsdata från ung. 15 större arkeologiska forskningsprojekt.
  http://datenportal.ianus-fdz.de/
• Johanna Mestorf Academy Research Data Exchange Platform: ett litet men lättnavigerat repositorium från Universitet Kiel. Otydlig om, och på vilka villkor, den tar emot material.
  https://www.jma.uni-kiel.de/en/research-projects/data-exchange-platform
• Archaeology Data Service: ett stort brittiskt repositorium med arkeologiska data, mest fr. brittiska öarna.
  https://archaeologydataservice.ac.uk/
• Propylaeum: Heidelbergs universitets arkeologiska repositorium med 33 datasets. Dataverse, alltså begränsad med ämnesspecifika metadata.
  https://heidata.uni-heidelberg.de/dataverse/propylaeum

TIDSKRIFTSANKNUTNA REPOSITORIER: Repositorier för forskningsdata relaterad till en specifik tidskriftspublikation.

• Journal of Open Archaeology Dataverse: 5 datasets med anknytning till publikation i JOAD. Dataverse: inga specifika arkeologiska metadatafält.
  https://dataverse.harvard.edu/dataverse/joad
• Edition Topoi: forskningsdata med anknytning till publikation i tyska Edition Topoi. Mycket bildmaterial men också 3D-modeller osv. Specifikt arkeologiska metadata i själva filbeskrivningar.
  http://repository.edition-topoi.org/

PROJEKTSPECIFIKA DATAKÄLLOR

• Svensk Hällristingsforskningsarkiv: bilder med geografiska metadata och RAÄ-identifierare av hällristningar i Sverige.
  https://www.shfa.se/
• Online ancient genome repository: australiensiskt repositorium för prehistoriska genetiska data. Varningar men sajten fungerar.
  https://oagr.org/
• ArkeoGIS: spatiella GIS-data, Strasbourg universitet. Specifik mjukvara behövs.
  https://arkeogis.org/
• Openheritage3D: spatiala data och 3D-bilder av fornlämningar och fyndplatser (internationell).
  https://openheritage3d.org/
• Maya Image Archive: forskningsmaterial om Mayansk arkeologi. Mest bilder från Karl Herbert Mayers arkiv.
  https://classicmayan.kor.de.dariah.eu/
• ROCEEH Out of Africa Database: information om lämningar kopplad till tidig prehistoria. Sökbar karta. Indexeras också i Ariadne.
  https://www.roceeh.uni-tuebingen.de/roadweb/smarty_road_simple_search.php
• Collaborative Research Centre 806 Database: forskningsdata men också publikationer, information om fyndplatser, osv. med fokus på moderna människans tidigaste prehistoria i Europa. Mycket material för ett projektspecifikt repositorium. Kölns universitet.
  https://crc806db.uni-koeln.de/start/
• IsoArch: repositorium för isotopisk information från bioarkeologiskt material i Europa. Tillgång till data kräver inloggning. Tar emot nya data.
  https://isoarch.eu/
• Radiocarbon Palaeolithic Europe Database: databas för radiometriska data från fyndplats i Europa och Sibirien.
  https://ees.kuleuven.be/geography/projects/14c-palaeolithic/
• Laboratoriet för Digitalt Arkeologi DARKLAB Digital Collections: 3D-bilder och metadata av framförallt objekt från Lunds universitets historiska museum.
  https://www.darklab.lu.se/digital-collections/

Add possibility to make statistical analyses of timelines

Statistical and other analyses (Growth rates, combinations of series, segmented regression, inflection points, synchrony, autocorrelation (including Red, white, blue noise), process tracing tests, ….

See pdf-document ”Plan Human timelines”.

View/Edit dataset should show data points in (editable) table

The x- and y-values are internally stored as comma-separated strings. When viewing or editing them, this should be done in a table where one can add a row to add a point, etc.

In the "timeline builder", add possibility to import csv-files when adding a new dataset

In the "timeline builder", add possibility to import csv-files when adding a new dataset.

Associate time series with geographical location

Associate time series with geographical location.

Add possibility to search for this (somehow).

Export as PDF does not generate true vector graphics

Export as PDF does not generate true vector graphics. Export as SVG does.

In "timeline builder", make it possible to create a new timeline from existing ones using arithemtic operations

In "timeline builder", make it possible to create a new timeline from existing ones using arithemtic operations, so that one can visualize one timeline minus another, for example.

Add possibility to search for time period

Add possibility to search for a time (period) and get as search results all timelines that have at least one (or all) datapoints in that period.

Y-axis limits don't automatically adjust for stacked charts except in the bottom chart

When adjusting the min and max limits on the time axis, the axis limits on the value axis should automatically adjust to fit all data within the zoomed time range. This doesn't work for stacked charts where the axis limits (on all charts except the bottom one) are set programmatically.

How-to-reproduce: Make a stacked charts plot with two quantitative data and change the time range with the scrollbar. Only the bottom chart's y-axis limits change, not the top.

Optional custom labels on time-axis

It should be possible to display optional custom labels on the time data points. A user may want to display "-1800" or "1800BC".    -

It should be possible to display optional custom labels between time data points. For example, a user may want to have "Bronze age" displayed between two time points.

If implemented, these labels should not be part of the timeline data stored in the database, but rather done "display settings" in the browser, just like colors of lines etc.

Dragging horizontal scrollbar quickly in stacked charts, the above charts are lagging behind

Validate all entered data

Validate all entered data.

Add optional text string for each data point for quantitative data

Add optional text string for each data point for quantitative data. This text string should be rendered near the (x,y)-coordinate. See picture for inspiration (taken from https://humanisten.se/2021/04/19/dagens-16-aringar-har-vad-som-kravs-for-att-fa-rosta/?fbclid=IwAR33qG1eA02asOpGKUyu61F7S8r7BqV8Csn2ANtqsOMi01PeEsK40TKVv3Y).

Add log scale

We should make it possible for the user to plot log-scale on the y-axis, but in the case of log-scale on the time-axis it is important what we mean by "time zero" (since nonpositive quantities cannot be plotted with log-scale). One way is to use Years Before Present, so that today (current year) is zero.

Only load js-code on pages that use js

Only load js-code on pages that use js, and restructure js-code into several files if needed.

Dragging time-axis limits does not update other stacked charts if time axis unit is YBC

Dragging time-axis limits does not update other stacked charts if time axis unit is YBC

Add ui for chart settings

Add ui for chart settings, for example background color, x-limits, y-limits, line color, thickness, marker type, marker color, marker size, etc.

This should perhaps be one panel per chart, or maybe one panel that shows the settings for all plotted lines, regardless of chart they are present in.

Add possibility to view "Predefined datasets"

Add possibility to view a predefined dataset so that one can see Description and the values, etc. in the same way as for users datasets.

For timelines in a tree structure, consider the possibility to have description in a parent node.

Improve visualization of qualitative data

When the data values for qualitative data are long, they can easily overwrite each other in the plot as in this screenshot.

One way to solve this is to have one shorter version (possibly automatically truncated) of each string.

Another possibility is to display the different strings at different y-values (say evero other at y=1 and every other at y=2).