datagov-cz/ms-adapter

Adapter for MS Graph API.

ms-adapter's Issues

Allow user to download directory using a path

As of now user must specify a library and a directory.
The directory is specified by name and thus can not be nested.
The objective is to allow user specify nested path using "/" as separators.

Change item IDs to column names

There is an issue that the column IDs used in adapter output are apparently the ones from the time when the column was created in the list, not reflecting its current state.

Currently, I get:

_:genid-786c5e7feb5847c1b5d3dca88251a4682-6E84EB919279D38DBD8B85641677ED38 <http://localhost/applications#Title>
    "8";
  <http://localhost/applications#Odkaznaaplikaci> "https://link2";
  <http://localhost/applications#Registrace> "2023-11-02T07:00:00Z";
  <http://localhost/applications#Kontrolaz_x00e1_znamu> "2023-11-04T07:00:00Z";
  <http://localhost/applications#LinkTitle> "8";
  <http://localhost/applications#N_x00e1_zev> "Druhá apka";
  <http://localhost/applications#Popis> """Druhá apka,
Druhá apka,
Druhá apka.""";
  <http://localhost/applications#Stav> "Archivovaná";
  <http://localhost/applications#Platforma> "iOS", "Jiná";
  <http://localhost/applications#T_x00e9_mata> "Doprava", "Mezinárodní otázky", "Regiony a města",
    "Spravedlnost, právní systém a veřejná bezpečnost";
  <http://localhost/applications#Typslu_x017e_by> "Částečně placená";
  <http://localhost/applications#Kontrola> "2023-11-01T07:00:00Z";
  <http://localhost/applications#Kontrolor> "Hemala David";
  <http://localhost/applications#Schvalovatel> "Kováčová Lenka";
  <http://localhost/applications#N_x00e1_zevautora> "Autorská 1";
  <http://localhost/applications#Jm_x00e9_noautora> "John";
  <http://localhost/applications#P_x0159__x00ed_jmen_x00ed_autora> "Doe";
  <http://localhost/applications#E_x002d_mailautora> "[email protected]";
  <http://localhost/applications#Souhlasautora> true;
  <http://localhost/applications#Jm_x00e9_noohla_x0161_ovatele> "Ohláš 2";
  <http://localhost/applications#P_x0159__x00ed_jmen_x00ed_ohla_x> "Ovatel 2";
  <http://localhost/applications#E_x002d_mailohla_x0161_ovatele> "[email protected]";
  <http://localhost/applications#Telefonohla_x0161_ovatele> "[phone]";
  <http://localhost/applications#Pozn_x00e1_mky> "Už zase form...";
  <http://localhost/applications#URLautoraa> "https://john.doe";
  <http://localhost/applications#DSURL10> "https://data.gov.cz/zdroj/datové-sady/inventární-seznam/agendy/A101/subjekty-a-objekty-údajů/101-1";
  <http://localhost/applications#Logo> "https://link2logo2";
  <http://localhost/applications#N_x00e1_zev_x0028_en_x0029_> "Second app";
  <http://localhost/applications#Popis_x0028_en_x0029_> """Second app
Second app
Second app""";
  <http://localhost/applications#N_x00e1_zevautora_x0028_en_x0029> "Author name in English";
  <http://localhost/applications#ContentType> "Položka";
  <http://localhost/applications#Modified> "2024-01-20T20:27:11Z";
  <http://localhost/applications#Created> "2023-11-02T10:45:08Z";
  <http://localhost/applications#Author> "Jakub Klímek";
  <http://localhost/applications#Editor> "Petr Škoda";
  <http://localhost/applications#_UIVersionString> "25.0";
  <http://localhost/applications#Attachments> false;
  <http://localhost/applications#Edit> "";
  <http://localhost/applications#LinkTitleNoMenu> "8";
  <http://localhost/applications#ItemChildCount> "0";
  <http://localhost/applications#FolderChildCount> "0";
  <http://localhost/applications#_ComplianceFlags> "";
  <http://localhost/applications#_ComplianceTag> "";
  <http://localhost/applications#_ComplianceTagWrittenTime> "";
  <http://localhost/applications#_ComplianceTagUserId> "" .

However, the names of columns are:

ID,Název (cs),Název (en),Popis (cs),Popis (en),Stav,Platforma,URL,Témata,Typ služby,Odkaz na obrázek,Vytvoření,Modified,Kontrola,Publikace,Kontrolor,Schvalovatel,Název autora (cs),Název autora (en),Jméno autora,Příjmení autora,E-mail autora,URL autora,Souhlas autora,Jméno ohlašovatele,Příjmení ohlašovatele,E-mail ohlašovatele,Telefon ohlašovatele,DS URLs,Poznámky,Obrázek

Which, in LP-ETL Tabular, produces:

_:4f38aa1a157d4fafae0e733c3c7b3b1f18047 <urn:ID> "8";
  <urn:N%C3%A1zev+%28cs%29> "Druhá apka";
  <urn:N%C3%A1zev+%28en%29> "Second app";
  <urn:Popis+%28cs%29> """Druhá apka,
Druhá apka,
Druhá apka.""";
  <urn:Popis+%28en%29> """Second app
Second app
Second app""";
  <urn:Stav> "Archivovaná";
  <urn:Platforma> "[\"iOS\",\"Jiná\"]";
  <urn:URL> "https://link2";
  <urn:T%C3%A9mata> "[\"Doprava\",\"Mezinárodní otázky\",\"Regiony a města\",\"Spravedlnost, právní systém a veřejná bezpečnost\"]";
  <urn:Typ+slu%C5%BEby> "Částečně placená";
  <urn:Odkaz+na+obr%C3%A1zek> "https://link2logo2";
  <urn:Vytvo%C5%99en%C3%AD> "02.11.2023";
  <urn:Modified> "20.01.2024 12:27";
  <urn:Kontrola> "01.11.2023";
  <urn:Publikace> "04.11.2023";
  <urn:Kontrolor> "Hemala David";
  <urn:Schvalovatel> "Kováčová Lenka";
  <urn:N%C3%A1zev+autora+%28cs%29> "Autorská 1";
  <urn:N%C3%A1zev+autora+%28en%29> "Author name in English";
  <urn:Jm%C3%A9no+autora> "John";
  <urn:P%C5%99%C3%ADjmen%C3%AD+autora> "Doe";
  <urn:E-mail+autora> "[email protected]";
  <urn:URL+autora> "https://john.doe";
  <urn:Souhlas+autora> "True";
  <urn:Jm%C3%A9no+ohla%C5%A1ovatele> "Ohláš 2";
  <urn:P%C5%99%C3%ADjmen%C3%AD+ohla%C5%A1ovatele> "Ovatel 2";
  <urn:E-mail+ohla%C5%A1ovatele> "[email protected]";
  <urn:Telefon+ohla%C5%A1ovatele> "[phone]";
  <urn:DS+URLs> "https://data.gov.cz/zdroj/datové-sady/inventární-seznam/agendy/A101/subjekty-a-objekty-údajů/101-1";
  <urn:Pozn%C3%A1mky> "Už zase form..." .

e.g. LinkTitle => ID, URLautoraa => URL+autora, DSURL10 => DS+URLs, etc.

The encoding does not have to be the same, but the source string should be the current column id.

Suggestions is now proposals

Podněty se přejmenovává na Návrhy
Suggestions is now renamed to Proposals

They will contain not only user collected suggestions, but also DIA created records.

Some columns for some records missing in the downloaded file

In the production shp list of apps the column "Publikace" is downloaded only for some (older) records and not for newer ones, even though it is filled out in the list

The border between old and new records corresponds to the time this column was edited (another column was removed from the view, this one was used instead).