Comments (15)
Updating the title of this. The lto2filemaker script uses the Filemaker Server XML api which is awkward and horribly slow, so changing this thread to consider other database options. @retokromer suggests MariaDB, @privatezero is doing something similar with MySQL.
I suggest these functions for a database:
- store entirety of the LTO schema in database tables
- allow some sort of command line
ltosearch
tool to query what file is where, when written, etc.
Other considerations?
from ltopers.
This is still true! And, more importantly, we need to ensure that lto2filemaker is reporting/reading the file path from the rsync log correctly.
from ltopers.
Possibly with some @jfarbowitz style, we could switch out from filemaker to some more open form of database (sqlite/mysql).
from ltopers.
I second @dericed 's suggestion for a more robust database. MariaDB is the free replacement for MySQL: https://github.com/MariaDB
from ltopers.
Another issue to resolve with lto2filemaker, which is specific to CUNY TV and our data migration, is to make sure that the database reflects the tape that the material has migrated to. This can be done by reporting additional information from the schema file to the database, such as the tape number. Presently, after writing a tape, we receive the following output about updating the database:
Uploading tape metadata for tape name=E00002. Please wait…
Uploading file metadata for tape name=E00002. Please wait…
The database already knows about a file in E00002.schema called name=AWW00001.mov
The database already knows about a file in E00002.schema called name=AWW00002.mov
The database already knows about a file in E00002.schema called name=AWW00003.mov
The database already knows about a file in E00002.schema called name=AWW00004.mov
The database already knows about a file in E00002.schema called name=AWW00005.mov
The database already knows about a file in E00002.schema called name=AWW00006.mov
The database already knows about a file in E00002.schema called name=AWW00007.mov
The database already knows about a file in E00002.schema called name=AWW00008.mov
The database already knows about a file in E00002.schema called name=AWW00009.mov
The database already knows about a file in E00002.schema called name=BDC00235.mov
The database already knows about a file in E00002.schema called name=BDC00246.mov
The database already knows about a file in E00002.schema called name=BDC00247.mov
The database already knows about a file in E00002.schema called name=BDC00248.mov
The database already knows about a file in E00002.schema called name=BDC00249.mov
The database already knows about a file in E00002.schema called name=BDC00250.mov
The database already knows about a file in E00002.schema called name=BDC00251.mov
The database already knows about a file in E00002.schema called name=BDC00252.mov
The database already knows about a file in E00002.schema called name=BDC00253.mov
etc.
from ltopers.
@dericed don't forget about this!!! :)
from ltopers.
B)
from ltopers.
I agree with @dericed
The SQL commands for MySQL (controlled now by Oracle) and MariaDB (a fork when Oracle tock over MySQL) should be identical. We replaced some years ago, in 2013 if I remember carefully.
from ltopers.
Yes, in 2013 (e.g. https://retokromer.ch/publications/FilmXML.html#ch7).
from ltopers.
partly (maybe fully) resolved by #25. Comments welcome.
from ltopers.
Yes! Comments/critiques please! Still a bunch to be worked out!
from ltopers.
Is this still an open issue, @dinahhandel, or is it resolved by #25?
from ltopers.
#25 is partly resolving, but there's plans to report on data from the schema file to a database. I believe @privatezero has this in the works.
from ltopers.
Thank you for the update! (Then I don’t close ;-)
from ltopers.
IIUC, this part was resolved by #46. Thanks to @privatezero
from ltopers.
Related Issues (20)
- Does `writelto` use `rsync`? HOT 5
- `writelto` calls `renameschemas `
- `verifylto` needs database HOT 2
- function `_check_for_lto_index_dir` is not defined HOT 5
- output of `writelto -h` starts with other information HOT 7
- .schema not writing to LTO_LOGS HOT 21
- clarification for LTO naming HOT 6
- support >6 character tape serials HOT 10
- Misc. Documentation Updates HOT 8
- Issues with error reporting vs error exiting HOT 7
- [wish] simplify tape serial usage
- install via linuxbrew fails at gtk+3 dependency HOT 18
- unable to mount tape with mountlto HOT 2
- LTFS 2.5 is under public review HOT 1
- [wish] add volume name management HOT 2
- /usr/local/bin/formatlto: line 90: mkltfs: command not found HOT 6
- mountlto can't find tape ready to mount HOT 21
- Fail to compile tnftp during install HOT 5
- Mtape MLogic ERROR HOT 3
- New release HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ltopers.