adding data lineage documentation

[schemaspy]

adding data lineage documentation

[rafalkasa]

Hi @ismailsimsek

I also believe that such functionality will be very interesting especially for views where it's a query between few or more tables. It will be very nice feature for representing graphs and relation like data lineage graph.

Could you find and explain other example to use such lineage graph in real case ?

[ismailsimsek]

Hi @rafalkasa

i know many ELT projects where a lot of data transformations used to transform data and prepare for reporting, for this kind of project often Stored procedures or PLSQL data transformation used. i can see this tool can be very useful to document database plus the PLSQL ELT scripts together.

• visual data lineage can give full view of data flow from source to end. its very helpful to see source tables that loading one table and seeing dependent tables that reading from a table.
• being able to see dependencies between objects is very useful to estimate impact of a change.

[npetzall]

I I've never heard of lineage other then fk constraint and impact as on update/delete/insert.
Or as in view which has parent tables.

We have the fk constant ans implied.
For views we have definition and a possible tables list.
We do have routines, it might be missing information.

So I'm guessing we might be missing triggers, I believe that routines doesn't have any referenced table information or guesses.

So it would be awesome for me if there was a script or db backup with which have these features and an explanation of what information should be included in report.