Delta merge ignore no change

[JeppeBlixen]

Delta merge ignore no change

[LauJohansson]

atc-dataplatform/src/atc/delta/delta_handle.py

Line 185 in 88edb01

df, merge_required = CheckDfMerge(

I think that this logic handles it? it finds only new records using the "CheckDfMerge" statement.

[JeppeBlixen]

I see, i wasn't aware of the that implementation using a join on the sink before the merge. I was thinking about adding it directly into the delta merge statement, but this properly have the same performance. Or maybe event better as it detects if only an append is necessary.

[LauJohansson]

I understand. That why it is good that you raised it as an issue. In that way can we knowledge share better!