Delete + Add document on import

[shemanaev]

Delete + Add document on import

[gerritv]

Having a 'Date Added' would assist in scanning for changed/new documents/books? The Created Date in FileInfo would be the source.
The same scan could be used to delete books/documents that are no longer present.

[shemanaev]

This is one option i'm considering, but not created date, rather 'import date'. Going that way we can update that field on import and delete all non-updated documents in library namespace after. Trying to remember why i didn't do that early :) 2017-02-03 18:02 GMT+03:00 Gerrit Visser <[email protected]>:

…

Having a 'Date Added' would assist in scanning for changed/new documents/books? The Created Date in FileInfo would be the source. The same scan could be used to delete books/documents that are no longer present. — You are receiving this because you were assigned. Reply to this email directly, view it on GitHub <#10 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABAm6ZiirqW4jsKhRX5t3adFTyaggmviks5rY0GWgaJpZM4L2Gno> .

-- Yours sincerely, Denis Shemanaev Skype: denis.shemanaev

[gerritv]

That would work, any file with a Creation Date after the Date Added would be ripe for Add or Update depending on whether it was already in the Library/Index. I expect to be updating the info in my PDF collection over time, lots are missing Title, Author and Keywords :-(

[gerritv]

I tried this out, not sure it is working as expected. Re-importing a library does not result in Deleted books >0.
When Insert a book, it has GUID.Empty. So the original will never be found using that. Then on Add, MapBook sets the GUID. I suspect that we end up with 2 Documents in the Index.

[shemanaev]

There is the catch: records delete not based on GUID, but on libraryid+file+ext+archive. Right now cleanup deletes only records that not being updated more than 6 hours ago. I'll fix this a bit later (remember time of import start and delete records updated later than that should be ok I assume). 2017-02-05 17:06 GMT+03:00 Gerrit Visser <[email protected]>:

…

I tried this out, not sure it is working as expected. Re-importing a library does not result in Deleted books >0. When Insert a book, it has GUID.Empty. So the original will never be found using that. Then on Add, MapBook sets the GUID. I suspect that we end up with 2 Documents in the Index. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#10 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ABAm6UvbYu8zeIqO7DhR1xL4FUwZnUE8ks5rZddSgaJpZM4L2Gno> .

-- Yours sincerely, Denis Shemanaev Skype: denis.shemanaev

[shemanaev]

Also you can open and explore Lucene.Net index with [Luke]( https://storage.googleapis.com/google-code-archive-downloads/v2/code.google.com/luke/lukeall-4.0.0-ALPHA.jar ). 2017-02-05 17:13 GMT+03:00 Denis Shemanaev <[email protected]>:

…

There is the catch: records delete not based on GUID, but on libraryid+file+ext+archive. Right now cleanup deletes only records that not being updated more than 6 hours ago. I'll fix this a bit later (remember time of import start and delete records updated later than that should be ok I assume). 2017-02-05 17:06 GMT+03:00 Gerrit Visser ***@***.***>: > I tried this out, not sure it is working as expected. Re-importing a > library does not result in Deleted books >0. > When Insert a book, it has GUID.Empty. So the original will never be > found using that. Then on Add, MapBook sets the GUID. I suspect that we end > up with 2 Documents in the Index. > > — > You are receiving this because you modified the open/close state. > Reply to this email directly, view it on GitHub > <#10 (comment)>, > or mute the thread > <https://github.com/notifications/unsubscribe-auth/ABAm6UvbYu8zeIqO7DhR1xL4FUwZnUE8ks5rZddSgaJpZM4L2Gno> > . > -- Yours sincerely, Denis Shemanaev Skype: denis.shemanaev

-- Yours sincerely, Denis Shemanaev Skype: denis.shemanaev

[gerritv]

Doh, I should have my cappuccino before reading and testing :-)

I also found https://luke.codeplex.com/. Both very useful and educational. Thank you