dkulchenko/watchdb

Keeping SQLite databases in sync

watchdb's Issues

More than 100 Mb SQLite File not working

Hi,
I am trying to implement sync functionality with binary and I test all the below scenarios with cmd with admin privileges.

I have to implement sync functionality with the SQLite file and test it with a master and slave database on different computers with the same network path. But it seems, it's creating an issue when the Sqlite file size is bigger, and here are the different test cases which I have tried.

• Small Sqilite file size of 40 MB - Via CMD Verified sync functionality and it is working.
• Test the data with 138 MB Sqilite file size but it is creating an issue in data sync.
  What's the issue? In the Synced database, more than 50,000 records could not match with the master database
• I have tried with 80 MB Sqlite file with the same above scenario -- the issue of file size but no issue of data sync.
• I have tried with 104 MB with same above scenario -- issue of file size(On slave server after sync, the file size is 98 MB)
  The Steps I have taken is
  1) At Master and slave both the side manually I have copied 104 Mb Sqlite file.
  2) In the master database and slave DB, started to watch and sync.
  3) Modified data directly on master db[Deleted And updated Record via Sqlite studio]
  4) In the Synced database file size has been reduced to 98 Mb But the strange things I have found, there was not any data difference but still, the file size has been reduced.
• With all of the above test cases, Another master Sqilite file with 121 MB file size, In this test scenario, I have found that there was a mismatch in the data and it was 50,000 data that has not been matched at sync database.

So in summary, I think when the Sqilite master database is file size going beyond 100 MB then it's creating a problem so please guide me on how should I implement sync functionality?

Thanks,
Shailesh

fatal error: runtime: out of memory

Hi,
I am looking for an easy way to keep .mbtiles in sync:
~ 7.5 GB
https://github.com/mapbox/mbtiles-spec
Operation failed: fatal error: runtime: out of memory
Thanks, Dirk