Huge leaks

[warrenfalk]

Huge leaks

[warrenfalk]

The code is too complicated for me to see an obvious flaw, and is missing enough that I can't run it, and missing enough detail in the comments to reconstruct the missing parts, which makes it difficult to be of much help. If you can reproduce the problem with simpler code, it would make it a lot simpler. I will see if I can reproduce a memory leak with similar operations.

[warrenfalk]

How big is the database, on disk, when this runs out of memory?

[jakoss]

Well, that's the weird part, it's kinda.. random to me. Or i just can't find the pattern here. Sometimes it have 260 MB and sometimes it stops on like 90 MB. The same database takes like 4 GB when i try to build it on LMDB!

I will try to create small project to reproduce this.

[jakoss]

I wasn't able to create small project since this whole thing is just POC and project structure is kinda big mess. You can get whole solution and build RocksDbBuilder to reproduce this problem. Links:

Solution: https://mega.nz/#!pYMgiB6b!-3me6SnpTWTthmhLpZX14EFCbAlofoPAxzOz6ct6gmw
Data (use this directory as application param): https://mega.nz/#!dAdjhZJL!GdfdEPSlwqLI-LEjzK4Dd_Bc-dCIIGXxb1Sb89WdMEk

[chester89]

@NekroMancer Have you looked at memory usage wiki page?

[jakoss]

@chester89 I looked - honestly RocksDB is pretty overwhelming for me with its all configuration options. And i tried to find answer to the one question that really interests me - is it even possible to setup something like "max heap" for RocksDB instance. But without any luck..

@warrenfalk Sorry, my bad. I updated links

[warrenfalk]

Indeed there was a memory leak in the .Net wrapper when doing reads (writes were not affected). This has been corrected, now. Sorry it took a while without enough to reproduce, I had tried myself but focused on the puts when the problem was the gets.

I agree, RocksDB is overwhelming. It's awesome but the documentation has some catching up to do.

[chester89]

Awesome news - I wanted to try out rocksdb, but didn't have enough time.
Now I'll try again with even better client library

2016-08-24 15:28 GMT+03:00 Warren Falk [email protected]:

Closed #4 #4.

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AALnfPVBMG-7lcW8ymJr4CcQDBOyd9tlks5qjDjbgaJpZM4IZ2oE
.

Yours faithfully,
Gleb