Comments (8)
The code is too complicated for me to see an obvious flaw, and is missing enough that I can't run it, and missing enough detail in the comments to reconstruct the missing parts, which makes it difficult to be of much help. If you can reproduce the problem with simpler code, it would make it a lot simpler. I will see if I can reproduce a memory leak with similar operations.
from rocksdb-sharp.
How big is the database, on disk, when this runs out of memory?
from rocksdb-sharp.
Well, that's the weird part, it's kinda.. random to me. Or i just can't find the pattern here. Sometimes it have 260 MB and sometimes it stops on like 90 MB. The same database takes like 4 GB when i try to build it on LMDB!
I will try to create small project to reproduce this.
from rocksdb-sharp.
I wasn't able to create small project since this whole thing is just POC and project structure is kinda big mess. You can get whole solution and build RocksDbBuilder to reproduce this problem. Links:
Solution: https://mega.nz/#!pYMgiB6b!-3me6SnpTWTthmhLpZX14EFCbAlofoPAxzOz6ct6gmw
Data (use this directory as application param): https://mega.nz/#!dAdjhZJL!GdfdEPSlwqLI-LEjzK4Dd_Bc-dCIIGXxb1Sb89WdMEk
from rocksdb-sharp.
@NekroMancer Have you looked at memory usage wiki page?
from rocksdb-sharp.
@chester89 I looked - honestly RocksDB is pretty overwhelming for me with its all configuration options. And i tried to find answer to the one question that really interests me - is it even possible to setup something like "max heap" for RocksDB instance. But without any luck..
@warrenfalk Sorry, my bad. I updated links
from rocksdb-sharp.
Indeed there was a memory leak in the .Net wrapper when doing reads (writes were not affected). This has been corrected, now. Sorry it took a while without enough to reproduce, I had tried myself but focused on the puts when the problem was the gets.
I agree, RocksDB is overwhelming. It's awesome but the documentation has some catching up to do.
from rocksdb-sharp.
Awesome news - I wanted to try out rocksdb, but didn't have enough time.
Now I'll try again with even better client library
2016-08-24 15:28 GMT+03:00 Warren Falk [email protected]:
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#4 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AALnfPVBMG-7lcW8ymJr4CcQDBOyd9tlks5qjDjbgaJpZM4IZ2oE
.
Yours faithfully,
Gleb
from rocksdb-sharp.
Related Issues (20)
- Options files support
- StartsWith Query HOT 2
- delete all keys
- Logger tuning support
- 5.4.6.11 release schedule HOT 1
- CompactRange does not support full key range compaction
- RocksDb Dispose stalls forever HOT 5
- MergeOperator Support
- RocksDb.MultiGet - ColumnFamilyHandle[]
- OpenAsSecondary instance
- Expose FIFO Compaction with TTL
- Calling Dispose twice on a RocksDb instance throws an AccessViolationException
- Checkpoint: Hardlink
- Limiting unmanaged memory consumption HOT 1
- MultiGet with ColumnFamily not working
- Including the a snappy dll link with the nuget
- CreateColumnFamily API causes RocksDbSharp.RocksDbException: IO error HOT 2
- RocksDbNave looks for the wrong native library in Linux HOT 1
- OpenWithTtl together with another column family
- Create CreateColumnFamily retrun nullptr HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rocksdb-sharp.