Comments (7)
In fact compact benchmark has only one C
Thank you for your answer.
Is the ops/sec of the CompactRange operation too slow?About Readrandom:
Thank you for your advice, I will try to find the anwer from the LOG file.
See db_bench_tool.cc line 1818 for its output, CompactRange is one opertation and this operation takes in a few seconds(it's normal because of high comsuming of compaction).
For "compact : 1445.000 micros/op 692 ops/sec;" is not correct , because you use terark-zip-table on fillrandom and compact on block-based-table, you may find from LOG like this: "error: Corruption: Bad table magic number: expected 9863518390377041911, found 1234605616436508552", so the actual compact would not happen and end quickly(that's why ops/sec is so large). We will fix this bug later.
from terarkdb.
compact : 2878433.000 micros/op 0 ops/sec;
vs
compact : 1445.000 micros/op 692 ops/sec;
you think this two value is invalid, especially the first one is 0 ops/sec?Am I right?
from terarkdb.
0 ops/sec is right.
If you run "$$ ./db_bench --benchmarks=fillrandom --use_existing_db=0 --disable_auto_compactions=1 --sync=0 --db=/data4/liufl/terarkdb/db/ --wal_dir=/data4/liufl/terarkdb/wal/ --num=1000000000" , you should also run "
$$ ./output/db_bench --benchmarks=compact --use_existing_db=1 --db=/data4/liufl/rocksdb/_terarkdb/". Both of which use terark-zip-table.
If you want to run "$$ ./output/db_bench --benchmarks=compact --use_existing_db=1 --db=/data4/liufl/rocksdb/_terarkdb/ --use_terark_table=false" , you should add --use_terark_table=false to fillrandom benchmark also before run it.
In fact compact benchmark has only one CompactRange operation, so its ops/sec is <1.0 and its output is 0. If you run bench(fillrandom + compact) with "-use_terark_table=false" both, the same output will you find.
About Readrandom:
Maybe bulkload has some flush didn't accomplish, when you ran radrandom ,it kept on flushing so you found some write bandwidth. LOG file may anwser your question.
from terarkdb.
compact : 2878433.000 micros/op 0 ops/sec;
vs
compact : 1445.000 micros/op 692 ops/sec;you think this two value is invalid, especially the first one is 0 ops/sec?Am I right?
in my opinion,
the first global compact is slow, so the first output is 0ops/sec.
the second global compact is fast because you have finished a global compact.
from terarkdb.
compact : 2878433.000 micros/op 0 ops/sec;
vs
compact : 1445.000 micros/op 692 ops/sec;you think this two value is invalid, especially the first one is 0 ops/sec?Am I right?
Only the first one. Why is it so slow,no matter how much data is in the DB.
from terarkdb.
In fact compact benchmark has only one C
Thank you for your answer.
Is the ops/sec of the CompactRange operation too slow?
About Readrandom:
Thank you for your advice, I will try to find the anwer from the LOG file.
from terarkdb.
In fact compact benchmark has only one C
Thank you for your answer.
Is the ops/sec of the CompactRange operation too slow?
About Readrandom:
Thank you for your advice, I will try to find the anwer from the LOG file.See db_bench_tool.cc line 1818 for its output, CompactRange is one opertation and this operation takes in a few seconds(it's normal because of high comsuming of compaction).
For "compact : 1445.000 micros/op 692 ops/sec;" is not correct , because you use terark-zip-table on fillrandom and compact on block-based-table, you may find from LOG like this: "error: Corruption: Bad table magic number: expected 9863518390377041911, found 1234605616436508552", so the actual compact would not happen and end quickly(that's why ops/sec is so large). We will fix this bug later.
Thanks for patiently answering my question.
Please forgive me for not knowing terarkdb/rocksdb well enough. Refer to your guidance, I will continue to read terarkdb/rocksdb code.
from terarkdb.
Related Issues (20)
- what is the largest db size of terarkdb? HOT 1
- compilation issue WITH_TESTS=OFF WITH_ZNS=OFF ./build.sh HOT 1
- customized terarkzip default options/options.cc modification. problem as mentioned HOT 4
- terarksql possible to opensource the storage engine? HOT 2
- can someone help make terarkzip default by checking what's wrong with this options.cc file?
- can someone pls provide the build.sh instructions for ubuntu 22.04 docker environment?
- another server with old installation of libterarkzip.a
- trying to use golang binding from grocksdb but realised that terarkzip option not available
- Is there memory growing issue like rocksdb do
- question about delete column family. HOT 7
- No Content in LOG file where using terarkdb in JNI HOT 2
- Is it possible to add switch to schedule TTL HOT 8
- for time based key, which is better? little endian or big endian for this patricia trie?
- May I know if TerarkFS support is done and can be tested?
- Ubuntu 22.04 compilation error
- how stable is terarkdb for production use? HOT 1
- About max subcompaction and blob size HOT 2
- is it possible to separately store l1 and l2 or l3 blob in different disks? HOT 1
- [BUG] example/simple_example.cc is out of date
- different prefix indexing strategies per ColumnFamilyOptions
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from terarkdb.