Comments (3)
Just a quick information, my initial SZ implementation in Adios2 was based on 1.4.12.x version. To use the most recent SZ, we need to change a few things in Adios2. I will start looking at.
from sz.
Thanks @jychoi-hpc . Yes, I removed a few things (see the // above) from sz parameters to make ADIOS2 compile with the latest SZ master. Still, shouldn't crash if defaults are passed.
from sz.
I fixed the issue. Thanks for the feedback.
In testdouble_decompress.c, there is an example to show how to call SZ_Init_Params() to do the initialization without reading the configuration file sz.config.
Specifically, you can change the following code
status = SZ_Init(cfgFile);
/*sz_params sz;
memset(&sz, 0, sizeof(sz_params));
sz.sol_ID = SZ;
sz.sampleDistance = 100;
sz.quantization_intervals = 0;
sz.max_quant_intervals = 65536;
sz.predThreshold = 0.98;
sz.szMode = SZ_BEST_COMPRESSION;
sz.losslessCompressor = ZSTD_COMPRESSOR;
sz.gzipMode = 1;
sz.errorBoundMode = REL;
sz.absErrBound = 1E-6;
sz.relBoundRatio = 1E-5;
SZ_Init_Params(&sz);*/
to be
//status = SZ_Init(cfgFile);
sz_params sz;
memset(&sz, 0, sizeof(sz_params));
sz.sol_ID = SZ;
sz.sampleDistance = 100;
sz.quantization_intervals = 0;
sz.max_quant_intervals = 65536;
sz.predThreshold = 0.98;
sz.szMode = SZ_BEST_COMPRESSION;
sz.losslessCompressor = ZSTD_COMPRESSOR;
sz.gzipMode = 1;
sz.errorBoundMode = REL;
sz.absErrBound = 1E-6;
sz.relBoundRatio = 1E-5;
SZ_Init_Params(&sz);
Then, execute "make" in the example/ directory.
Then, you can test the compression as follows:
./testdouble_compress sz.config testdata/x86/testdouble_8_8_128.dat 8 8 128
Please let me know if you encounter any more questions/problems.
Please also note that the parameters are different between sz 1.4 and sz 2.0, because of some parameters become deprecated in sz 2.0.
For instance, the following parameters are removed in SZ 2.0:
layers
offset
segment_size
pwr_type
Moreover, the default setting of sz.szMode is SZ_BEST_COMPRESSION now.
In SZ 2.0, we added a parameter called losslessCompressor, which is either GZIP_COMPRESSOR or ZSTD_COMPRSSOR. The latter is the recommended setting. If not set for this parameter, ZSTD_COMPRSSOR will be set by default.
from sz.
Related Issues (20)
- Please consider reverting "remove useless config.h in many .c files" HOT 3
- Absolute Error Bound Exceeded
- sz.h issue with HDF5 filter HOT 9
- Puzzling error with absolute mode. HOT 22
- How to get the size of compressed data? HOT 1
- cmake command not found
- sz.h: No such file or directory HOT 1
- Don't compress code example HOT 1
- How to run SZ API code HOT 2
- wrong version error HOT 7
- Poor compression & quality for difficult-to-compress data HOT 17
- A miss-unlocking bug HOT 2
- Better warning about Windows not being supported? HOT 14
- can not find the [INSTALL_DIR]/bin HOT 4
- write the compressed data in a file HOT 10
- SZ principle work HOT 6
- Segmentation fault when first dimension has size 1 HOT 7
- missing header sys/time.h HOT 2
- New tag after update in the hdf5 filter interface HOT 1
- Adding SZ to hdf5plugin HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sz.