mcmilk/7-zip-zstd

7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard

7-zip-zstd's Issues

Updates

Hi, there's been some updates since last release.
Zstandard has updated to 1.3.3
Brotli to 1.0.2
and 7-Zip to 18.00 beta

zstd 1.2.0 is out!

Besides, I found zstd was better than lz4 whether compress or decompress, whether speed or size!
I had thought lz4 was better than zstd on speed!

Option to create archive that stores all smbolic links / junktions as-is

This is equally applicable to 7zip.
7zip totally fails if you want to create exact copy of some folder structure. All symbolic link will be lost.
7zip only has option to save links when you use tar or wim. Can you add an option to do tar.gz in on go (or tar+zstd) that preserves all the links.

CVE-2018-10115

This is a severe issue. Please give us a build based off the new 18.03!

Swap compression level and compression methods dropdowns

In the dialog to add files to archive, the two dropdowns - Compression level and compression method - should be swapped, so that first a method is selected and then compression level - because compression level depends on compression method.

Maybe cooperation with Igor is required on this?

p7zip

Hi Tino,

may you please also create a zstd patch for p7zip?

Vielen Dank

only little question

http://i.imgur.com/TEtVkH9.png and maybe right click and compress with zstd?

PAQ8 or ZPAQ support

Would be amazing if 7z support PAQ8 or ZPAQ compression methods, including sfx with respective stubs.

The Explorer context menu should offer compression to .zst instead of .7z

Having the same file extension for different compression types is confusing. People expect .7z files to be extractable with "normal" 7-Zip.

Workaround: I now always use the "Add to an archive ..." context menu item and select the archive format "zstd" manually.

(tested with 16.04 ZS)

Plugging in the regular Zstandard library into 7zip codecs folder

I know this isn't exactly related to 7-zip-zstd, but given that Tino has lost interest in this, I'm hoping to find a way to upgrade the Zstandard library into the regular 7zip Codecs folder.. To v1.3.4.

I've tried putting the two dll's found within the stand-alone Zstandard executable package - found in https://github.com/facebook/zstd/releases/download/v1.3.4/zstd-v1.3.4-win64.zip . But doing the "7z.exe i" won't show it as being 'installed'.

Alternatively, is there an easy way to compile it for use somehow - either in the regular 7zip or in 7zip-zstd? (For someone that doesn't know much about coding these days.) I have visual Studio 2017 installed, but I just started trying to make heads or tails out of it, strictly for the purpose of the Zstandard algorithm. V1.3.4 is said to to have many speed increases, which has me drooling since it's already speedy at v1.3.3. :)

Thanks!

7z1700-zstd-x64.exe identified by Symantec Endpoint Protection as untrustworthy

The file got moved to quarantine after download.

release links do not work anymore

https://github.com/mcmilk/7-Zip-zstd/releases

:(

v1.1.3 source zstd decompression speed issue

I was wondering if i could get some help with this to see what im doing wrong. When compiling with the v1.1.3 source in VS2015 the resulting 32 bit 7z.exe is 4-5 times slower decompressing zstd archives compared to the downloadable binary installation.

I have made sure that the build.mak has the/Wv:18 flag and used the included build-x32.cmd and run it from visual studios dev command line to successfully compile the projects. Any idea why performance would be so poor for the one compiled? Perhaps I'm missing a preprocessor definition?

Thanks

Cannot open and create exe (self-extracted files) from Explorer Shell

Starting from 7-Zip ZS 17.00 - v1.2.0 - Release 6 the possibility to open self-extracted files with exe extension is broken - "the interface is not supported".

Nut I must admit it happens not always - UPX-packed files are opened normally, NSIS - not (the clean example is GoodSync installer that is available here: https://www.goodsync.com/download/GoodSync-v10-Setup.exe )

Also when creating self-extracted archives via Explorer Shell the window allows to choose options for archive but shows "the interface is not supported" when pressing OK button.

[UI] When choose compressed format other than 7z, and then choose 7z back. the compress method are empty.

Could you add sixth compression method?

There is an open-source lossless JPEG repacker called Lepton:
https://github.com/dropbox/lepton
It can compress JPEG files by ~25%. This is much more than 7zip or WinRAR can do.
WinZIP has a very similar JPEG preprocessor in their ZIPX archive format so it would be great if 7zip also had a way to pack JPEGs.

data after the end of the payload data error for tar.gz

Archives, downloaded (2016-11-16) from Oracle Java Archive:
jre-7u80-windows-i586.tar.gz
jre-7u80-windows-x64.tar.gz

7-Zip ZS 16.04 shows "There are some data after the end of the payload data : jre-7u80-windows-???.tar" when trying to open the tar in 7zFM.

The files open fine in 7-Zip 9.20 upstream/mainline 7-Zip 16.04 has the same issue. The equivalent jre-8u112 archives also open fine.

Suggestions for adding new features

Good morning,
I kindly ask you to consider adding to your project the following functionalities improve the quality of use based on the changes made by the creator of "Easy 7-Zip"?

With the changes in the following range can be read at:http://www.e7z.org/

1. Adds icons to context menu
2. Adds options to Extract dialog
3. Keeps same output folder history
4. Minimizes to system tray when clicking "Background" on progress dialog
5. new installation file
6. • 7-Zip icons replacement -based on files from 7-Zip Theme Manager or added support for the ability to use skins/themes - http://www.7ztm.de/index.php?cat=01_Engli7-Zip Theme Manager

*https://sourceforge.net/p/sevenzip/discussion/45797/thread/32cf3313/

thank you in advance for the inclination for change

dziubek

brotli in firefox's onmi.ja

After 2017-08-30 mozilla pack omni.ja (firefox main js lib) with brotli algo. Why 7-Zip-zstd fails to unpack it if it supports brotli? 7-Zip-zstd say that it's 129:v1 stream and nothing more.

omni.ja.zip

docs (lzip): add lzip to benchmark and replace "LZ4, LZ45" in README.md by "lzip (LZ4, LZ5)"

Quoting from https://sourceforge.net/p/sevenzip/discussion/45797/thread/32771d84/#e23d :

Hello,

I added the lzip patch to my modified 7-Zip version, which also has LZ4, LZ5 and Zstandard multithreaded compression / decompression in it...

And its in the docs, too. Shouldn't it be added to the README.md (and maybe the tags)?

Adding Radyx matchfinder

Is it possible to add "Radyx" match finder from https://github.com/conor42/Radyx

Feature request: Option to change codepage

I would like to have the possibility to change the codepage .. this is only using the cli or using ntleas

Can't stop compression of big files

How to reproduce:
Select some big file (for example, 200 MB), set brotli, set level 11. Start compression. Click "Cancel"->"Yes". Wait several minutes: nothing happens.
Also, you will not see any progress in GUI: progress bar is empty, speed field is empty, processed/compressed size is 0.
If you wait long enough then whole current file will be finished and compression will be canceled but it can take very long time. If doesn't work that way with lzma2, for example: compression stops right after clicking on button.

Also if you select 10+ GB file and set fast compression method (for example, zstandard level 5) you will see speed and size but you are still unable to stop it before the whole file is processed.

Can you do something with it?
Killing the process every time I make a mistake or experimenting is exhausting, and compression speed/size updating once per eternity (for slow algorithms) is really inconvenient.

Issues when extracting geocities archives

Right so I have a fairly large file that I need to decompress, and the file is:

D:\Torrents\geocities.archiveteam.torrent\GEOCITIES\w\www.geocites.com

This file is about 70GB and I get multiple errors, specifically errors that say...

cannot open output file the system cannot find the path specified

Update to Zstandard 1.3.2

Could you please update to Zstandard 1.3.2 (https://github.com/facebook/zstd/releases/tag/v1.3.2)?

ZSTD Memory required to decompress

I have a question about the high memory required to decompress a zstd file with 7-Zip ZS.

I compressed a large file (2.28GB) using 7-Zip ZS and set the compression settings to Level 22 (Ultra), Solid. I also compressed the same file using the executable zstd.exe via command line.
zstd "my file.zst" -f --ultra -22 --threads=8
When decompressing the archive compressed with 7-Zip ZS the peak of the required memory reaches 5GB in the decompression, while the other file created with zstd.exe reaches a peak of 140MB, using 7-Zip ZS or the command line. zstd "my file.zst" -d -f

I am not an expert, that's why I want to understand how this tool works, to see if it is feasible to use it on low-end devices.

Security issues CVE-2018-5996 and CVE-2017-17969

Hi,

is this version of 7-zip affected by these recently published security issues?
https://landave.io/2018/01/7-zip-multiple-memory-corruptions-via-rar-and-zip/

If so, is rebasing to 7-zip 18.00 already viable?

zstandard hit 1.0 release

go'n grab 'em :)

"Add to .zip" context menu option does not work unless zip options have been used at least once

Using the "Add to .zip" context menu options produce a "parameter is incorrect" error if using a fresh install of 7-Zip-zstd where I haven't made a .zip file using the File Manager before. I assume some default setting is unfilled in installation.

Feature request: Use "Number of CPU threads" control

Currently, the "Add to archive" dialog only offers a "Number of CPU threads" setting of 1, which seems to be invalid (I get load on four cores during a compression test.)

If you don't want to use this control (for now), please disable it (or at least empty it, like the dictionary size and word size controls).

Brotli doesn't appear in compression dropdown in GUI?

I might be overlooking something, but is Brotli missing from the compression dropdown?

I'm using 7z 1700-x64 beta with 1.2 release 7 codecs.

crowdfunding for continuation of the project

Hi there,

what about starting crowdfunding on permanent zstd integration into 7zip?
@mcmilk - would this make you go on with the project?

Best regards,
Tobias

For archive format "zstd", all zstd compression levels should be offered in the dialog

In the "Add to archive" dialog of 16.04 ZS, when I select the archive format "zstd", the compression level selection only offers the levels 0, 1, 3, 5, 7, 9. It should offer the same levels 0 - 22 as with archive format 7z and compression method ZSTD.

Does Not Show Option to Compress Folder with ZSTD

Version 1.13 64bit

Disregard

.

manifest - missing stuff.

Windows 8.1/10 support: adding manifest with requestedPrivileges and OS support, _{adding support for Windows' theme and high-DPI screens is a bonus.}

edit:
I've moved it to to here.

_{disclaimer.. You probably can edit it so it will better fit your needs (removing applicationRequestMinimum for example)}

Can not open .zst archives directly via Explorer shell

Associating .zst files with "C:\Program Files\7-Zip-ZStandard\7zFM.exe" via the Explorer context menu item "Open with" -> "Choose another app" and then double-clicking .zst files results in the following error message and in no opening of the archive.

Error:

Can not open file "some-directory-path\some-file-name.zst" as archive.

The same happens when associating the .zst file type via the built-in file association editor (Tools -> Options -> System).

What does work however is opening the file via the Explorer context menu item "7-Zip ZStandard" -> "Open archive".

This applies to .zst archives created and attempted to open with 7-Zip 17.00 ZS v1.3.0 R1.

Extracting exe files

Hi Tino,

I've been noticing that 7-zip-Zstd doesn't want to extract the .exe files that tend to be self-extracting archives - at least not via the context menu. It's one reason I'm still wanting to keep the mainline version around. It will say "no such interface supported".

For instance, it will do this when trying to extract your 7-zip-Zstd installers. 7-zip mainline will extract these without issue.

Which compression should I use for video?

Hi, I noticed that there are alot of compression methods available in this 7z mod.

Which would save the most space for video files? I have mostly mp4 files for video. Does this support the webm & webp formats from google? If so, I may consider converting if it saves on file size.

If those aren't supported, which compression format should I compress them in to save the most space? Brotli, 7zip, gzip etc.

update the external codecs not to depend on 7z.dll

if someone wants to try/use the codecs from Codecs.7z you'd also need to replace the 7z.dll
I really don't think this is a good idea as when 7zip updates you end-up with an obsolete dll nor is it necessary as there are other plugins for 7zip which add support for extra formats/codecs without the need to replace the main program dll for example
http://www.tc4shell.com/en/7zip/lzip/
http://www.tc4shell.com/en/7zip/asar/
http://www.tc4shell.com/en/7zip/wincrypthashers/
the above plugins work without replacing the 7z.dll

Unable to download 7z1604-zstd-x64

Hello, I tried downloading your new x64 release 16.04 for hours... Still having a download error. In every browser. Every operating system. If I rename the crdownload file 7-zip says that the .exe package has CERITIFICATE and [0] corrupted. The renamed installer says ERROR.

Could you check the file?
Thanks!

Update to ZStandard 1.1.2

https://github.com/facebook/zstd/releases/tag/v1.1.2

API : streaming : decompression : changed : automatic implicit reset when chain-decoding new frames without init
API : experimental : added : dictID retrieval functions, and ZSTD_initCStream_srcSize()
API : zbuff : changed : prototypes now generate deprecation warnings
lib : improved : faster decompression speed at ultra compression settings and 32-bits mode
lib : changed : only public ZSTD_ symbols are now exposed
lib : changed : reduced usage of stack memory
lib : fixed : several corner case bugs, by @terrelln
cli : new : gzstd, experimental version able to decode .gz files, by @inikep
cli : new : preserve file attributes
cli : new : added zstdless and zstdgrep tools
cli : fixed : status displays total amount decoded, even for file consisting of multiple frames (like pzstd)
cli : fixed : zstdcat
zlib_wrapper : added support for gz* functions, by @inikep
install : better compatibility with FreeBSD, by @DimitryAndric
source tree : changed : zbuff source files moved to lib/deprecated

https://github.com/facebook/zstd/releases/tag/v1.1.1

New : cli commands -M#, --memory=, --memlimit=, --memlimit-decompress= to limit allowed memory consumption during decompression
New : doc/zstd_manual.html, by @inikep
Improved : slightly better compression ratio at --ultra levels (>= 20)
Improved : better memory usage when using streaming compression API, thanks to @Rogier-5 report
Added : API : ZSTD_initCStream_usingCDict(), ZSTD_initDStream_usingDDict() (experimental section)
Added : examples/multiple_streaming_compression.c
Changed : zstd_errors.h is now installed within /include (and replaces errors_public.h)
Updated man page
Fixed : several sanitizer warnings, by @terrelln
Fixed : zstd-small, zstd-compress and zstd-decompress compilation targets

Problems when adding files to 7z archive from context menu

When pressing any file by right button in Explorer and choosing 7-Zip ZStandard - "Add to "blahblah.7z" the program shows "Incorrect parameter" error.
Adding to zip archive works OK as any other context menu options.

Support zstd long range compressed files / allow long range compression

Can you allow to decompress .zstd that was created with long walk (--long=31).
It gives error "frame requires too much memory for decoding".

On my use with zstd v1.3.3 compresses from 27.2GB to 15.1GB at -1 --longwalk=31 251s usertime but on 7-Zip-zstd on 7 only compresses to 18.7GB and takes a lot more, 1087s usertime.

Details:
https://github.com/facebook/zstd/releases/tag/v1.3.2

Not working with new 7z 18.03

Hello, yours not working with new 7z, can you update it? Thanks

Question about updating process

Do I need to delete the old installation first before running the new installer?

7z file compressed by 7zip R6 cannot be decompressed by p7zip

Hi,

Error log likes:
ERROR: Data Error : zstdtest/README
ERROR: Data Error : zstdtest/TODO
ERROR: Data Error : zstdtest/Utils/bin_to_sources.py
ERROR: Data Error : zstdtest/Utils/CPUTest/Benchmark.h
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/makefile
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/makefile.list
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/MemLat.cpp
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/Walk.c
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/Walk.h
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/Walk32.asm
ERROR: Data Error : zstdtest/Utils/CPUTest/MemLat/Walk64.asm
ERROR: Data Error : zstdtest/Utils/CPUTest/MyVersion.h
ERROR: Data Error : zstdtest/Utils/CPUTest/PipeLen/makefile
ERROR: Data Error : zstdtest/Utils/CPUTest/PipeLen/makefile.list
ERROR: Data Error : zstdtest/Utils/CPUTest/PipeLen/MemLat
ERROR: Data Error : zstdtest/Utils/CPUTest/PipeLen/PipeLen.cpp
ERROR: Data Error : zstdtest/Utils/CPUTest/PipeLen/pl32.asm
ERROR: Data Error : zstdtest/Utils/file_7z.py
ERROR: Data Error : zstdtest/Utils/file_7za.py
ERROR: Data Error : zstdtest/Utils/file_7zCon_sfx.py
ERROR: Data Error : zstdtest/Utils/file_7zFM.py
ERROR: Data Error : zstdtest/Utils/file_7zG.py
ERROR: Data Error : zstdtest/Utils/file_7zr.py
ERROR: Data Error : zstdtest/Utils/file_7z_so.py
ERROR: Data Error : zstdtest/Utils/file_Client7z.py
ERROR: Data Error : zstdtest/Utils/file_Codecs_Lzham_so.py
ERROR: Data Error : zstdtest/Utils/file_Codecs_Rar_so.py
ERROR: Data Error : zstdtest/Utils/file_Codecs_ZStd_so.py

SFX can't unpack zstd

7z.sfx/7zCon.sfx can't unpack zstd archive.
Also 7zS.sfx/7zSD.sfx (SFX Installer) files are nowhere to find.

Please make plugin for Far file manager

There is archive manager plugin in Far which supports 7-zip format. Is it possible to add these new algorithms to that plugin?

[REJECTED] Cancel compression

Pick a big file and initiate any non standard compression, then try to cancel it, confirm and…
On my end compression just goes further, which is quite upsetting experience.
On the contrary, standard compression could be canceled without a hassle.