climateprediction.net (CPDN) home page
Thread 'LZMA2 (7zip) compression of transferred data files'

Thread 'LZMA2 (7zip) compression of transferred data files'

Questions and Answers : Wish list : LZMA2 (7zip) compression of transferred data files
Message board moderation

To post messages, you must log in.

AuthorMessage
elias023

Send message
Joined: 11 Jan 17
Posts: 1
Credit: 528,999
RAC: 0
Message 55897 - Posted: 14 Mar 2017, 20:37:35 UTC

Did a compression test of the content of some of the .gz data files stored by CPDN.
LZMA2 seems to halve the space used and transferred. I wish LZMA2 compression.
ID: 55897 · Report as offensive     Reply Quote
Heuristic0667

Send message
Joined: 10 May 19
Posts: 8
Credit: 30,476
RAC: 0
Message 60149 - Posted: 16 May 2019, 13:53:14 UTC

The uploaded file is already compressed in zip format / Deflate compression algorithm, the compression rate(compressed file size/original data size) is about 66.09%.
During my own compress test, compressing using LZMA2 with "best quality" and "solid" configured achieved a better (but not MUCH better) compression rate (53.74%), and the CPU time used in the compression process is much more(11 seconds for DEFLATE, and 41.9 seconds for LZMA2, tested on i7-6500U).
ID: 60149 · Report as offensive     Reply Quote

Questions and Answers : Wish list : LZMA2 (7zip) compression of transferred data files

©2024 cpdn.org