|
Wanted to see how much slower was 'Lexx' compared to 'Hoshimi', quite, below a good showdown between some strong compressors is given.
I sacrificed Hoshimi's speed in order to better (on paper from 4:1 to 8:1) Lexx' compression ratio.
Main thing, first, the code of the latest&last Nakamichi:
; Nakamichi 'Oniyanma-Monsterdragonfly-Lexx_branchless' decompression loop, dc-3c+6=166 bytes long:
; mark_description "Intel(R) C++ Intel(R) 64 Compiler XE for applications running on Intel(R) 64, Version 15.0.0.108 Build 20140";
; mark_description "-O3 -QxSSE2 -D_N_GP -FAcs";
.B6.3::
0003c 8b 2a mov ebp, DWORD PTR [rdx]
0003e 89 e9 mov ecx, ebp
00040 83 f1 03 xor ecx, 3
00043 bf ff ff ff ff mov edi, -1
00048 c1 e1 03 shl ecx, 3
0004b 4d 89 c6 mov r14, r8
0004e d3 ef shr edi, cl
00050 49 89 d7 mov r15, rdx
00053 23 ef and ebp, edi
00055 33 ff xor edi, edi
00057 41 89 eb mov r11d, ebp
0005a 41 89 ec mov r12d, ebp
0005d 41 83 e3 0f and r11d, 15
00061 41 83 fb 0c cmp r11d, 12
00065 0f 44 f8 cmove edi, eax
00068 41 c1 ec 04 shr r12d, 4
0006c ff cf dec edi
0006e 45 89 e5 mov r13d, r12d
00071 49 89 fb mov r11, rdi
00074 4d 2b f5 sub r14, r13
00077 49 f7 d3 not r11
0007a 49 ff ce dec r14
0007d 4d 23 fb and r15, r11
00080 4c 23 f7 and r14, rdi
00083 4b 8b 4c 37 01 mov rcx, QWORD PTR [1+r15+r14]
00088 49 89 08 mov QWORD PTR [r8], rcx
0008b 4b 8b 4c 37 09 mov rcx, QWORD PTR [9+r15+r14]
00090 49 89 48 08 mov QWORD PTR [8+r8], rcx
00094 4b 8b 4c 37 11 mov rcx, QWORD PTR [17+r15+r14]
00099 49 89 48 10 mov QWORD PTR [16+r8], rcx
0009d 4f 8b 74 37 19 mov r14, QWORD PTR [25+r15+r14]
000a2 4d 89 70 18 mov QWORD PTR [24+r8], r14
000a6 41 89 ee mov r14d, ebp
000a9 83 e5 0c and ebp, 12
000ac 41 83 e6 03 and r14d, 3
000b0 83 c5 04 add ebp, 4
000b3 41 ff c6 inc r14d
000b6 41 ff c4 inc r12d
000b9 44 89 f1 mov ecx, r14d
000bc 4d 23 eb and r13, r11
000bf c1 e9 02 shr ecx, 2
000c2 d3 e5 shl ebp, cl
000c4 4d 23 e3 and r12, r11
000c7 4c 23 f7 and r14, rdi
000ca 48 23 ef and rbp, rdi
000cd 4d 03 e6 add r12, r14
000d0 4c 03 ed add r13, rbp
000d3 49 03 d4 add rdx, r12
000d6 4d 03 c5 add r8, r13
000d9 49 3b d1 cmp rdx, r9
000dc 0f 82 5a ff ff
ff jb .B6.3
When compiled with -D_N_YMM the code should be (in theory) significantLY faster, but my experiments with Haswell showed that it is not the case, no matter, future CPUs should be optimized YMM to behave as it should.
Also, contrary to my expectations the branchless compile is slower than the branchfull, again, it is just the current situation, I expect future CPUs to take full advantage of this vector-friendly code.
Anyway, the decompression speeds given below are achieved by this very 64bit General Purpose code.
Speaking of compression speed 'Lexx' still holds the title 'Slowest Compressor Under the Sun'. Just an example using one of files used in this benchmark:
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\testlexx>Nakamichi_Oniyanma_Monsterdragonfly_Lexx_GP_32bit.exe open_watcom_1.9.0-src.tar
Nakamichi 'Oniyanma-Monsterdragonfly-Lexx', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Compressing 259707904 bytes ...
-; Each rotation means 64KB are encoded; Done 100%
NumberOfFullLiterals (lower-the-better): 75312
Legend: MatchLengths: 4|8=Tiny, 8|16=Short, 12|24=Medium, 16|32=Long; WindowSizes: 1/2/3/4=Tiny/Short/Medium/Long
NumberOf(Tiny )Matches,[Tiny ]Window (4)[1]: 342188
NumberOf(Short )Matches,[Tiny ]Window (8)[1]: 546155
NumberOf(Medium)Matches,[Tiny ]Window (12)[1]: 5508719
NumberOf(Tiny )Matches,[Short ]Window (4)[2]: 1445641
NumberOf(Short )Matches,[Short ]Window (8)[2]: 981296
NumberOf(Medium)Matches,[Short ]Window (12)[2]: 793145
NumberOf(Long )Matches,[Short ]Window (16)[2]: 4381164
NumberOf(Tiny )Matches,[Medium]Window (4)[3]: 1240192
NumberOf(Short )Matches,[Medium]Window (8)[3]: 911758
NumberOf(Medium)Matches,[Medium]Window (12)[3]: 420946
NumberOf(Long )Matches,[Medium]Window (16)[3]: 492830
NumberOf(Tiny )Matches,[Long ]Window (8)[4]: 828145
NumberOf(Short )Matches,[Long ]Window (16)[4]: 279066
NumberOf(Medium)Matches,[Long ]Window (24)[4]: 323066
NumberOf(Long )Matches,[Long ]Window (32)[4]: 1461582
RAM-to-RAM performance: 159 bytes/s.
Compressed to 47370235 bytes.
Grmbl, for 'Watcom' testfile 'Lexx' falls behind, yet, it goes beyond Hoshimi's 4:1 ratio.
The results from MTCS (Mini_Textual_Compression_Showdown) on laptop with Core 2 Q9550s @2.8GHz (memcpy() 2727MB/s):
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Testdatafile \ Decompressor | Uncompressed | Zstd 1 thread | LZ4 1 thread | Nakamichi 'Oniyanma' (branchless 64bit) |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt | 92,096 | 35,088; 312.5 MB/s | 38,639; 921.2 MB/s | 44,818; 384 MB/s |
| Fahrenheit_451_-_Ray_Bradbury.txt | 260,569 | 104,745; 305.5 MB/s | 114,133; 860.1 MB/s | 126,069; 384 MB/s |
| calgary.tar | 3,265,536 | 1,174,132; 369.1 MB/s | 1,241,017; 1064.2 MB/s | 1,332,624; 512 MB/s |
| Webster_Bible.tar | 4,612,608 | 1,616,411; 322.5 MB/s | 1,686,148; 951.4 MB/s | 1,524,728; 576 MB/s |
| Fyodor_Dostoyevsky_12-books.tar | 9,569,792 | 3,820,603; 301.7 MB/s | 4,080,915; 903.7 MB/s | 3,508,317; 448 MB/s |
| The_Book_of_The_Thousand_Nights_and_a_Night.txt | 14,613,183 | 5,932,453; 306.5 MB/s | 6,223,940; 921.9 MB/s | 5,425,740; 384 MB/s |
| Agatha_Christie_89-ebooks_TXT.tar | 33,258,496 | 12,615,468; 305.7 MB/s | 13,365,137; 909.2 MB/s | 10,913,026; 320 MB/s |
| Encyclopedia_of_Language_and_Linguistics.txt | 59,416,161 | 19,751,262; 359.0 MB/s | 21,118,982; 1038.8 MB/s | 18,675,464; 320 MB/s |
| enwik8 | 100,000,000 | 40,024,854; 326.4 MB/s | 42,283,904; 936.9 MB/s | 35,425,948; 192 MB/s |
| OSHO.TXT | 206,908,949 | 66,655,604; 339.5 MB/s | 71,399,309; 947.4 MB/s | 54,357,708; 256 MB/s |
| open_watcom_1.9.0-src.tar | 259,707,904 | 39,078,326; 665.9 MB/s | 41,757,845; 1437.5 MB/s | 47,370,235; 576 MB/s |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Despite 'Lexx' is run on non-native (that is, 256bit) system it keeps up with the phenomenal Zstd.
[Performers:]
- LZ4 for Windows 32-bits v1.4, by Yann Collet (Sep 17 2013).
- zstd command line interface 64-bits v0.0.1, by Yann Collet (Jan 25 2015).
- 7-Zip (A) 9.20, Copyright (c) 1999-2010 Igor Pavlov, 2010-11-18.
- bsc, Block Sorting Compressor, Version 3.1.0. Copyright (c) 2009-2012 Ilya Grebnov, 8 July 2012.
- lzturbo 1.2 Copyright (c) 2007-2014 Hamid Buzidi, Aug 11 2014.
- zpaq v7.05 journaling archiver, compiled Apr 17 2015.
- Nakamichi 'Oniyanma-Monsterdragonfly-Lexx' (branchless 64bit compile), written by Kaze, based on Nobuo Ito's LZSS source, 2015-Mar-27.
[Options used:]
>LZ4.exe -9 enwik8
>zstd.exe enwik8
>7za a -tgzip -mx9 enwik8.zip enwik8
>bsc e enwik8 enwik8.ST6Block256.bsc -b256 -m6 -cp -Tt
>lzturbo.exe -39 -b256 -p0 enwik8 enwik8.256MB.lzturbo12-39.lzt
>zpaq64.exe add enwik8.method28.zpaq enwik8 -method 28 -threads 1
>zpaq64.exe add enwik8.method58.zpaq enwik8 -method 58 -threads 1
>Nakamichi_Oniyanma_Monsterdragonfly_Lexx_GP_64bit.exe enwik8
[Compression Ratio for the 18 testdatafiles:]
06/02/2015 11:11 PM 33,258,496 Agatha_Christie_89-ebooks_TXT.tar
06/03/2015 02:35 AM 7,955,038 Agatha_Christie_89-ebooks_TXT.tar.256MB.lzturbo12-39.lzt
06/03/2015 02:59 AM 13,365,137 Agatha_Christie_89-ebooks_TXT.tar.lz4
06/03/2015 03:27 AM 9,557,649 Agatha_Christie_89-ebooks_TXT.tar.method28.zpaq
06/03/2015 03:41 AM 6,036,509 Agatha_Christie_89-ebooks_TXT.tar.method58.zpaq
05/27/2015 03:35 AM 10,913,026 Agatha_Christie_89-ebooks_TXT.tar.Nakamichi
06/03/2015 03:25 AM 6,780,062 Agatha_Christie_89-ebooks_TXT.tar.ST6Block256.bsc
06/03/2015 03:01 AM 11,173,195 Agatha_Christie_89-ebooks_TXT.tar.zip
06/03/2015 03:00 AM 12,615,468 Agatha_Christie_89-ebooks_TXT.tar.zst
06/02/2015 11:14 PM 3,265,536 calgary.tar
06/03/2015 02:35 AM 919,768 calgary.tar.256MB.lzturbo12-39.lzt
06/03/2015 02:59 AM 1,241,017 calgary.tar.lz4
06/03/2015 03:27 AM 1,079,779 calgary.tar.method28.zpaq
06/03/2015 03:42 AM 683,836 calgary.tar.method58.zpaq
05/27/2015 03:35 AM 1,332,624 calgary.tar.Nakamichi
06/03/2015 03:25 AM 825,066 calgary.tar.ST6Block256.bsc
06/03/2015 03:01 AM 1,017,229 calgary.tar.zip
06/03/2015 03:00 AM 1,174,132 calgary.tar.zst
06/02/2015 11:17 PM 59,416,161 Encyclopedia_of_Language_and_Linguistics.txt
06/03/2015 02:36 AM 12,886,052 Encyclopedia_of_Language_and_Linguistics.txt.256MB.lzturbo12-39.lzt
06/03/2015 02:59 AM 21,118,982 Encyclopedia_of_Language_and_Linguistics.txt.lz4
06/03/2015 03:28 AM 15,331,800 Encyclopedia_of_Language_and_Linguistics.txt.method28.zpaq
06/03/2015 03:47 AM 9,744,369 Encyclopedia_of_Language_and_Linguistics.txt.method58.zpaq
05/27/2015 03:35 AM 18,675,464 Encyclopedia_of_Language_and_Linguistics.txt.Nakamichi
06/03/2015 03:26 AM 10,976,462 Encyclopedia_of_Language_and_Linguistics.txt.ST6Block256.bsc
06/03/2015 03:02 AM 17,546,530 Encyclopedia_of_Language_and_Linguistics.txt.zip
06/03/2015 03:00 AM 19,751,262 Encyclopedia_of_Language_and_Linguistics.txt.zst
06/02/2015 11:21 PM 100,000,000 enwik8
06/03/2015 02:38 AM 25,330,833 enwik8.256MB.lzturbo12-39.lzt
06/03/2015 02:59 AM 42,283,904 enwik8.lz4
06/03/2015 03:29 AM 30,088,258 enwik8.method28.zpaq
06/03/2015 03:55 AM 19,084,598 enwik8.method58.zpaq
05/27/2015 03:35 AM 35,425,948 enwik8.Nakamichi
06/03/2015 03:26 AM 22,112,692 enwik8.ST6Block256.bsc
06/03/2015 03:05 AM 35,102,891 enwik8.zip
06/03/2015 03:00 AM 40,024,854 enwik8.zst
06/02/2015 11:24 PM 260,569 Fahrenheit_451_-_Ray_Bradbury.txt
06/03/2015 02:38 AM 87,538 Fahrenheit_451_-_Ray_Bradbury.txt.256MB.lzturbo12-39.lzt
06/03/2015 02:59 AM 114,133 Fahrenheit_451_-_Ray_Bradbury.txt.lz4
06/03/2015 03:29 AM 104,230 Fahrenheit_451_-_Ray_Bradbury.txt.method28.zpaq
06/03/2015 03:55 AM 66,508 Fahrenheit_451_-_Ray_Bradbury.txt.method58.zpaq
05/27/2015 03:35 AM 126,069 Fahrenheit_451_-_Ray_Bradbury.txt.Nakamichi
06/03/2015 03:26 AM 71,214 Fahrenheit_451_-_Ray_Bradbury.txt.ST6Block256.bsc
06/03/2015 03:05 AM 92,457 Fahrenheit_451_-_Ray_Bradbury.txt.zip
06/03/2015 03:00 AM 104,745 Fahrenheit_451_-_Ray_Bradbury.txt.zst
06/02/2015 11:27 PM 9,569,792 Fyodor_Dostoyevsky_12-books.tar
06/03/2015 02:38 AM 2,560,124 Fyodor_Dostoyevsky_12-books.tar.256MB.lzturbo12-39.lzt
06/03/2015 02:59 AM 4,080,915 Fyodor_Dostoyevsky_12-books.tar.lz4
06/03/2015 03:29 AM 3,062,047 Fyodor_Dostoyevsky_12-books.tar.method28.zpaq
06/03/2015 03:55 AM 1,882,135 Fyodor_Dostoyevsky_12-books.tar.method58.zpaq
06/01/2015 12:17 AM 3,508,317 Fyodor_Dostoyevsky_12-books.tar.Nakamichi
06/03/2015 03:26 AM 2,122,550 Fyodor_Dostoyevsky_12-books.tar.ST6Block256.bsc
06/03/2015 03:05 AM 3,386,527 Fyodor_Dostoyevsky_12-books.tar.zip
06/03/2015 03:00 AM 3,820,603 Fyodor_Dostoyevsky_12-books.tar.zst
06/02/2015 11:31 PM 146,759,168 glibc-2.21.tar
06/03/2015 02:41 AM 13,514,351 glibc-2.21.tar.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 32,362,501 glibc-2.21.tar.lz4
06/03/2015 03:30 AM 21,296,789 glibc-2.21.tar.method28.zpaq
06/03/2015 04:05 AM 8,515,050 glibc-2.21.tar.method58.zpaq
05/04/2015 12:21 PM 31,307,973 glibc-2.21.tar.Nakamichi
06/03/2015 03:26 AM 13,126,766 glibc-2.21.tar.ST6Block256.bsc
06/03/2015 03:08 AM 22,101,099 glibc-2.21.tar.zip
06/03/2015 03:00 AM 27,520,182 glibc-2.21.tar.zst
06/02/2015 11:34 PM 81,324,663 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt
06/03/2015 02:42 AM 16,790,449 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 32,656,409 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.lz4
06/03/2015 03:31 AM 27,387,447 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.method28.zpaq
06/03/2015 04:12 AM 9,825,568 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.method58.zpaq
05/27/2015 03:35 AM 28,825,883 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.Nakamichi
06/03/2015 03:26 AM 15,424,258 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.ST6Block256.bsc
06/03/2015 03:09 AM 17,175,535 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.zip
06/03/2015 03:00 AM 27,461,200 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.zst
06/02/2015 11:38 PM 55,409,152 Kursk_Hitler_WWII_49-texts.tar
06/03/2015 02:43 AM 14,005,228 Kursk_Hitler_WWII_49-texts.tar.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 22,930,264 Kursk_Hitler_WWII_49-texts.tar.lz4
06/03/2015 03:32 AM 16,768,421 Kursk_Hitler_WWII_49-texts.tar.method28.zpaq
06/03/2015 04:19 AM 10,335,307 Kursk_Hitler_WWII_49-texts.tar.method58.zpaq
05/27/2015 03:35 AM 19,053,540 Kursk_Hitler_WWII_49-texts.tar.Nakamichi
06/03/2015 03:26 AM 11,778,146 Kursk_Hitler_WWII_49-texts.tar.ST6Block256.bsc
06/03/2015 03:11 AM 19,354,978 Kursk_Hitler_WWII_49-texts.tar.zip
06/03/2015 03:00 AM 21,682,469 Kursk_Hitler_WWII_49-texts.tar.zst
06/02/2015 11:41 PM 132,728,832 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar
06/03/2015 02:47 AM 16,451,660 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 30,133,280 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.lz4
06/03/2015 03:33 AM 19,741,855 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.method28.zpaq
06/03/2015 04:29 AM 10,954,157 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.method58.zpaq
05/27/2015 03:35 AM 27,311,688 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.Nakamichi
06/03/2015 03:26 AM 13,024,928 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.ST6Block256.bsc
06/03/2015 03:14 AM 25,418,601 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.zip
06/03/2015 03:00 AM 29,770,454 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.zst
06/02/2015 11:45 PM 259,707,904 open_watcom_1.9.0-src.tar
06/03/2015 02:52 AM 21,908,095 open_watcom_1.9.0-src.tar.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 41,757,845 open_watcom_1.9.0-src.tar.lz4
06/03/2015 03:35 AM 27,987,854 open_watcom_1.9.0-src.tar.method28.zpaq
06/03/2015 04:46 AM 15,630,827 open_watcom_1.9.0-src.tar.method58.zpaq
06/02/2015 05:19 AM 47,370,235 open_watcom_1.9.0-src.tar.Nakamichi
06/03/2015 03:27 AM 22,207,814 open_watcom_1.9.0-src.tar.ST6Block256.bsc
06/03/2015 03:19 AM 33,780,738 open_watcom_1.9.0-src.tar.zip
06/03/2015 03:00 AM 39,078,326 open_watcom_1.9.0-src.tar.zst
06/02/2015 11:49 PM 206,908,949 OSHO.TXT
06/03/2015 02:59 AM 40,006,461 OSHO.TXT.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 71,399,309 OSHO.TXT.lz4
06/03/2015 03:37 AM 48,770,217 OSHO.TXT.method28.zpaq
06/03/2015 05:02 AM 30,258,564 OSHO.TXT.method58.zpaq
05/27/2015 03:35 AM 54,357,708 OSHO.TXT.Nakamichi
06/03/2015 03:27 AM 34,181,346 OSHO.TXT.ST6Block256.bsc
06/03/2015 03:24 AM 59,289,895 OSHO.TXT.zip
06/03/2015 03:00 AM 66,655,604 OSHO.TXT.zst
06/02/2015 11:53 PM 16,013,935 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt
06/03/2015 02:59 AM 4,627,911 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 7,187,432 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.lz4
06/03/2015 03:37 AM 5,513,948 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.method28.zpaq
06/03/2015 05:03 AM 3,451,092 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.method58.zpaq
05/27/2015 03:35 AM 6,266,162 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.Nakamichi
06/03/2015 03:27 AM 3,813,612 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.ST6Block256.bsc
06/03/2015 03:25 AM 5,943,470 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.zip
06/03/2015 03:00 AM 6,704,892 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.zst
06/02/2015 11:56 PM 4,999,168 Sahih_Bukhari.tar
06/03/2015 02:59 AM 935,699 Sahih_Bukhari.tar.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 1,513,907 Sahih_Bukhari.tar.lz4
06/03/2015 03:37 AM 1,125,870 Sahih_Bukhari.tar.method28.zpaq
06/03/2015 05:03 AM 663,373 Sahih_Bukhari.tar.method58.zpaq
05/27/2015 03:35 AM 1,374,342 Sahih_Bukhari.tar.Nakamichi
06/03/2015 03:27 AM 770,526 Sahih_Bukhari.tar.ST6Block256.bsc
06/03/2015 03:25 AM 1,274,728 Sahih_Bukhari.tar.zip
06/03/2015 03:00 AM 1,424,939 Sahih_Bukhari.tar.zst
06/02/2015 11:59 PM 14,613,183 The_Book_of_The_Thousand_Nights_and_a_Night.txt
06/03/2015 02:59 AM 3,982,547 The_Book_of_The_Thousand_Nights_and_a_Night.txt.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 6,223,940 The_Book_of_The_Thousand_Nights_and_a_Night.txt.lz4
06/03/2015 03:37 AM 4,717,755 The_Book_of_The_Thousand_Nights_and_a_Night.txt.method28.zpaq
06/03/2015 05:04 AM 2,932,378 The_Book_of_The_Thousand_Nights_and_a_Night.txt.method58.zpaq
05/27/2015 03:35 AM 5,425,740 The_Book_of_The_Thousand_Nights_and_a_Night.txt.Nakamichi
06/03/2015 03:27 AM 3,273,062 The_Book_of_The_Thousand_Nights_and_a_Night.txt.ST6Block256.bsc
06/03/2015 03:25 AM 5,198,949 The_Book_of_The_Thousand_Nights_and_a_Night.txt.zip
06/03/2015 03:00 AM 5,932,453 The_Book_of_The_Thousand_Nights_and_a_Night.txt.zst
06/03/2015 12:02 AM 92,096 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt
06/03/2015 02:59 AM 30,730 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 38,639 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.lz4
06/03/2015 03:37 AM 36,711 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.method28.zpaq
06/03/2015 05:04 AM 23,631 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.method58.zpaq
05/27/2015 03:35 AM 44,818 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.Nakamichi
06/03/2015 03:27 AM 25,202 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.ST6Block256.bsc
06/03/2015 03:25 AM 30,329 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.zip
06/03/2015 03:00 AM 35,088 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.zst
06/03/2015 12:05 AM 4,612,608 Webster_Bible.tar
06/03/2015 02:59 AM 1,122,782 Webster_Bible.tar.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 1,686,148 Webster_Bible.tar.lz4
06/03/2015 03:37 AM 1,346,202 Webster_Bible.tar.method28.zpaq
06/03/2015 05:05 AM 782,292 Webster_Bible.tar.method58.zpaq
05/27/2015 03:35 AM 1,524,728 Webster_Bible.tar.Nakamichi
06/03/2015 03:27 AM 910,244 Webster_Bible.tar.ST6Block256.bsc
06/03/2015 03:25 AM 1,378,457 Webster_Bible.tar.zip
06/03/2015 03:00 AM 1,616,411 Webster_Bible.tar.zst
06/03/2015 12:09 AM 5,047,949 www.gnu.org_libc.html
06/03/2015 02:59 AM 664,443 www.gnu.org_libc.html.256MB.lzturbo12-39.lzt
06/03/2015 03:00 AM 1,068,688 www.gnu.org_libc.html.lz4
06/03/2015 03:37 AM 792,538 www.gnu.org_libc.html.method28.zpaq
06/03/2015 05:05 AM 439,607 www.gnu.org_libc.html.method58.zpaq
05/27/2015 03:35 AM 1,148,342 www.gnu.org_libc.html.Nakamichi
06/03/2015 03:27 AM 556,420 www.gnu.org_libc.html.ST6Block256.bsc
06/03/2015 03:25 AM 881,512 www.gnu.org_libc.html.zip
06/03/2015 03:00 AM 1,021,036 www.gnu.org_libc.html.zst
And listing the files tarred into next four .tar files:
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>7za.exe l New_Shorter_Oxford_English_Dictionary_fifth_edition.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Listing archive: New_Shorter_Oxford_English_Dictionary_fifth_edition.tar
--
Path = New_Shorter_Oxford_English_Dictionary_fifth_edition.tar
Type = tar
Physical Size = 132728832
Headers Size = 6144
Date Time Attr Size Compressed Name
------------------- ----- ------------ ------------ ------------------------
2014-06-05 20:34:42 D.... 0 0 New_Shorter_Oxford_English_Dictionary_fifth_edition
2002-08-08 15:50:56 ..... 37881541 37881856 New_Shorter_Oxford_English_Dictionary_fifth_edition\1.htm
2002-08-08 16:35:42 ..... 36974857 36975104 New_Shorter_Oxford_English_Dictionary_fifth_edition\2.htm
2002-08-08 17:20:24 ..... 41378864 41379328 New_Shorter_Oxford_English_Dictionary_fifth_edition\3.htm
2002-08-08 17:38:38 ..... 16339873 16339968 New_Shorter_Oxford_English_Dictionary_fifth_edition\4.htm
2002-08-06 15:51:52 ..... 22437 22528 New_Shorter_Oxford_English_Dictionary_fifth_edition\Abbreviations.htm
2002-08-06 15:53:24 ..... 92745 93184 New_Shorter_Oxford_English_Dictionary_fifth_edition\Guide.htm
2002-08-06 15:57:26 ..... 2394 2560 New_Shorter_Oxford_English_Dictionary_fifth_edition\Lexicographers.htm
2002-08-06 16:01:38 ..... 13867 14336 New_Shorter_Oxford_English_Dictionary_fifth_edition\preface.htm
2002-08-06 16:02:52 ..... 13613 13824 New_Shorter_Oxford_English_Dictionary_fifth_edition\Pronunciation.htm
------------------- ----- ------------ ------------ ------------------------
132720191 132722688 9 files, 1 folders
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>7za.exe l Fyodor_Dostoyevsky_12-books.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Listing archive: Fyodor_Dostoyevsky_12-books.tar
--
Path = Fyodor_Dostoyevsky_12-books.tar
Type = tar
Physical Size = 9569792
Headers Size = 9216
Date Time Attr Size Compressed Name
------------------- ----- ------------ ------------ ------------------------
2015-05-30 01:09:07 ..... 613108 613376 Fyodor_Dostoyevsky_12-books\38241-0_Uncle's_Dream_and_The_Permanent_Husband_by_Fyodor_Dostoyevsky.txt
2015-05-30 01:01:30 ..... 75416 75776 Fyodor_Dostoyevsky_12-books\8578_The_Grand_Inquisitor_by_Fyodor_Dostoyevsky.txt
2015-05-30 01:03:36 ..... 357764 357888 Fyodor_Dostoyevsky_12-books\pg2197_The_Gambler_by_Fyodor_Dostoyevsky.txt
2015-05-30 01:07:38 ..... 316364 316416 Fyodor_Dostoyevsky_12-books\pg2302_Poor_Folk_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:49:08 ..... 1177123 1177600 Fyodor_Dostoyevsky_12-books\pg2554_Crime_and_Punishment_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:51:15 ..... 1396972 1397248 Fyodor_Dostoyevsky_12-books\pg2638_The_Idiot_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:44:48 ..... 1996603 1996800 Fyodor_Dostoyevsky_12-books\pg28054_The_Brothers_Karamazov_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:54:18 ..... 682370 682496 Fyodor_Dostoyevsky_12-books\pg36034_White_Nights_and_Other_Stories_by_Fyodor_Dostoyevsky.txt
2015-05-30 01:05:33 ..... 717666 717824 Fyodor_Dostoyevsky_12-books\pg37536_The_House_of_the_Dead_or_Prison_Life_in_Siberia_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:57:42 ..... 475679 476160 Fyodor_Dostoyevsky_12-books\pg40745_Short_Stories_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:50:14 ..... 265585 265728 Fyodor_Dostoyevsky_12-books\pg600_Notes_from_the_Underground_by_Fyodor_Dostoyevsky.txt
2015-05-30 00:52:56 ..... 1482966 1483264 Fyodor_Dostoyevsky_12-books\pg8117_The_Possessed_(The_Devils)_by_Fyodor_Dostoyevsky.txt
------------------- ----- ------------ ------------ ------------------------
9557616 9560576 12 files, 0 folders
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>7za.exe l Kursk_Hitler_WWII_49-texts.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Listing archive: Kursk_Hitler_WWII_49-texts.tar
--
Path = Kursk_Hitler_WWII_49-texts.tar
Type = tar
Physical Size = 55409152
Headers Size = 35328
Date Time Attr Size Compressed Name
------------------- ----- ------------ ------------ ------------------------
2015-05-18 20:51:26 ..... 687295 687616 Kursk_Hitler_WWII_49-texts\1001_Things_Everyone_Should_Know_About_WWII.epub.txt
2015-05-17 13:37:25 ..... 1597940 1597952 Kursk_Hitler_WWII_49-texts\Adolf_Hitler's_Mein_Kampf.pdf.txt
2015-05-17 17:43:30 ..... 2822033 2822144 Kursk_Hitler_WWII_49-texts\Adolf_Hitler_-_The_Definitive_Biography_-_John_Toland.epub.txt
2015-05-16 23:45:13 ..... 173464 173568 Kursk_Hitler_WWII_49-texts\Albert_Kesselring.pdf.txt
2015-05-16 03:14:33 ..... 659372 659456 Kursk_Hitler_WWII_49-texts\Armor_and_Blood_-_The_Battle_of_Kursk_-_The_Turning_Point_of_World_War_II.epub.txt
2015-05-16 23:59:12 ..... 115947 116224 Kursk_Hitler_WWII_49-texts\Battle_of_Kursk_1943_(Images_of_War)_by_Hans_Seidler.pdf.txt
2015-05-16 03:06:31 ..... 224389 224768 Kursk_Hitler_WWII_49-texts\Battle_Story_-_Kursk_1943.epub.txt
2015-05-17 13:41:17 ..... 673397 673792 Kursk_Hitler_WWII_49-texts\Chris_McNab_-_Hitler's_Armies_[retail].epub.txt
2015-05-16 03:31:48 ..... 579581 579584 Kursk_Hitler_WWII_49-texts\Citadel_-_The_Battle_of_Kursk.epub.txt
2015-05-16 22:12:39 ..... 608789 609280 Kursk_Hitler_WWII_49-texts\Cry_from_the_Deep_-_The_Sinking_of_the_Kursk.epub.txt
2015-05-17 21:45:39 ..... 639134 639488 Kursk_Hitler_WWII_49-texts\Disaster_at_Stalingrad_An_Alternate_History_by_Peter_Tsouras.pdf.txt
2015-05-17 14:02:42 ..... 1720148 1720320 Kursk_Hitler_WWII_49-texts\Enigme_Books_-_Hitlers_Table_Talk_1941-1944.pdf.txt
2015-05-16 22:10:27 ..... 1164923 1165312 Kursk_Hitler_WWII_49-texts\Forgotten_Soldier.epub.txt
2015-05-17 14:10:22 ..... 545641 545792 Kursk_Hitler_WWII_49-texts\Fur_Volk_und_Fuhrer_-_Erwin_Bartmann.pdf.txt
2015-05-16 23:39:08 ..... 917835 918016 Kursk_Hitler_WWII_49-texts\Hitler's_Commanders_-_Officers_of_the_Wehrmacht,_the_Luftwaffe,_the_Kriegsmarine,_and_the_Waffen-SS.epub.txt
2015-05-17 13:49:40 ..... 132806 133120 Kursk_Hitler_WWII_49-texts\Hitler's_Forgotten_Secret_Weapon_by_Leonard_James.epub.txt
2015-05-17 14:15:42 ..... 635687 635904 Kursk_Hitler_WWII_49-texts\Hitler's_Panzer_Armies_on_the_Eastern_Front.epub.txt
2015-05-17 13:43:26 ..... 453882 454144 Kursk_Hitler_WWII_49-texts\Hitler's_War_on_Russia.epub.txt
2015-05-17 13:57:21 ..... 604426 604672 Kursk_Hitler_WWII_49-texts\Hitlers_Panzers_East.pdf.txt
2015-05-18 17:16:57 ..... 925718 926208 Kursk_Hitler_WWII_49-texts\Hunger_and_War_Food_Provisioning_in_the_Soviet_Union_during_World_War_II.epub.txt
2015-05-17 13:59:27 ..... 2679697 2679808 Kursk_Hitler_WWII_49-texts\IAN_KERSHAW_-_Hitler.epub.txt
2015-05-17 14:21:40 ..... 2448828 2448896 Kursk_Hitler_WWII_49-texts\Joachim_Fest_-_Hitler.epub.txt
2015-05-15 13:03:19 ..... 395226 395264 Kursk_Hitler_WWII_49-texts\Kursk-The_Greatest_Tank_Battle.pdf.txt
2015-05-16 02:22:40 ..... 1115176 1115648 Kursk_Hitler_WWII_49-texts\Kursk_-_The_German_View_-_Eyewitness_Reports_of_Operation_Citadel_by_the_German_Commanders.pdf.txt
2015-05-16 03:27:47 ..... 247513 247808 Kursk_Hitler_WWII_49-texts\KURSK_1943_-_The_Northern_Front.pdf.txt
2015-05-15 13:16:17 ..... 346317 346624 Kursk_Hitler_WWII_49-texts\Kursk_Down,_The_Shocking_True_Story_-_Clyde_Burleson.epub.txt
2015-05-16 03:18:27 ..... 428284 428544 Kursk_Hitler_WWII_49-texts\Nikolas_Cornish_Images_of_Kursk_-_History_s_Greatest_Tank_Battle_July_1943.pdf.txt
2015-05-17 13:51:26 ..... 173285 173568 Kursk_Hitler_WWII_49-texts\OCom13_Heinz_Guderian.pdf.txt
2015-05-16 23:54:39 ..... 173627 174080 Kursk_Hitler_WWII_49-texts\OCom15_Walther_Model.pdf.txt
2015-05-16 04:10:55 ..... 356457 356864 Kursk_Hitler_WWII_49-texts\OGM_Ferdinand_and_Elefant.pdf.txt
2015-05-16 23:53:39 ..... 174991 175104 Kursk_Hitler_WWII_49-texts\OСom02_Erich_von_Manstein.pdf.txt
2015-05-17 21:25:43 ..... 1058071 1058304 Kursk_Hitler_WWII_49-texts\PANZER_ACES_-_THE_LEGENDARY_WORLD_WAR_II_BATTLES_OF_SIX_GERMAN_TANK_COMMANDERS.pdf.txt
2015-05-16 23:52:10 ..... 708635 709120 Kursk_Hitler_WWII_49-texts\Panzer_Aces_III.pdf.txt
2015-05-17 17:36:56 ..... 746003 746496 Kursk_Hitler_WWII_49-texts\Panzer_Legions_A_Guide_to_the_German_Army_Tank_Divisions_of_World_War_II.pdf.txt
2015-05-17 14:05:01 ..... 1798825 1799168 Kursk_Hitler_WWII_49-texts\Pinkus,_Oscar_-_The_War_Aims_and_Strategies_of_Adolf_Hitler.pdf.txt
2015-05-17 13:32:26 ..... 542531 542720 Kursk_Hitler_WWII_49-texts\Red_Army_Tank_Commander_At_War_in_a_T-34_on_the_Eastern_Front.pdf.txt
2015-05-18 18:27:11 ..... 594301 594432 Kursk_Hitler_WWII_49-texts\Sledgehammers_-_Strengths_and_Flaws_of_Tiger_Tank_Battalions_in_World_War_II.pdf.txt
2015-05-18 23:59:09 ..... 319258 319488 Kursk_Hitler_WWII_49-texts\The_Bad_War_The_Truth_NEVER_Taught_About_World_War_II.pdf.txt
2015-05-18 18:24:28 ..... 4295800 4296192 Kursk_Hitler_WWII_49-texts\The_Concise_Encyclopedia_of_World_War_II.pdf.txt
2015-05-17 14:07:31 ..... 830006 830464 Kursk_Hitler_WWII_49-texts\The_Devil's_General_The_Life_of_Hyazinth_Strachwitz_-_The_Panzer_Graf.pdf.txt
2015-05-18 09:48:03 ..... 9354532 9354752 Kursk_Hitler_WWII_49-texts\The_Essential_Hitler_-_Speeches_and_Commentary_by_Max_Domarus.pdf.txt
2015-05-18 18:31:25 ..... 718342 718848 Kursk_Hitler_WWII_49-texts\The_history_buff's_guide_to_World_War_II.epub.txt
2015-05-18 09:52:19 ..... 113061 113152 Kursk_Hitler_WWII_49-texts\The_Panther_V_in_Combat_-_Guderian's_Problem_Child.pdf.txt
2015-05-16 23:42:23 ..... 791801 792064 Kursk_Hitler_WWII_49-texts\Tigers_in_the_Mud.pdf.txt
2015-05-16 23:57:20 ..... 391895 392192 Kursk_Hitler_WWII_49-texts\Tigers_of_the_Death's_Head_SS_Totenkopf_Division's_Tiger_Company.pdf.txt
2015-05-19 02:01:38 ..... 960863 961024 Kursk_Hitler_WWII_49-texts\WORLD_WAR_II_-_An_Encyclopedia_of_Quotations.pdf.txt
2015-05-18 20:32:29 ..... 1947534 1947648 Kursk_Hitler_WWII_49-texts\World_War_II_Almanac.pdf.txt
2015-05-19 02:02:33 ..... 2455216 2455552 Kursk_Hitler_WWII_49-texts\World_War_II_at_Sea_-_AN_ENCYCLOPEDIA.pdf.txt
2015-05-18 17:23:26 ..... 3312208 3312640 Kursk_Hitler_WWII_49-texts\_Encyclopedia_of_World_War_II_.pdf.txt
------------------- ----- ------------ ------------ ------------------------
55360690 55373824 49 files, 0 folders
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>7za.exe l Agatha_Christie_89-ebooks_TXT.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Listing archive: Agatha_Christie_89-ebooks_TXT.tar
--
Path = Agatha_Christie_89-ebooks_TXT.tar
Type = tar
Physical Size = 33258496
Headers Size = 94720
Date Time Attr Size Compressed Name
------------------- ----- ------------ ------------ ------------------------
2014-10-11 01:45:46 ..... 391061 391168 Agatha_Christie_89-ebooks_TXT\4. 50 From Paddington (1)\4. 50 From Paddington - Agatha Christie.txt
2014-10-11 01:45:42 ..... 308295 308736 Agatha_Christie_89-ebooks_TXT\A Caribbean Mystery (2)\A Caribbean Mystery - Agatha Christie.txt
2014-10-11 01:56:54 ..... 427609 428032 Agatha_Christie_89-ebooks_TXT\A Murder Is Announced_ A Miss Marple (3)\A Murder Is Announced_ A Miss M - Agatha Christie.txt
2014-10-11 01:56:37 ..... 344754 345088 Agatha_Christie_89-ebooks_TXT\A Pocket Full of Rye_ A Miss Marple (4)\A Pocket Full of Rye_ A Miss Ma - Agatha Christie.txt
2014-10-11 01:56:10 ..... 419217 419328 Agatha_Christie_89-ebooks_TXT\After the Funeral_ A Hercule Poirot (8)\After the Funeral_ A Hercule Po - Agatha Christie.txt
2014-10-11 01:56:15 ..... 332565 332800 Agatha_Christie_89-ebooks_TXT\Agatha Christie's Detectives_ Five C (7)\Agatha Christie's Detectives_ F - Agatha Christie.txt
2014-10-11 01:56:00 ..... 1334050 1334272 Agatha_Christie_89-ebooks_TXT\An Autobiography (9)\An Autobiography - Agatha Christie.txt
2014-10-11 01:55:50 ..... 315599 315904 Agatha_Christie_89-ebooks_TXT\And Then There Were None (10)\And Then There Were None - Agatha Christie.txt
2014-10-11 01:55:20 ..... 322022 322048 Agatha_Christie_89-ebooks_TXT\Appointment with Death (13)\Appointment with Death - Agatha Christie.txt
2014-10-11 01:55:24 ..... 368831 369152 Agatha_Christie_89-ebooks_TXT\At Bertram's Hotel (14)\At Bertram's Hotel - Agatha Christie.txt
2014-10-11 01:55:08 ..... 318144 318464 Agatha_Christie_89-ebooks_TXT\Big Four (15)\Big Four - Agatha Christie.txt
2014-10-11 01:55:07 ..... 251443 251904 Agatha_Christie_89-ebooks_TXT\Black Coffee (16)\Black Coffee - Agatha Christie.txt
2014-10-11 01:54:41 ..... 398847 398848 Agatha_Christie_89-ebooks_TXT\By the Pricking of My Thumbs (19)\By the Pricking of My Thumbs - Agatha Christie.txt
2014-10-11 01:54:39 ..... 334418 334848 Agatha_Christie_89-ebooks_TXT\Cards on the Table (20)\Cards on the Table - Agatha Christie.txt
2014-10-11 01:54:14 ..... 406409 406528 Agatha_Christie_89-ebooks_TXT\Cat Among the Pigeons (23)\Cat Among the Pigeons - Agatha Christie.txt
2014-10-11 01:54:00 ..... 418517 418816 Agatha_Christie_89-ebooks_TXT\Collins They Came to Baghdad (24)\Collins They Came to Baghdad - Agatha Christie.txt
2014-10-11 01:53:26 ..... 326323 326656 Agatha_Christie_89-ebooks_TXT\Crooked House (28)\Crooked House - Agatha Christie.txt
2014-10-11 01:53:23 ..... 326190 326656 Agatha_Christie_89-ebooks_TXT\Curtain (29)\Curtain - Agatha Christie.txt
2014-10-11 01:53:09 ..... 354906 355328 Agatha_Christie_89-ebooks_TXT\Death Comes as the End (30)\Death Comes as the End - Agatha Christie.txt
2014-10-11 01:52:48 ..... 356335 356352 Agatha_Christie_89-ebooks_TXT\Death in the Clouds (32)\Death in the Clouds - Agatha Christie.txt
2014-10-11 01:52:45 ..... 468013 468480 Agatha_Christie_89-ebooks_TXT\Death on the Nile (33)\Death on the Nile - Agatha Christie.txt
2014-10-11 01:52:31 ..... 361173 361472 Agatha_Christie_89-ebooks_TXT\Destination Unknown. Agatha Christie (34)\Destination Unknown. Agatha Chr - Agatha Christie.txt
2014-10-11 01:52:05 ..... 442761 442880 Agatha_Christie_89-ebooks_TXT\Dumb Witness_ Hercule Poirot Investi (39)\Dumb Witness_ Hercule Poirot In - Agatha Christie.txt
2014-10-11 01:51:49 ..... 344293 344576 Agatha_Christie_89-ebooks_TXT\Elephants Can Remember (40)\Elephants Can Remember - Agatha Christie.txt
2014-10-11 01:51:29 ..... 345605 346112 Agatha_Christie_89-ebooks_TXT\Endless Night (43)\Endless Night - Agatha Christie.txt
2014-10-11 01:51:17 ..... 336334 336384 Agatha_Christie_89-ebooks_TXT\Evil Under the Sun (44)\Evil Under the Sun - Agatha Christie.txt
2014-10-11 01:51:07 ..... 350163 350208 Agatha_Christie_89-ebooks_TXT\Five Little Pigs (45)\Five Little Pigs - Agatha Christie.txt
2014-10-11 01:50:32 ..... 387958 388096 Agatha_Christie_89-ebooks_TXT\Halloween Party (48)\Halloween Party - Agatha Christie.txt
2014-10-11 01:51:13 ..... 474596 474624 Agatha_Christie_89-ebooks_TXT\Hercule Poirot's Casebook (49)\Hercule Poirot's Casebook - Agatha Christie.txt
2014-10-11 01:49:38 ..... 358435 358912 Agatha_Christie_89-ebooks_TXT\Hercule Poirot's Christmas (56)\Hercule Poirot's Christmas - Agatha Christie.txt
2014-10-11 01:49:24 ..... 483263 483328 Agatha_Christie_89-ebooks_TXT\Hercule Poirot's Early Cases (57)\Hercule Poirot's Early Cases - Agatha Christie.txt
2014-10-11 01:49:20 ..... 339370 339456 Agatha_Christie_89-ebooks_TXT\Hickory Dickory Dock (58)\Hickory Dickory Dock - Agatha Christie.txt
2014-10-11 01:49:04 ..... 337015 337408 Agatha_Christie_89-ebooks_TXT\Listerdale Mystery (59)\Listerdale Mystery - Agatha Christie.txt
2014-10-11 01:49:15 ..... 374577 374784 Agatha_Christie_89-ebooks_TXT\Lord Edgware Dies (60)\Lord Edgware Dies - Agatha Christie.txt
2014-10-11 01:48:59 ..... 204075 204288 Agatha_Christie_89-ebooks_TXT\Miss Marple's Final Cases (61)\Miss Marple's Final Cases - Agatha Christie.txt
2014-10-11 01:48:54 ..... 533058 533504 Agatha_Christie_89-ebooks_TXT\Miss Marple_ The Complete Short Stor (62)\Miss Marple_ The Complete Short - Agatha Christie.txt
2014-10-11 01:48:28 ..... 358128 358400 Agatha_Christie_89-ebooks_TXT\Mrs McGinty's Dead (67)\Mrs McGinty's Dead - Agatha Christie.txt
2014-10-11 01:48:15 ..... 385684 386048 Agatha_Christie_89-ebooks_TXT\Murder in Mesopotamia (68)\Murder in Mesopotamia - Agatha Christie.txt
2014-10-11 01:47:58 ..... 433248 433664 Agatha_Christie_89-ebooks_TXT\Murder in the Mews (71)\Murder in the Mews - Agatha Christie.txt
2014-10-11 01:47:39 ..... 317694 317952 Agatha_Christie_89-ebooks_TXT\Murder Is Easy (72)\Murder Is Easy - Agatha Christie.txt
2014-10-11 01:47:30 ..... 351634 351744 Agatha_Christie_89-ebooks_TXT\Murder on the Orient Express (73)\Murder on the Orient Express - Agatha Christie.txt
2014-10-11 01:47:17 ..... 332047 332288 Agatha_Christie_89-ebooks_TXT\N or M_ (75)\N or M_ - Agatha Christie.txt
2014-10-11 01:47:07 ..... 437064 437248 Agatha_Christie_89-ebooks_TXT\Nemesis_ A Miss Marple Mystery (76)\Nemesis_ A Miss Marple Mystery - Agatha Christie.txt
2014-10-11 01:47:00 ..... 316925 316928 Agatha_Christie_89-ebooks_TXT\One, Two, Buckle My Shoe (77)\One, Two, Buckle My Shoe - Agatha Christie.txt
2014-10-11 01:46:34 ..... 396721 396800 Agatha_Christie_89-ebooks_TXT\Ordeal by Innocence (82)\Ordeal by Innocence - Agatha Christie.txt
2014-10-11 01:46:30 ..... 369102 369152 Agatha_Christie_89-ebooks_TXT\Pale Horse (83)\Pale Horse - Agatha Christie.txt
2014-10-11 01:46:17 ..... 294634 294912 Agatha_Christie_89-ebooks_TXT\Parker Pyne Investigates (84)\Parker Pyne Investigates - Agatha Christie.txt
2014-10-11 01:46:12 ..... 391379 391680 Agatha_Christie_89-ebooks_TXT\Partners In Crime (85)\Partners In Crime - Agatha Christie.txt
2014-10-11 01:46:10 ..... 393679 393728 Agatha_Christie_89-ebooks_TXT\Passenger to Frankfurt (86)\Passenger to Frankfurt - Agatha Christie.txt
2014-10-11 01:46:03 ..... 310260 310272 Agatha_Christie_89-ebooks_TXT\Peril at End House (87)\Peril at End House - Agatha Christie.txt
2014-10-11 01:45:51 ..... 364455 364544 Agatha_Christie_89-ebooks_TXT\Poirot Investigates (88)\Poirot Investigates - Agatha Christie.txt
2014-10-11 01:56:34 ..... 427791 428032 Agatha_Christie_89-ebooks_TXT\Postern of Fate (5)\Postern of Fate - Agatha Christie.txt
2014-10-11 01:56:17 ..... 284676 285184 Agatha_Christie_89-ebooks_TXT\Problem at Pollensa Bay (6)\Problem at Pollensa Bay - Agatha Christie.txt
2014-10-11 01:55:44 ..... 308894 309248 Agatha_Christie_89-ebooks_TXT\Sad Cypress (11)\Sad Cypress - Agatha Christie.txt
2014-10-11 01:55:38 ..... 433547 433664 Agatha_Christie_89-ebooks_TXT\Secret of Chimneys (12)\Secret of Chimneys - Agatha Christie.txt
2014-10-11 01:54:55 ..... 334788 334848 Agatha_Christie_89-ebooks_TXT\Sleeping Murder (17)\Sleeping Murder - Agatha Christie.txt
2014-10-11 01:54:56 ..... 361950 361984 Agatha_Christie_89-ebooks_TXT\Sparkling Cyanide (18)\Sparkling Cyanide - Agatha Christie.txt
2014-10-11 01:54:26 ..... 265698 265728 Agatha_Christie_89-ebooks_TXT\Spider's Web (21)\Spider's Web - Agatha Christie.txt
2014-10-11 01:54:21 ..... 370280 370688 Agatha_Christie_89-ebooks_TXT\Taken at the Flood_ Hercule Poirot I (22)\Taken at the Flood_ Hercule Poi - Agatha Christie.txt
2014-10-11 01:53:52 ..... 344920 345088 Agatha_Christie_89-ebooks_TXT\The A.B.C. Murders_ A Hercule Poirot (25)\The A.B.C. Murders_ A Hercule P - Agatha Christie.txt
2014-10-11 01:53:33 ..... 401123 401408 Agatha_Christie_89-ebooks_TXT\The Adventure of the Christmas Puddi (26)\The Adventure of the Christmas - Agatha Christie.txt
2014-10-11 01:53:38 ..... 278948 279040 Agatha_Christie_89-ebooks_TXT\The Body in the Library_ A Miss Marp (27)\The Body in the Library_ A Miss - Agatha Christie.txt
2014-10-11 01:53:06 ..... 439988 440320 Agatha_Christie_89-ebooks_TXT\The Clocks (31)\The Clocks - Agatha Christie.txt
2014-10-11 01:52:15 ..... 331696 331776 Agatha_Christie_89-ebooks_TXT\The Harlequin Tea Set and Other Stor (35)\The Harlequin Tea Set and Other - Agatha Christie.txt
2014-10-11 01:52:22 ..... 423685 423936 Agatha_Christie_89-ebooks_TXT\The Hollow (36)\The Hollow - Agatha Christie.txt
2014-10-11 01:52:09 ..... 370212 370688 Agatha_Christie_89-ebooks_TXT\The Hound of Death (37)\The Hound of Death - Agatha Christie.txt
2014-10-11 01:52:02 ..... 487803 487936 Agatha_Christie_89-ebooks_TXT\The Labors of Hercules (38)\The Labors of Hercules - Agatha Christie.txt
2014-10-11 01:51:47 ..... 426267 426496 Agatha_Christie_89-ebooks_TXT\The Man in the Brown Suit (41)\The Man in the Brown Suit - Agatha Christie.txt
2014-10-11 01:51:35 ..... 394521 394752 Agatha_Christie_89-ebooks_TXT\The Mirror Crack'd From Side to Side (42)\The Mirror Crack'd From Side to - Agatha Christie.txt
2014-10-11 01:50:58 ..... 279564 280064 Agatha_Christie_89-ebooks_TXT\The Moving Finger (46)\The Moving Finger - Agatha Christie.txt
2014-10-11 01:50:50 ..... 408251 408576 Agatha_Christie_89-ebooks_TXT\The Murder at the Vicarage (47)\The Murder at the Vicarage - Agatha Christie.txt
2014-10-11 01:50:16 ..... 393672 393728 Agatha_Christie_89-ebooks_TXT\The Murder of Roger Ackroyd (50)\The Murder of Roger Ackroyd - Agatha Christie.txt
2014-10-11 01:50:13 ..... 337750 337920 Agatha_Christie_89-ebooks_TXT\The Murder on the Links (51)\The Murder on the Links - Agatha Christie.txt
2014-10-11 01:50:01 ..... 334846 334848 Agatha_Christie_89-ebooks_TXT\The Mysterious Affair at Styles (52)\The Mysterious Affair at Styles - Agatha Christie.txt
2014-10-11 01:49:54 ..... 455904 456192 Agatha_Christie_89-ebooks_TXT\The Mysterious Mr. Quin (53)\The Mysterious Mr. Quin - Agatha Christie.txt
2014-10-11 01:49:57 ..... 415253 415744 Agatha_Christie_89-ebooks_TXT\The Mystery of the Blue Train_ A Her (54)\The Mystery of the Blue Train_ - Agatha Christie.txt
2014-10-11 01:49:48 ..... 270238 270336 Agatha_Christie_89-ebooks_TXT\The Regatta Mystery and Other Storie (55)\The Regatta Mystery and Other S - Agatha Christie.txt
2014-10-11 01:48:58 ..... 443468 443904 Agatha_Christie_89-ebooks_TXT\The Secret Adversary (63)\The Secret Adversary - Agatha Christie.txt
2014-10-11 01:48:47 ..... 393650 393728 Agatha_Christie_89-ebooks_TXT\The Seven Dials Mystery (64)\The Seven Dials Mystery - Agatha Christie.txt
2014-10-11 01:48:40 ..... 379355 379392 Agatha_Christie_89-ebooks_TXT\The Sittaford Mystery (65)\The Sittaford Mystery - Agatha Christie.txt
2014-10-11 01:48:22 ..... 365539 365568 Agatha_Christie_89-ebooks_TXT\The Thirteen Problems (66)\The Thirteen Problems - Agatha Christie.txt
2014-10-11 01:48:08 ..... 204161 204288 Agatha_Christie_89-ebooks_TXT\The Unexpected Guest (69)\The Unexpected Guest - Agatha Christie.txt
2014-10-11 01:47:56 ..... 294574 294912 Agatha_Christie_89-ebooks_TXT\They Do It With Mirrors (70)\They Do It With Mirrors - Agatha Christie.txt
2014-10-11 01:47:24 ..... 415625 415744 Agatha_Christie_89-ebooks_TXT\Third Girl (74)\Third Girl - Agatha Christie.txt
2014-10-11 01:46:52 ..... 347863 348160 Agatha_Christie_89-ebooks_TXT\Three Act Tragedy_ A Hercule Poirot (78)\Three Act Tragedy_ A Hercule Po - Agatha Christie.txt
2014-10-11 01:46:41 ..... 121005 121344 Agatha_Christie_89-ebooks_TXT\Three Blind Mice (79)\Three Blind Mice - Agatha Christie.txt
2014-10-11 01:46:43 ..... 336032 336384 Agatha_Christie_89-ebooks_TXT\Towards Zero (80)\Towards Zero - Agatha Christie.txt
2014-10-11 01:46:37 ..... 250586 250880 Agatha_Christie_89-ebooks_TXT\While the Light Lasts (81)\While the Light Lasts - Agatha Christie.txt
2014-10-11 01:45:54 ..... 359995 360448 Agatha_Christie_89-ebooks_TXT\Why Didn't They Ask Evans_ (89)\Why Didn't They Ask Evans_ - Agatha Christie.txt
------------------- ----- ------------ ------------ ------------------------
33142996 33163776 89 files, 0 folders
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>
The showdown is downloadable at:
http://www.codeproject.com/Articles/878593/Slowest-LZSS-Compressor-in-C#_comments
https://mega.co.nz/#!whgQSCZA!qNWY1DOTPjLgwnfF-yG09iCh9Rgel-OXQSO4zjZrMXA
It contains:
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\testlexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>dir
06/03/2015 06:30 AM 587,776 7za.exe
06/03/2015 06:30 AM 205 7z_TARall.bat
06/03/2015 06:30 AM 10,913,026 Agatha_Christie_89-ebooks_TXT.tar.Nakamichi
06/03/2015 06:30 AM 8,287,744 bsc.exe
06/03/2015 06:30 AM 1,332,624 calgary.tar.Nakamichi
06/03/2015 06:30 AM 617,472 cudart64_42_9.dll
06/03/2015 06:30 AM 18,675,464 Encyclopedia_of_Language_and_Linguistics.txt.Nakamichi
06/03/2015 06:30 AM 35,425,948 enwik8.Nakamichi
06/03/2015 06:30 AM 126,069 Fahrenheit_451_-_Ray_Bradbury.txt.Nakamichi
06/03/2015 06:30 AM 3,508,317 Fyodor_Dostoyevsky_12-books.tar.Nakamichi
06/03/2015 06:30 AM 31,307,973 glibc-2.21.tar.Nakamichi
06/03/2015 06:30 AM 28,825,883 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.Nakamichi
06/03/2015 06:30 AM 19,053,540 Kursk_Hitler_WWII_49-texts.tar.Nakamichi
06/03/2015 06:30 AM 118,272 LZ4.exe
06/03/2015 06:30 AM 339,968 lzturbo.exe
06/03/2015 06:30 AM 11,856 makearchives.bat
06/03/2015 06:30 AM 1,027 MakeEXEs_Nakamichi_Oniyanma_Monsterdragonfly_Lexx.bat
06/03/2015 06:30 AM 1,632 MokujIN 224 prompt.lnk
06/03/2015 06:30 AM 185,344 Nakamichi_Lexx_cover.doc
06/03/2015 06:30 AM 197,123 Nakamichi_Lexx_cover.pdf
06/03/2015 06:30 AM 118,059 Nakamichi_Oniyanma_Monsterdragonfly_Lexx.c
06/03/2015 06:30 AM 120,320 Nakamichi_Oniyanma_Monsterdragonfly_Lexx_GP_64bit.exe
06/03/2015 06:30 AM 120,320 Nakamichi_Oniyanma_Monsterdragonfly_Lexx_YMM_64bit.exe
06/03/2015 06:30 AM 27,311,688 New_Shorter_Oxford_English_Dictionary_fifth_edition.tar.Nakamichi
06/03/2015 06:30 AM 47,370,235 open_watcom_1.9.0-src.tar.Nakamichi
06/03/2015 06:30 AM 54,357,708 OSHO.TXT.Nakamichi
06/03/2015 06:30 AM 6,266,162 pg3200_The_Entire_Project_Gutenberg_Works_of_Mark_Twain_by_Mark_Twain.txt.Nakamichi
06/03/2015 06:30 AM 1,374,342 Sahih_Bukhari.tar.Nakamichi
06/03/2015 06:30 AM 3,632 SPEEDTEST.BAT
06/03/2015 06:30 AM 5,425,740 The_Book_of_The_Thousand_Nights_and_a_Night.txt.Nakamichi
06/03/2015 06:30 AM 44,818 The_Little_Prince_-_Antoine_de_Saint-Exupery.epub.txt.Nakamichi
06/03/2015 06:30 AM 1,524,728 Webster_Bible.tar.Nakamichi
06/03/2015 06:30 AM 1,148,342 www.gnu.org_libc.html.Nakamichi
06/03/2015 06:30 AM 657,920 zpaq64.exe
06/03/2015 06:30 AM 155,648 zstd.exe
D:\_KAZE\Nakamichi_Oniyanma_Monsterdragonfly_Lexx\testlexx\Nakamichi_LzTurbo_Zstd_LZ4_BSC_ZIP_ZPAQ>
Hope someone will run SPEEDTEST.BAT on Haswell or/and Atom Silvermont soon and share the dump here.
modified 3-Jun-15 0:00am.
|
|
|
|
|
Finally some info on latest&last Nakamichi 'Oniyanma/Lexx'.
The benchmark is downloadable at:
http://www.sanmayce.com/Downloads/Oniyanma_vs_Zstd_64-bits_v0.0.1.zip[^]
The results from Oniyanma_vs_Zstd_64-bits_v0.0.1.zip comparison on laptop with Core 2 Q9550s @2.8GHz:
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Testdatafile \ Decompressor | Uncompressed | LZ4 1 thread | Zstd 1 thread | Nakamichi 'Oniyanma' |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| #1 Encyclopedia_of_Language_and_Linguistics.txt | 59,416,161 | 21,118,907; 1033.1 MB/s | 19,435,030; 358.1 MB/s | 18,675,464; 320 MB/s |
| #2 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt | 81,324,663 | 32,656,314; 987.4 MB/s | 27,657,847; 319.3 MB/s | 28,825,883; 256 MB/s |
| #3 enwik8 | 100,000,000 | 42,283,793; 943.9 MB/s | 39,573,323; 325.7 MB/s | 35,425,948; 192 MB/s |
| #4 glibc-2.21.tar | 146,759,168 | 32,362,346; 1364.9 MB/s | 25,428,301; 561.4 MB/s | 31,307,973; 704 MB/s |
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Note:
#1 testdatafile is ASCII TXT
#2 testdatafile is ASCII wordlist
#3 testdatafile is XML
#4 testdatafile is C sources
The Oniyanma_vs_Zstd_64-bits_v0.0.1.zip contains:
D:\WorkTemp\Oniyanma_vs_Zstd_64-bits_v0.0.1>dir
04/27/2015 12:33 AM 1,630,279 BIGGEST DRAGONFLY IN JAPAN.jpg
04/07/2015 07:59 AM 18,675,464 Encyclopedia_of_Language_and_Linguistics.txt.Nakamichi
04/05/2015 02:31 PM 35,425,948 enwik8.Nakamichi
05/04/2015 11:21 AM 31,307,973 glibc-2.21.tar.Nakamichi
04/21/2015 04:23 AM 28,825,883 Google_Books_corpus_All_Nodes_ripped_7,477,257_1gramlist_out_of_3,473,595_English_books.txt.Nakamichi
06/28/2014 08:16 PM 176,580 lz4-master.zip
09/17/2013 01:22 PM 118,272 LZ4.exe
04/27/2015 12:33 AM 1,027 MakeEXEs_Nakamichi_Oniyanma_Monsterdragonfly_Lexx.bat
04/27/2015 12:33 AM 1,632 MokujIN 224 prompt.lnk
04/27/2015 12:33 AM 102,400 Nakamichi_Lexx_cover.doc
04/27/2015 12:33 AM 172,188 Nakamichi_Lexx_cover.pdf
04/27/2015 12:33 AM 118,059 Nakamichi_Oniyanma_Monsterdragonfly_Lexx.c
04/27/2015 12:33 AM 120,320 Nakamichi_Oniyanma_Monsterdragonfly_Lexx_GP_64bit.exe
04/27/2015 12:33 AM 120,320 Nakamichi_Oniyanma_Monsterdragonfly_Lexx_YMM_64bit.exe
05/06/2015 06:15 AM 7,676 Results_Q9550s.txt
05/05/2015 08:55 PM 1,619 RUNME.BAT
05/01/2015 11:26 PM 101,579 zstd-master.zip
01/25/2015 02:48 PM 155,648 zstd.exe
D:\WorkTemp\Oniyanma_vs_Zstd_64-bits_v0.0.1>
What can I say, Zstd is overpromissing, the compression speed is unseenof (after unheardof), as for the compression ratio it is just fine (even beats 'Lexx' sometimes), and the most important (for me) aspect - decompression speed is sweet as well especially considering the low RAM footprint.
As I said, Zstd is not promising but over such!
My finest Nakamichi (Lexx) is kinda from the distant future, it fails to scream, moreover I used compile with branchless main loop which is slower than branchful one, don't care, that's how I want it - I wrote/used code for CPU-RAM subsystem not existing yet. DDR4's huge latency adds to the slowness, again don't care. I know that 'Lexx' will scream one day.
Yann's overview of Zstd is at:
http://fastcompression.blogspot.com/2015/01/zstd-stronger-compression-algorithm.html[^]
|
|
|
|
|
My wish to juxtapose 11 console compressors resulted in MTCS a.k.a. Mini_Textual_Compression_Showdown package, the benchmark is reproducible and downloadable from
www.sanmayce.com/Hayabusa/MTCS_Mini_Textual_Compression_Showdown_Benchmark.7z[^]
Note: C Sources are included in the package, it is 289,810,208 bytes.
The results from MTCS (Mini_Textual_Compression_Showdown) on laptop with Core 2 Q9550s @2.8GHz:
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Testdatafile \ Decompressor | Uncompressed | LZ4 4 threads | LZ4 1 thread | Nakamichi 'Tengu' | Nakamichi 'Loonette-Hoshimi' |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Agatha_Christie_89-ebooks_TXT.tar | 33,258,496 | 13,365,090; 2182.0 MB/s | 13,365,090; 909.2 MB/s | 12,081,163; 704 MB/s | 10,854,012; 320 MB/s |
| enwik8 | 100,000,000 | 42,283,793; 2186.9 MB/s | 42,283,793; 944.3 MB/s | 40,860,927; 576 MB/s | 34,968,896; 256 MB/s |
| Autobiography_411-ebooks_Collection.tar | 273,401,856 | 117,125,927; 2141.2 MB/s | 117,125,927; 902.3 MB/s | 107,237,997; 640 MB/s | 88,867,460; 192 MB/s |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Add-on:
The results from MTCS (Mini_Textual_Compression_Showdown) on Harold's 4770K, standard CPU settings (3.5GHz base, 3.9GHz turbo):
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Testdatafile \ Decompressor | Uncompressed | LZ4 8 threads | LZ4 1 thread | Nakamichi 'Tengu' | Nakamichi 'Loonette-Hoshimi' |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
| Agatha_Christie_89-ebooks_TXT.tar | 33,258,496 | 13,365,090; 7914.0 MB/s | 13,365,090; 2215.0 MB/s | 12,081,163; 1856 MB/s | 10,854,012; 1216 MB/s |
| enwik8 | 100,000,000 | 42,283,793; 9393.6 MB/s | 42,283,793; 2235.5 MB/s | 40,860,927; 1344 MB/s | 34,968,896; 960 MB/s |
| Autobiography_411-ebooks_Collection.tar | 273,401,856 | 117,125,927; 9032.5 MB/s | 117,125,927; 2257.3 MB/s | 107,237,997; 1728 MB/s | 88,867,460; 832 MB/s |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Note: RAM (2x 8GB) 2400MHz DDR3, timings 10-12-12-31.
As expected 'Hoshimi' runs much more smoothly on i7, 4x faster. Those 800+MB/s are ideal for textual decompression on SSD but fail to come near my dream - lightfast decompression when traversing HUGE English corpora.
I compiled both Nakamichies to use XMM which is a bad choice for Core 2 but I don't care, Nakamichi targets newer than newest CPUs.
The latency of RAM is huge factor, in fact a break, with new DDR4 it is scarily increased, pfu.
The full console dump is given below.
D:\MTCS_Mini_Textual_Compression_Showdown>MAKE_archives.bat
D:\MTCS_Mini_Textual_Compression_Showdown>REM Performers:
D:\MTCS_Mini_Textual_Compression_Showdown>REM - LZ4 for Windows 32-bits v1.4, by Yann Collet (Sep 17 2013).
D:\MTCS_Mini_Textual_Compression_Showdown>REM - lzop v1.03, Markus Franz Xaver Johannes Oberhumer, Nov 1st 2010.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - 7-Zip (A) 9.20, Copyright (c) 1999-2010 Igor Pavlov, 2010-11-18.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - bsc, Block Sorting Compressor, Version 3.1.0. Copyright (c) 2009-2012 Ilya Grebnov, 8 July 2012.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - lzturbo 1.2 Copyright (c) 2007-2014 Hamid Buzidi, Aug 11 2014.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - zpaq v6.60 journaling archiver, (C) 2009-2014, Dell Inc. Free under GPL v3. http://mattmahoney.net/zpaq, compiled Dec 19 2014.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - CABARC, Microsoft (R) Cabinet Tool - Version 5.1.2600.0, Copyright (c) Microsoft Corporation.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - lrzip version 0.616 Copyright (C) Con Kolivas 2006-2013. Based on rzip Copyright (C) Andrew Tridgell 1998-2003.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - Nakamichi 'Loonette-Hoshimi', written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim
Dempsey enforced.
D:\MTCS_Mini_Textual_Compression_Showdown>REM - Compress, version: (N)compress 4.2.4.4, compiled: Fri, Aug 23, 2013 11:56:09. Authors: Peter Jannesen, Dave Mack, Spencer W. Thomas, Jim McKie, Steve Da
vies, Ken Turkowski, James A. Woods, Joe Orost.
D:\MTCS_Mini_Textual_Compression_Showdown>lz4 -9 Agatha_Christie_89-ebooks_TXT.tar
Compressed filename will be : Agatha_Christie_89-ebooks_TXT.tar.lz4
Read 31 MB (40.19%)
Compressed 33258496 bytes into 13365137 bytes ==> 40.19%
D:\MTCS_Mini_Textual_Compression_Showdown>lz4 -9 enwik8
Compressed filename will be : enwik8.lz4
Read 95 MB (42.28%)
Compressed 100000000 bytes into 42283904 bytes ==> 42.28%
D:\MTCS_Mini_Textual_Compression_Showdown>lz4 -9 Autobiography_411-ebooks_Collection.tar
Compressed filename will be : Autobiography_411-ebooks_Collection.tar.lz4
Read 260 MB (42.84%)
Compressed 273401856 bytes into 117126206 bytes ==> 42.84%
D:\MTCS_Mini_Textual_Compression_Showdown>lzop -9 Agatha_Christie_89-ebooks_TXT.tar
D:\MTCS_Mini_Textual_Compression_Showdown>lzop -9 enwik8
D:\MTCS_Mini_Textual_Compression_Showdown>lzop -9 Autobiography_411-ebooks_Collection.tar
D:\MTCS_Mini_Textual_Compression_Showdown>7za a -tgzip -mx9 Agatha_Christie_89-ebooks_TXT.tar.zip Agatha_Christie_89-ebooks_TXT.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive Agatha_Christie_89-ebooks_TXT.tar.zip
Compressing Agatha_Christie_89-ebooks_TXT.tar
Everything is Ok
D:\MTCS_Mini_Textual_Compression_Showdown>7za a -tgzip -mx9 enwik8.zip enwik8
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive enwik8.zip
Compressing enwik8
Everything is Ok
D:\MTCS_Mini_Textual_Compression_Showdown>7za a -tgzip -mx9 Autobiography_411-ebooks_Collection.tar.zip Autobiography_411-ebooks_Collection.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive Autobiography_411-ebooks_Collection.tar.zip
Compressing Autobiography_411-ebooks_Collection.tar
Everything is Ok
D:\MTCS_Mini_Textual_Compression_Showdown>7za a -t7z -md=27 Agatha_Christie_89-ebooks_TXT.tar.128MB.7z Agatha_Christie_89-ebooks_TXT.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive Agatha_Christie_89-ebooks_TXT.tar.128MB.7z
Compressing Agatha_Christie_89-ebooks_TXT.tar
Everything is Ok
D:\MTCS_Mini_Textual_Compression_Showdown>7za a -t7z -md=27 enwik8.128MB.7z enwik8
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive enwik8.128MB.7z
Compressing enwik8
Everything is Ok
D:\MTCS_Mini_Textual_Compression_Showdown>7za a -t7z -md=27 Autobiography_411-ebooks_Collection.tar.128MB.7z Autobiography_411-ebooks_Collection.tar
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive Autobiography_411-ebooks_Collection.tar.128MB.7z
Compressing Autobiography_411-ebooks_Collection.tar
Everything is Ok
D:\MTCS_Mini_Textual_Compression_Showdown>bsc e Agatha_Christie_89-ebooks_TXT.tar Agatha_Christie_89-ebooks_TXT.tar.ST6Block256.bsc -b256 -m6 -cp -Tt
This is bsc, Block Sorting Compressor. Version 3.1.0. 8 July 2012.
Copyright (c) 2009-2012 Ilya Grebnov <Ilya.Grebnov@gmail.com>.
Agatha_Christie_89-ebooks_TXT.tar compressed 33258496 into 6780062 in 3.775 seconds.
D:\MTCS_Mini_Textual_Compression_Showdown>bsc e enwik8 enwik8.ST6Block256.bsc -b256 -m6 -cp -Tt
This is bsc, Block Sorting Compressor. Version 3.1.0. 8 July 2012.
Copyright (c) 2009-2012 Ilya Grebnov <Ilya.Grebnov@gmail.com>.
enwik8 compressed 100000000 into 22112692 in 8.986 seconds.
D:\MTCS_Mini_Textual_Compression_Showdown>bsc e Autobiography_411-ebooks_Collection.tar Autobiography_411-ebooks_Collection.tar.ST6Block256.bsc -b256 -m6 -cp -Tt
This is bsc, Block Sorting Compressor. Version 3.1.0. 8 July 2012.
Copyright (c) 2009-2012 Ilya Grebnov <Ilya.Grebnov@gmail.com>.
Autobiography_411-ebooks_Collection.tar compressed 273401856 into 59360768 in 27.332 seconds.
D:\MTCS_Mini_Textual_Compression_Showdown>lzturbo.exe -19 -b256 -p0 Agatha_Christie_89-ebooks_TXT.tar Agatha_Christie_89-ebooks_TXT.tar.256MB.lzturbo12-19.lzt
D:\MTCS_Mini_Textual_Compression_Showdown>lzturbo.exe -19 -b256 -p0 enwik8 enwik8.256MB.lzturbo12-19.lzt
D:\MTCS_Mini_Textual_Compression_Showdown>lzturbo.exe -19 -b256 -p0 Autobiography_411-ebooks_Collection.tar Autobiography_411-ebooks_Collection.tar.256MB.lzturbo12-19.lzt
D:\MTCS_Mini_Textual_Compression_Showdown>lzturbo.exe -39 -b256 -p0 Agatha_Christie_89-ebooks_TXT.tar Agatha_Christie_89-ebooks_TXT.tar.256MB.lzturbo12-39.lzt
D:\MTCS_Mini_Textual_Compression_Showdown>lzturbo.exe -39 -b256 -p0 enwik8 enwik8.256MB.lzturbo12-39.lzt
D:\MTCS_Mini_Textual_Compression_Showdown>lzturbo.exe -39 -b256 -p0 Autobiography_411-ebooks_Collection.tar Autobiography_411-ebooks_Collection.tar.256MB.lzturbo12-39.lzt
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add Agatha_Christie_89-ebooks_TXT.tar.method08 Agatha_Christie_89-ebooks_TXT.tar -method 08 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 08
Appending to Agatha_Christie_89-ebooks_TXT.tar.method08.zpaq at offset 0
Creating Agatha_Christie_89-ebooks_TXT.tar.method08.zpaq version 1 at 2015-03-09 09:27:11
Adding 33.258496 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 1 blocks, 491 fragments.0%)
0 + (33258496 -> 33277021) = 33277021
3.386 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add enwik8.method08 enwik8 -method 08 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 08
Appending to enwik8.method08.zpaq at offset 0
Creating enwik8.method08.zpaq version 1 at 2015-03-09 09:27:14
Adding 100.000000 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 1 blocks, 1457 fragments.00%)
0 + (100000000 -> 100053475) = 100053475
4.867 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add Autobiography_411-ebooks_Collection.tar.method08 Autobiography_411-ebooks_Collection.tar -method 08 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 08
Appending to Autobiography_411-ebooks_Collection.tar.method08.zpaq at offset 0
Creating Autobiography_411-ebooks_Collection.tar.method08.zpaq version 1 at 2015-03-09 09:27:19
Adding 273.401856 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 2 blocks, 3930 fragments.00%)
0 + (273401856 -> 273310401) = 273310401
14.274 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add Agatha_Christie_89-ebooks_TXT.tar.method28 Agatha_Christie_89-ebooks_TXT.tar -method 28 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 28
Appending to Agatha_Christie_89-ebooks_TXT.tar.method28.zpaq at offset 0
Creating Agatha_Christie_89-ebooks_TXT.tar.method28.zpaq version 1 at 2015-03-09 09:27:34
Adding 33.258496 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 1 blocks, 491 fragments.%)
0 + (33258496 -> 9557649) = 9557649
15.132 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add enwik8.method28 enwik8 -method 28 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 28
Appending to enwik8.method28.zpaq at offset 0
Creating enwik8.method28.zpaq version 1 at 2015-03-09 09:27:49
Adding 100.000000 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 1 blocks, 1457 fragments.0%)
0 + (100000000 -> 30088258) = 30088258
52.760 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add Autobiography_411-ebooks_Collection.tar.method28 Autobiography_411-ebooks_Collection.tar -method 28 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 28
Appending to Autobiography_411-ebooks_Collection.tar.method28.zpaq at offset 0
Creating Autobiography_411-ebooks_Collection.tar.method28.zpaq version 1 at 2015-03-09 09:28:42
Adding 273.401856 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 2 blocks, 3930 fragments.0%)
0 + (273401856 -> 83888119) = 83888119
156.204 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add Agatha_Christie_89-ebooks_TXT.tar.method58 Agatha_Christie_89-ebooks_TXT.tar -method 58 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 58
Appending to Agatha_Christie_89-ebooks_TXT.tar.method58.zpaq at offset 0
Creating Agatha_Christie_89-ebooks_TXT.tar.method58.zpaq version 1 at 2015-03-09 09:31:18
Adding 33.258496 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 1 blocks, 491 fragments.%)
0 + (33258496 -> 6036509) = 6036509
155.112 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add enwik8.method58 enwik8 -method 58 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 58
Appending to enwik8.method58.zpaq at offset 0
Creating enwik8.method58.zpaq version 1 at 2015-03-09 09:33:53
Adding 100.000000 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 1 blocks, 1457 fragments.0%)
0 + (100000000 -> 19084598) = 19084598
479.282 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>zpaq64.exe add Autobiography_411-ebooks_Collection.tar.method58 Autobiography_411-ebooks_Collection.tar -method 58 -threads 1
zpaq v6.60 journaling archiver, compiled Dec 19 2014
Compressing with -method 58
Appending to Autobiography_411-ebooks_Collection.tar.method58.zpaq at offset 0
Creating Autobiography_411-ebooks_Collection.tar.method58.zpaq version 1 at 2015-03-09 09:41:52
Adding 273.401856 MB in 1 files using 1 jobs in 1 threads.
Updating with 1 files, 2 blocks, 3930 fragments.0%)
0 + (273401856 -> 53597471) = 53597471
1318.723 seconds (all OK)
D:\MTCS_Mini_Textual_Compression_Showdown>cabarc.exe -m LZX:21 N Agatha_Christie_89-ebooks_TXT.tar.LZX21.cab Agatha_Christie_89-ebooks_TXT.tar
Microsoft (R) Cabinet Tool - Version 5.1.2600.0
Copyright (c) Microsoft Corporation. All rights reserved..
Creating new cabinet 'Agatha_Christie_89-ebooks_TXT.tar.LZX21.cab' with compression 'LZX:21':
-- adding Agatha_Christie_89-ebooks_TXT.tar
Completed successfully
D:\MTCS_Mini_Textual_Compression_Showdown>cabarc.exe -m LZX:21 N enwik8.LZX21.cab enwik8
Microsoft (R) Cabinet Tool - Version 5.1.2600.0
Copyright (c) Microsoft Corporation. All rights reserved..
Creating new cabinet 'enwik8.LZX21.cab' with compression 'LZX:21':
-- adding enwik8
Completed successfully
D:\MTCS_Mini_Textual_Compression_Showdown>cabarc.exe -m LZX:21 N Autobiography_411-ebooks_Collection.tar.LZX21.cab Autobiography_411-ebooks_Collection.tar
Microsoft (R) Cabinet Tool - Version 5.1.2600.0
Copyright (c) Microsoft Corporation. All rights reserved..
Creating new cabinet 'Autobiography_411-ebooks_Collection.tar.LZX21.cab' with compression 'LZX:21':
-- adding Autobiography_411-ebooks_Collection.tar
Completed successfully
D:\MTCS_Mini_Textual_Compression_Showdown>cabarc.exe -m MSZIP N Agatha_Christie_89-ebooks_TXT.tar.MSZIP.cab Agatha_Christie_89-ebooks_TXT.tar
Microsoft (R) Cabinet Tool - Version 5.1.2600.0
Copyright (c) Microsoft Corporation. All rights reserved..
Creating new cabinet 'Agatha_Christie_89-ebooks_TXT.tar.MSZIP.cab' with compression 'MSZIP':
-- adding Agatha_Christie_89-ebooks_TXT.tar
Completed successfully
D:\MTCS_Mini_Textual_Compression_Showdown>cabarc.exe -m MSZIP N enwik8.MSZIP.cab enwik8
Microsoft (R) Cabinet Tool - Version 5.1.2600.0
Copyright (c) Microsoft Corporation. All rights reserved..
Creating new cabinet 'enwik8.MSZIP.cab' with compression 'MSZIP':
-- adding enwik8
Completed successfully
D:\MTCS_Mini_Textual_Compression_Showdown>cabarc.exe -m MSZIP N Autobiography_411-ebooks_Collection.tar.MSZIP.cab Autobiography_411-ebooks_Collection.tar
Microsoft (R) Cabinet Tool - Version 5.1.2600.0
Copyright (c) Microsoft Corporation. All rights reserved..
Creating new cabinet 'Autobiography_411-ebooks_Collection.tar.MSZIP.cab' with compression 'MSZIP':
-- adding Autobiography_411-ebooks_Collection.tar
Completed successfully
D:\MTCS_Mini_Textual_Compression_Showdown>lrzip.exe -b -L 9 -w 256 Agatha_Christie_89-ebooks_TXT.tar
Output filename is: Agatha_Christie_89-ebooks_TXT.tar.lrz
Agatha_Christie_89-ebooks_TXT.tar - Compression Ratio: 4.065. Average Compression Speed: 4.429MB/s.
Total time: 00:00:07.05
D:\MTCS_Mini_Textual_Compression_Showdown>lrzip.exe -b -L 9 -w 256 enwik8
Output filename is: enwik8.lrz
enwik8 - Compression Ratio: 3.477. Average Compression Speed: 4.524MB/s.
Total time: 00:00:20.60
D:\MTCS_Mini_Textual_Compression_Showdown>lrzip.exe -b -L 9 -w 256 Autobiography_411-ebooks_Collection.tar
Output filename is: Autobiography_411-ebooks_Collection.tar.lrz
Autobiography_411-ebooks_Collection.tar - Compression Ratio: 3.659. Average Compression Speed: 5.909MB/s.
Total time: 00:00:44.12
D:\MTCS_Mini_Textual_Compression_Showdown>rem Nakamichi_Loonette_Hoshimi_XMM_PREFETCH_4096.exe Agatha_Christie_89-ebooks_TXT.tar
D:\MTCS_Mini_Textual_Compression_Showdown>rem Nakamichi_Loonette_Hoshimi_XMM_PREFETCH_4096.exe enwik8
D:\MTCS_Mini_Textual_Compression_Showdown>rem Nakamichi_Loonette_Hoshimi_XMM_PREFETCH_4096.exe Autobiography_411-ebooks_Collection.tar
D:\MTCS_Mini_Textual_Compression_Showdown>compress.exe -c Agatha_Christie_89-ebooks_TXT.tar 1>Agatha_Christie_89-ebooks_TXT.tar.Z
D:\MTCS_Mini_Textual_Compression_Showdown>compress.exe -c enwik8 1>enwik8.Z
D:\MTCS_Mini_Textual_Compression_Showdown>compress.exe -c Autobiography_411-ebooks_Collection.tar 1>Autobiography_411-ebooks_Collection.tar.Z
D:\MTCS_Mini_Textual_Compression_Showdown>dir
03/04/2015 03:57 AM 587,776 7za.exe
03/04/2015 03:57 AM 8,287,744 bsc.exe ! It needs cudart64_42_9.dll !
08/17/2001 01:53 PM 62,976 cabarc.exe
08/23/2013 06:56 PM 22,035 compress.exe ! Taken from Cygwin64, it needs some DLLs !
03/04/2015 03:57 AM 617,472 cudart64_42_9.dll
03/07/2013 04:54 AM 65,043 cygbz2-1.dll ! Taken from C:\cygwin64\bin !
03/03/2015 01:03 AM 70,675 cyggcc_s-seh-1.dll ! Taken from C:\cygwin64\bin !
11/17/2014 01:29 PM 128,531 cyglzo2-2.dll ! Taken from C:\cygwin64\bin !
03/03/2015 01:04 AM 963,091 cygstdc++-6.dll ! Taken from C:\cygwin64\bin !
03/04/2015 01:09 PM 3,265,340 cygwin1.dll ! Taken from C:\cygwin64\bin !
11/20/2014 01:08 AM 81,437 cygz.dll ! Taken from C:\cygwin64\bin !
03/09/2014 08:30 AM 246,803 lrzip.exe ! Taken from Cygwin64, it needs some DLLs !
03/04/2015 03:57 AM 118,272 LZ4.exe
09/15/2013 08:07 PM 305,652 lzop.exe ! Taken from Cygwin64, it needs some DLLs !
03/04/2015 03:57 AM 339,968 lzturbo.exe
03/09/2015 09:31 AM 4,830 MAKE_archives.bat
12/18/2014 05:51 AM 1,632 MokujIN 224 prompt.lnk
03/06/2015 07:06 AM 123,392 Nakamichi_Loonette_Hoshimi_XMM_PREFETCH_4096.exe ! 64bit compile, 256MB Sliding Window !
03/04/2015 03:57 AM 116,224 Nakamichi_Tengu_XMM_PREFETCH_4096.exe ! 64bit compile, 1MB Sliding Window !
12/16/2014 02:34 AM 49,152 sha1sum.exe
03/04/2015 03:57 AM 706,560 zpaq64.exe
...
D:\MTCS_Mini_Textual_Compression_Showdown>dir aga*/o-s
03/09/2015 11:27 AM 33,277,021 Agatha_Christie_89-ebooks_TXT.tar.method08.zpaq
03/09/2015 08:52 AM 33,258,496 Agatha_Christie_89-ebooks_TXT.tar
03/09/2015 08:52 AM 13,587,411 agatha_christie_89-ebooks_txt.tzo ! Bad truncation, should be .lzo !
03/09/2015 09:54 AM 13,365,137 Agatha_Christie_89-ebooks_TXT.tar.lz4
03/09/2015 10:14 AM 13,165,715 Agatha_Christie_89-ebooks_TXT.tar.256MB.lzturbo12-19.lzt ! AFAIK the real window is 64KB !
03/09/2015 12:12 PM 12,899,917 Agatha_Christie_89-ebooks_TXT.tar.Z
03/09/2015 09:16 AM 12,081,163 Agatha_Christie_89-ebooks_TXT.tar.Tengu.Nakamichi
03/09/2015 12:10 PM 11,760,258 Agatha_Christie_89-ebooks_TXT.tar.MSZIP.cab
03/09/2015 09:56 AM 11,173,195 Agatha_Christie_89-ebooks_TXT.tar.zip
02/23/2015 03:03 PM 10,854,012 Agatha_Christie_89-ebooks_TXT.tar.Hoshimi.Nakamichi
03/09/2015 11:27 AM 9,557,649 Agatha_Christie_89-ebooks_TXT.tar.method28.zpaq
03/09/2015 12:04 PM 8,728,588 Agatha_Christie_89-ebooks_TXT.tar.LZX21.cab
03/09/2015 12:11 PM 8,181,075 Agatha_Christie_89-ebooks_TXT.tar.lrz
03/09/2015 11:00 AM 7,955,038 Agatha_Christie_89-ebooks_TXT.tar.256MB.lzturbo12-39.lzt
03/09/2015 10:05 AM 7,888,205 Agatha_Christie_89-ebooks_TXT.tar.128MB.7z
03/09/2015 10:13 AM 6,780,062 Agatha_Christie_89-ebooks_TXT.tar.ST6Block256.bsc ! BOP! Best Overall Performer !
03/09/2015 11:33 AM 6,036,509 Agatha_Christie_89-ebooks_TXT.tar.method58.zpaq
03/09/2015 08:01 AM 77 Agatha_Christie_89-ebooks_TXT.tar.sha1
D:\MTCS_Mini_Textual_Compression_Showdown>dir enw*/o-s
03/09/2015 11:27 AM 100,053,475 enwik8.method08.zpaq
03/09/2015 07:58 AM 100,000,000 enwik8
03/09/2015 12:12 PM 46,264,513 enwik8.Z
03/09/2015 09:54 AM 42,283,904 enwik8.lz4
03/09/2015 10:16 AM 41,924,186 enwik8.256MB.lzturbo12-19.lzt ! AFAIK the real window is 64KB !
03/09/2015 07:58 AM 41,217,688 enwik8.lzo
03/09/2015 11:38 AM 40,860,927 enwik8.Tengu.Nakamichi ! Also, Tengu is faster decompressor than LZO !
03/09/2015 12:10 PM 36,590,004 enwik8.MSZIP.cab
03/09/2015 09:58 AM 35,102,891 enwik8.zip ! GZIP - not that bad !
02/28/2015 08:17 AM 34,968,896 enwik8.Hoshimi.Nakamichi ! Also, Hoshimi is MUCH faster decompressor than GZIP !
03/09/2015 11:28 AM 30,088,258 enwik8.method28.zpaq
03/09/2015 12:11 PM 28,762,314 enwik8.lrz
03/09/2015 12:05 PM 28,464,101 enwik8.LZX21.cab
03/09/2015 11:03 AM 25,330,833 enwik8.256MB.lzturbo12-39.lzt
03/09/2015 10:07 AM 25,010,936 enwik8.128MB.7z
03/09/2015 10:13 AM 22,112,692 enwik8.ST6Block256.bsc ! BOP! Best Overall Performer !
03/09/2015 11:41 AM 19,084,598 enwik8.method58.zpaq
03/09/2015 07:59 AM 50 enwik8.sha1
D:\MTCS_Mini_Textual_Compression_Showdown>dir aut*/o-s
02/12/2015 03:34 AM 273,401,856 Autobiography_411-ebooks_Collection.tar
03/09/2015 11:27 AM 273,310,401 Autobiography_411-ebooks_Collection.tar.method08.zpaq
02/12/2015 03:34 AM 118,194,051 autobiography_411-ebooks_collection.tzo ! Bad truncation, should be .lzo !
03/09/2015 09:54 AM 117,126,206 Autobiography_411-ebooks_Collection.tar.lz4
03/09/2015 10:59 AM 115,563,116 Autobiography_411-ebooks_Collection.tar.256MB.lzturbo12-19.lzt ! AFAIK the real window is 64KB !
03/09/2015 12:12 PM 115,271,495 Autobiography_411-ebooks_Collection.tar.Z
02/19/2015 08:14 PM 107,237,997 Autobiography_411-ebooks_Collection.tar.Tengu.Nakamichi
03/09/2015 12:11 PM 102,640,144 Autobiography_411-ebooks_Collection.tar.MSZIP.cab
03/09/2015 10:05 AM 97,569,046 Autobiography_411-ebooks_Collection.tar.zip ! GZIP - weak and slow !
03/11/2015 06:17 AM 88,867,460 Autobiography_411-ebooks_Collection.tar.Hoshimi.Nakamichi
03/09/2015 11:31 AM 83,888,119 Autobiography_411-ebooks_Collection.tar.method28.zpaq
03/09/2015 12:10 PM 77,219,356 Autobiography_411-ebooks_Collection.tar.LZX21.cab
03/09/2015 12:12 PM 74,712,642 Autobiography_411-ebooks_Collection.tar.lrz
03/09/2015 11:27 AM 69,398,819 Autobiography_411-ebooks_Collection.tar.256MB.lzturbo12-39.lzt
03/09/2015 10:13 AM 69,187,032 Autobiography_411-ebooks_Collection.tar.128MB.7z ! For some reason -md=28 i.e. 256MB was refused by 7z !
03/09/2015 10:13 AM 59,360,768 Autobiography_411-ebooks_Collection.tar.ST6Block256.bsc ! BOP! Best Overall Performer !
03/09/2015 12:03 PM 53,597,471 Autobiography_411-ebooks_Collection.tar.method58.zpaq ! So strong! 273,401,856:53,597,471 = 5.1:1 !
03/09/2015 08:01 AM 83 Autobiography_411-ebooks_Collection.tar.sha1
I am not sure, however in my opinion Nakamichi 'Loonette-Hoshimi' is the fastest decompressor (with ratios 33,258,496:10,854,012 = 3.0:1; 100,000,000:34,968,896 = 2.8:1; 273,401,856:88,867,460 = 3.0:1) among above performers, yes?
www.sanmayce.com/Hayabusa/LoonetteHoshimi_enwik8_19-A4-pages_NO-FIT.pdf[^]
If you know of some superfast textual decompressor not included in above shootout, I will try to add it to the mix.
modified 11-Mar-15 15:11pm.
|
|
|
|
|
More aggressive scenario to maintain 4:1 ratio comes to me.
It puts into the mix yet another Match Length, 16.
Thus next two lines:
srcLOCAL+= 1+(DWORDtrio&0x03); retLOCAL+= 12-(DWORDtrio&0x04);
become:
srcLOCAL+= 1+(DWORDtrio&0x03); retLOCAL+= ((1+(DWORDtrio&0x03))<<2)-(DWORDtrio&0x04);
The priority is again sizewise:
// (8-0):2 = 4
// (12-0):3 = 4
// (16-0):4 = 4
// (16-4):4 = 3
// (12-4):3 = 2.6
// (8-4):2 = 2
It is better that way, I think, should be tortured...
Edit:
I did it and I liked it, quick-test is given below ('Agatha' after few hours):
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>Nakamichi_Loonette_4-8-12-16_XMM_PREFETCH_4096.exe alice29.txt
Nakamichi 'Loonette' (4-8-12-16), written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Compressing 152089 bytes ...
-; Each rotation means 64KB are encoded; Done 100%
NumberOfFullLiterals (lower-the-better): 38
Legend: MatchLengths: 4=Tiny, 8=Short, 12=Medium, 16=Long; WindowSizes: 2/3/4=Short/Medium/Long
NumberOf(Short)Matches[Short]Window (8)[2]: 4875
NumberOf(Medium)Matches[Medium]Window (12)[3]: 1126
NumberOf(Long)Matches[Long]Window (16)[4]: 0
NumberOf(Medium)Matches[Long]Window (12)[4]: 0
NumberOf(Short)Matches[Medium]Window (8)[3]: 4121
NumberOf(Tiny)Matches[Short]Window (4)[2]: 11834
RAM-to-RAM performance: 27300 bytes/s.
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>dir ali*
Volume in drive D is S640_Vol5
Volume Serial Number is 5861-9E6C
Directory of D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16
02/21/2015 07:56 AM 152,089 alice29.txt
02/21/2015 07:57 AM 75,319 alice29.txt.Nakamichi
2 File(s) 227,408 bytes
0 Dir(s) 20,135,559,168 bytes free
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>
Edit:
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>Nakamichi_Loonette_4-8-12-16_XMM_PREFETCH_4096.exe Agatha_Christie_89-ebooks_TXT.tar
Nakamichi 'Loonette' (4-8-12-16), written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Compressing 33258496 bytes ...
\; Each rotation means 64KB are encoded; Done 100%
NumberOfFullLiterals (lower-the-better): 714
Legend: MatchLengths: 4=Tiny, 8=Short, 12=Medium, 16=Long; WindowSizes: 2/3/4=Short/Medium/Long
NumberOf(Short)Matches[Short]Window (8)[2]: 660676
NumberOf(Medium)Matches[Medium]Window (12)[3]: 803087
NumberOf(Long)Matches[Long]Window (16)[4]: 210513
NumberOf(Medium)Matches[Long]Window (12)[4]: 396747
NumberOf(Short)Matches[Medium]Window (8)[3]: 891352
NumberOf(Tiny)Matches[Short]Window (4)[2]: 500730
RAM-to-RAM performance: 1324 bytes/s.
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>dir aga*
02/13/2015 04:16 AM 33,258,496 Agatha_Christie_89-ebooks_TXT.tar
02/21/2015 03:04 PM 11,374,329 Agatha_Christie_89-ebooks_TXT.tar.Nakamichi
02/20/2015 09:04 PM 11,173,343 Agatha_Christie_89-ebooks_TXT.tar.zip
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>Nakamichi_Loonette_4-8-12-16_XMM_PREFETCH_4096.exe Agatha_Christie_89-ebooks_TXT.tar.Nakamichi /test
Nakamichi 'Loonette' (4-8-12-16), written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Decompressing 11374329 bytes ...
RAM-to-RAM performance: 320 MB/s.
Memory pool starting address: 0000000000F60080 ... 64 byte aligned, OK
Copying a 512MB block 1024 times i.e. 512GB READ + 512GB WRITTEN ...
memcpy(): (512MB block); 524288MB copied in 206178 clocks or 2.543MB per clock
RAM-to-RAM performance vs memcpy() ratio (bigger-the-better): 12%
Little stronger and little faster. This is the new Nakamichi 'Loonette' (4-8-12-16) variant.
Edit:
Couldn't resist to throw 'dickens' (being a part of 'SILESIA' testdata corpus) at new 'Loonette':
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>\7za a -tzip -mx9 dickens.zip dickens
7-Zip (A) 9.20 Copyright (c) 1999-2010 Igor Pavlov 2010-11-18
Scanning
Creating archive dickens.zip
Compressing dickens
Everything is Ok
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>Nakamichi_Loonette_4-8-12-16_XMM_PREFETCH_4096.exe dickens
Nakamichi 'Loonette' (4-8-12-16), written by Kaze, based on Nobuo Ito's LZSS source, babealicious suggestion by m^2 enforced, muffinesque suggestion by Jim Dempsey enforced.
Compressing 10192446 bytes ...
\; Each rotation means 64KB are encoded; Done 100%
NumberOfFullLiterals (lower-the-better): 309
Legend: MatchLengths: 4=Tiny, 8=Short, 12=Medium, 16=Long; WindowSizes: 2/3/4=Short/Medium/Long
NumberOf(Short)Matches[Short]Window (8)[2]: 160162
NumberOf(Medium)Matches[Medium]Window (12)[3]: 229401
NumberOf(Long)Matches[Long]Window (16)[4]: 12921
NumberOf(Medium)Matches[Long]Window (12)[4]: 62377
NumberOf(Short)Matches[Medium]Window (8)[3]: 470611
NumberOf(Tiny)Matches[Short]Window (4)[2]: 241283
RAM-to-RAM performance: 2373 bytes/s.
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>dir di*
02/12/2015 03:24 AM 10,192,446 dickens
02/21/2015 04:40 PM 3,884,034 dickens.Nakamichi
02/21/2015 03:28 PM 3,681,950 dickens.zip
D:\_KAZE\EBOOKs_for_benching\Nakamichi_Loonette_Intel15\Nakamichi_Loonette_Intel15_4-8-12-16>
|
|
|
|
|