Compressing packages with bzip2 instead gzip?
Mikael Eriksson
mikael.miffe.eriksson at gmail.com
Wed Dec 7 21:02:29 GMT 2005
On Wed, Dec 07, 2005 at 09:46:03PM +0200, Aigars Mahinovs wrote:
> On 12/7/05, Mikael Eriksson <mikael.miffe.eriksson at gmail.com> wrote:
> > I wrote some benchmarking script, please see the attached file.
> > If we recompress all packages from breezy main i386 beginning with a with
> > 7zip we save 8MB on filesize. But some files are smallest as tar.gz.
>
> 8 Mb out of 44 Mb, which makes 17.8 % less, at the same time
> de(?)compression time seams to have increased 2.36 times. The
> compression is there, but is the time increase worth it?
>
> Could also do the benchmark with lzop - compressor optimised for
> speed. Also, could you pick another letter - "a" looks to be quite
> poisoned by aspell-* packages that are mostly text.
Added lzop and zip. This is for main/e for breezy i386.
lzop and zip increases the size from 497MB to ~669MB, But they are
really fast.
Attached log
-------------- next part --------------
Name deb-size deb-time gz-size gz-time bz2-size bz2-time lzop-size lzop-time zip-size zip-time 7z-size 7z-time
adept 1514706 0.11 1521218 0.34 1427936 0.83 1980809 0.06 1549773 0.06 861766 0.26
aspell-es 164154 0.01 163844 0.01 162344 0.07 176272 0.00 166715 0.00 156255 0.07
comerr-dev 44344 0.01 44472 0.00 44431 0.02 52996 0.00 97806 0.00 38675 0.04
debian-el 78122 0.01 78922 0.00 70970 0.02 104242 0.00 84703 0.00 67647 0.05
dpkg-dev-el 55390 0.01 55076 0.00 51217 0.02 70691 0.00 62722 0.00 47825 0.04
e2fslibs 78610 0.01 77678 0.00 78271 0.03 93789 0.00 133068 0.00 68868 0.05
e2fslibs-dev 385392 0.02 390354 0.03 326064 0.16 554817 0.01 490677 0.02 245618 0.10
e2fsprogs 519614 0.03 520622 0.04 424296 0.22 669758 0.02 736255 0.02 350762 0.12
e2tools 31466 0.01 30372 0.00 30955 0.01 35981 0.00 143598 0.00 27444 0.04
eagle-usb-data 421094 0.02 421213 0.03 296968 0.14 518325 0.01 422316 0.01 222005 0.09
eagle-usb-utils 87180 0.01 75720 0.00 70496 0.02 100808 0.00 110140 0.00 63489 0.05
ecj-bootstrap 932416 0.03 930224 0.07 933452 0.55 939226 0.03 932444 0.01 928494 0.24
ed 44766 0.01 43752 0.00 45023 0.02 49318 0.00 72564 0.00 40952 0.04
editres 34494 0.01 33839 0.00 33875 0.01 41169 0.00 36046 0.00 29093 0.04
edubuntu-artwork 2133164 0.04 2129350 0.16 2143917 1.26 2140535 0.07 2137850 0.02 2130756 0.51
edubuntu-artwork-usplash 14258 0.01 13192 0.00 12992 0.00 18103 0.00 14939 0.00 12012 0.04
edubuntu-desktop 8168 0.01 5869 0.00 6303 0.00 5976 0.00 6855 0.00 5728 0.03
edubuntu-live 6592 0.01 5869 0.00 6315 0.00 5972 0.00 6795 0.00 5725 0.03
edubuntu-server 6546 0.01 5868 0.00 6292 0.00 5967 0.00 6835 0.00 5726 0.03
efibootmgr 31364 0.01 30214 0.00 31401 0.01 35766 0.00 32581 0.00 27393 0.04
eject 34564 0.01 33221 0.00 34358 0.01 39777 0.00 45580 0.00 28366 0.04
elilo 107096 0.01 104943 0.00 106461 0.04 128140 0.00 112969 0.00 94072 0.06
elinks 1315878 0.06 1322421 0.10 1176107 0.65 1661263 0.05 1368751 0.04 986678 0.27
emacs21 1993476 0.10 1996256 0.16 1866407 1.06 2763043 0.08 3551524 0.20 1511753 0.41
emacs21-bin-common 133252 0.01 133885 0.01 112345 0.04 169468 0.00 148949 0.00 92374 0.06
emacs21-common 10981938 0.54 11141669 0.89 9369288 5.31 15878207 0.51 13498898 0.55 8473606 2.19
emacs21-el 7152376 0.41 7236322 0.55 6045372 3.54 11254557 0.36 7868795 0.38 5460367 1.41
emacsen-common 17298 0.01 16334 0.00 16297 0.00 18700 0.00 24568 0.00 14957 0.04
emacs-goodies-el 584218 0.03 586189 0.04 494740 0.26 865818 0.03 640611 0.02 459824 0.14
enscript 405202 0.03 440413 0.03 368502 0.18 617441 0.02 550638 0.02 310412 0.12
eog 490184 0.03 489928 0.03 458760 0.24 582869 0.01 509965 0.01 410061 0.13
eperl 133380 0.01 130573 0.01 125760 0.05 152219 0.00 146085 0.00 111386 0.06
epiphany-browser 2037708 0.08 2046036 0.16 1921590 1.11 2373685 0.07 2067709 0.05 1664924 0.42
epiphany-browser-dev 155224 0.01 158758 0.01 143688 0.06 191663 0.00 207156 0.00 143131 0.07
epiphany-extensions 233414 0.02 234083 0.02 195859 0.08 303165 0.01 317537 0.01 169963 0.08
epydoc-doc 389000 0.06 411717 0.03 260893 0.12 671985 0.02 824884 0.04 190006 0.11
esound 27132 0.01 26420 0.00 26567 0.01 33550 0.00 27738 0.00 23038 0.04
esound-clients 34928 0.01 33322 0.00 34546 0.01 39804 0.00 47208 0.00 29597 0.04
esound-common 38760 0.01 38555 0.00 38493 0.01 39447 0.00 40717 0.00 37179 0.04
ethtool 43398 0.01 42511 0.00 43124 0.01 53986 0.00 44433 0.00 36803 0.04
evince 602460 0.03 601035 0.05 507559 0.26 728244 0.02 820766 0.03 354380 0.12
evms 62210 0.01 59209 0.00 61631 0.02 65015 0.00 66944 0.00 56261 0.05
evms-cli 86604 0.01 85661 0.00 85650 0.03 109943 0.00 86596 0.00 73735 0.05
evms-gui 181194 0.01 180039 0.01 173052 0.08 252298 0.00 181457 0.00 137705 0.07
evms-ncurses 87996 0.01 87538 0.00 82679 0.03 117462 0.00 88528 0.00 71707 0.05
evolution 4535134 0.18 4568916 0.35 4176392 2.38 5625420 0.17 5590127 0.19 3780927 0.91
evolution-data-server 997224 0.14 1002165 0.09 831901 0.47 1367350 0.04 1283988 0.05 660439 0.22
evolution-data-server-dev 37986 0.01 37187 0.00 37798 0.01 37461 0.00 39775 0.00 37078 0.04
evolution-dev 210770 0.03 212174 0.01 177323 0.08 308525 0.01 448916 0.02 171045 0.08
evolution-exchange 329824 0.03 334446 0.02 292725 0.14 455324 0.01 403129 0.01 260400 0.10
evolution-plugins 262122 0.02 265342 0.02 225413 0.10 344711 0.01 324974 0.01 190675 0.08
evolution-webcal 28328 0.01 26610 0.00 26474 0.01 33864 0.00 28987 0.00 23082 0.04
exim4-base 833594 0.02 816722 0.06 818507 0.47 866897 0.02 843726 0.01 794685 0.21
exim4-config 246184 0.01 98404 0.00 86853 0.03 117206 0.00 121822 0.00 79307 0.05
exim4-daemon-heavy 416426 0.02 416974 0.03 400089 0.20 531736 0.01 3293607 0.13 361878 0.12
exim4-daemon-light 367500 0.02 365986 0.02 351890 0.18 466294 0.01 2848636 0.11 321392 0.11
exim4-doc-html 855024 0.05 872322 0.06 610907 0.36 1313504 0.04 967338 0.04 567211 0.18
expat 19918 0.01 18907 0.00 19850 0.01 21379 0.00 20527 0.00 17160 0.04
expect 270780 0.02 274017 0.02 269921 0.13 320850 0.01 347719 0.00 245602 0.09
expect-dev 160190 0.01 160195 0.01 158010 0.06 195268 0.00 222188 0.00 141096 0.07
expect-tcl8.3 270882 0.02 274627 0.02 269951 0.13 320844 0.01 348349 0.00 245762 0.09
exuberant-ctags 100620 0.01 99083 0.00 101403 0.04 117831 0.00 101184 0.00 91407 0.05
libblkid1 42820 0.01 41594 0.00 44025 0.01 46666 0.00 57228 0.00 39109 0.04
libblkid-dev 53976 0.01 53957 0.00 50827 0.02 74360 0.00 69565 0.00 41427 0.04
libcamel1.2-6 530480 0.03 531824 0.04 466931 0.25 691767 0.02 801085 0.03 403929 0.13
libcamel1.2-dev 101632 0.01 101491 0.00 87573 0.03 144640 0.00 209220 0.01 85669 0.06
libcomerr2 27822 0.01 26520 0.00 27682 0.01 27668 0.00 30865 0.00 26192 0.04
libebook1.2-5 107696 0.01 106217 0.00 111373 0.05 131689 0.00 177264 0.00 91740 0.06
libebook1.2-dev 59988 0.01 59488 0.00 57008 0.02 73070 0.00 69559 0.00 54536 0.05
libecal1.2-3 257116 0.02 257461 0.02 261123 0.12 334952 0.01 480390 0.02 206237 0.08
libecal1.2-dev 103394 0.01 106472 0.00 91528 0.03 145970 0.00 145562 0.00 89506 0.06
libedata-book1.2-2 75008 0.01 73193 0.00 77069 0.03 87331 0.00 111864 0.00 65010 0.05
libedata-book1.2-dev 53972 0.01 53436 0.00 51359 0.02 64164 0.00 63381 0.00 49681 0.05
libedata-cal1.2-1 84352 0.01 82885 0.00 86484 0.03 100986 0.00 130892 0.00 71756 0.05
libedata-cal1.2-dev 58394 0.01 57095 0.00 53588 0.02 72005 0.00 69253 0.00 53207 0.05
libedataserver1.2-4 381694 0.02 382748 0.02 356232 0.19 499186 0.01 730732 0.02 316597 0.11
libedataserver1.2-dev 52792 0.01 51464 0.00 51780 0.02 59613 0.00 72967 0.00 48415 0.04
libedataserverui1.2-6 89908 0.01 88747 0.00 90240 0.03 107362 0.00 142298 0.00 78808 0.05
libedataserverui1.2-dev 45828 0.01 44489 0.00 45594 0.01 49029 0.00 60022 0.00 42949 0.04
libeel2-2 280114 0.02 279841 0.02 283534 0.13 356438 0.01 490782 0.01 234000 0.09
libeel2-data 71682 0.01 70741 0.00 71257 0.02 71352 0.00 72554 0.00 70541 0.05
libeel2-dev 112754 0.02 110671 0.00 107529 0.05 136076 0.00 151169 0.00 103225 0.06
libegroupwise1.2-8 87014 0.01 85760 0.00 87451 0.03 102887 0.00 136544 0.00 76394 0.05
libegroupwise1.2-dev 46780 0.01 45424 0.00 46688 0.01 49860 0.00 55662 0.00 43943 0.04
libenchant1c2 69696 0.01 69651 0.00 64345 0.02 90183 0.00 192900 0.00 52505 0.05
libenchant-dev 56374 0.01 56113 0.00 51093 0.02 77484 0.00 67416 0.00 41113 0.04
libesd0 17724 0.01 16893 0.00 16375 0.00 22030 0.00 35922 0.00 14062 0.04
libesd0-dev 22732 0.01 22027 0.00 21700 0.01 29928 0.00 24983 0.00 18888 0.04
libesd-alsa0 20214 0.01 19210 0.00 18642 0.00 25178 0.00 40612 0.00 15912 0.04
libevms-2.5 732882 0.04 738857 0.05 599499 0.32 1002348 0.03 923217 0.04 546987 0.17
libevms-dev 294624 0.02 293296 0.02 240773 0.11 419082 0.01 473473 0.02 213612 0.09
libexchange-storage1.2-0 145964 0.01 145122 0.01 147143 0.06 182139 0.00 255104 0.01 124571 0.06
libexchange-storage1.2-dev 77676 0.01 77023 0.00 72520 0.02 99907 0.00 97287 0.00 68420 0.05
libexpat1 60794 0.01 60466 0.00 61675 0.02 78456 0.00 167801 0.00 51646 0.05
libexpat1-dev 127144 0.01 125951 0.01 119612 0.05 167380 0.00 154366 0.00 102022 0.06
libgadu3 61164 0.01 61082 0.00 61545 0.02 72032 0.00 95320 0.00 54589 0.05
libgadu-dev 123676 0.01 124660 0.00 112779 0.04 163928 0.00 132455 0.00 105283 0.06
libss2 33728 0.01 32281 0.00 34066 0.01 35261 0.00 42268 0.00 31055 0.04
libuuid1 32646 0.01 31277 0.00 32881 0.01 33489 0.00 38305 0.00 30278 0.04
mozilla-thunderbird-enigmail 318264 0.02 321624 0.02 255183 0.13 469161 0.01 327855 0.01 229990 0.09
myspell-eo 98676 0.01 99439 0.00 98075 0.04 146351 0.00 185282 0.00 81719 0.06
myspell-es 207276 0.02 209670 0.01 214181 0.09 329445 0.01 401532 0.02 170624 0.08
python2.4-egenix-mxdatetime 103184 0.01 103972 0.00 91245 0.04 144392 0.00 120025 0.00 84075 0.06
python2.4-egenix-mxproxy 29034 0.01 28114 0.00 26580 0.01 36948 0.00 35363 0.00 23113 0.04
python2.4-egenix-mxstack 19676 0.01 18439 0.00 18475 0.01 23805 0.00 24976 0.00 15919 0.04
python2.4-egenix-mxtexttools 64914 0.01 64874 0.00 58853 0.02 85707 0.00 79520 0.00 53207 0.05
python2.4-egenix-mxtools 86194 0.01 86686 0.00 72731 0.03 122801 0.00 103993 0.00 68208 0.05
python2.4-elementtree 28398 0.01 27094 0.00 24589 0.01 36696 0.00 40628 0.00 22908 0.04
python2.4-epydoc 164728 0.02 166463 0.01 137187 0.05 253968 0.00 181821 0.00 136572 0.07
python2.4-eunuchs 10222 0.01 8930 0.00 9117 0.00 12186 0.00 16590 0.00 7252 0.03
python-egenix-mx-base-dev 36600 0.01 36345 0.00 23863 0.01 51961 0.00 51174 0.00 19178 0.04
python-egenix-mxdatetime 6372 0.01 5317 0.00 5544 0.00 6113 0.00 6764 0.00 4838 0.03
python-egenix-mxproxy 6238 0.01 5305 0.00 5525 0.00 6074 0.00 6692 0.00 4834 0.04
python-egenix-mxstack 6044 0.01 5303 0.00 5517 0.00 6072 0.00 6692 0.00 4835 0.03
python-egenix-mxtexttools 6266 0.01 5324 0.00 5538 0.00 6115 0.00 6788 0.00 4837 0.03
python-egenix-mxtools 6170 0.01 5304 0.00 5508 0.00 6075 0.00 6692 0.00 4836 0.03
python-elementtree 7728 0.01 6860 0.00 7267 0.00 7010 0.00 8406 0.00 6586 0.03
python-elementtree-doc 20416 0.01 19185 0.00 17686 0.01 25281 0.00 28472 0.00 16842 0.04
python-epydoc 7788 0.01 6932 0.00 7098 0.00 7969 0.00 8810 0.00 6402 0.03
python-eunuchs 3500 0.01 2499 0.00 2776 0.00 2934 0.00 4379 0.00 2311 0.03
ss-dev 39640 0.01 39368 0.00 36054 0.01 57375 0.00 54256 0.00 29106 0.04
uuid-dev 46474 0.01 45752 0.00 46905 0.02 52903 0.00 75910 0.00 42126 0.04
Name deb-size deb-time gz-size gz-time bz2-size bz2-time lzop-size lzop-time zip-size zip-time 7z-size 7z-time
Total 49789292 3.26 49963009 3.72 44245673 23.72 66979971 1.83 66621587 2.25 39071796 13.69
More information about the ubuntu-devel
mailing list