Compressing packages with bzip2 instead gzip?

Mikael Eriksson mikael.miffe.eriksson at gmail.com
Wed Dec 7 21:02:29 GMT 2005


On Wed, Dec 07, 2005 at 09:46:03PM +0200, Aigars Mahinovs wrote:
> On 12/7/05, Mikael Eriksson <mikael.miffe.eriksson at gmail.com> wrote:
> > I wrote some benchmarking script, please see the attached file.
> > If we recompress all packages from breezy main i386 beginning with a with
> > 7zip we save 8MB on filesize. But some files are smallest as tar.gz.
> 
> 8 Mb out of 44 Mb, which makes 17.8 % less, at the same time
> de(?)compression time seams to have increased 2.36 times. The
> compression is there, but is the time increase worth it?
> 
> Could also do the benchmark with lzop - compressor optimised for
> speed. Also, could you pick another letter - "a" looks to be quite
> poisoned by aspell-* packages that are mostly text.

Added lzop and zip. This is for main/e for breezy i386.
lzop and zip increases the size from 497MB to ~669MB, But they are
really fast.

Attached log
-------------- next part --------------
Name                          deb-size  deb-time  gz-size   gz-time  bz2-size  bz2-time  lzop-size  lzop-time  zip-size  zip-time  7z-size   7z-time
adept                         1514706   0.11      1521218   0.34     1427936   0.83      1980809    0.06       1549773   0.06      861766    0.26
aspell-es                     164154    0.01      163844    0.01     162344    0.07      176272     0.00       166715    0.00      156255    0.07
comerr-dev                    44344     0.01      44472     0.00     44431     0.02      52996      0.00       97806     0.00      38675     0.04
debian-el                     78122     0.01      78922     0.00     70970     0.02      104242     0.00       84703     0.00      67647     0.05
dpkg-dev-el                   55390     0.01      55076     0.00     51217     0.02      70691      0.00       62722     0.00      47825     0.04
e2fslibs                      78610     0.01      77678     0.00     78271     0.03      93789      0.00       133068    0.00      68868     0.05
e2fslibs-dev                  385392    0.02      390354    0.03     326064    0.16      554817     0.01       490677    0.02      245618    0.10
e2fsprogs                     519614    0.03      520622    0.04     424296    0.22      669758     0.02       736255    0.02      350762    0.12
e2tools                       31466     0.01      30372     0.00     30955     0.01      35981      0.00       143598    0.00      27444     0.04
eagle-usb-data                421094    0.02      421213    0.03     296968    0.14      518325     0.01       422316    0.01      222005    0.09
eagle-usb-utils               87180     0.01      75720     0.00     70496     0.02      100808     0.00       110140    0.00      63489     0.05
ecj-bootstrap                 932416    0.03      930224    0.07     933452    0.55      939226     0.03       932444    0.01      928494    0.24
ed                            44766     0.01      43752     0.00     45023     0.02      49318      0.00       72564     0.00      40952     0.04
editres                       34494     0.01      33839     0.00     33875     0.01      41169      0.00       36046     0.00      29093     0.04
edubuntu-artwork              2133164   0.04      2129350   0.16     2143917   1.26      2140535    0.07       2137850   0.02      2130756   0.51
edubuntu-artwork-usplash      14258     0.01      13192     0.00     12992     0.00      18103      0.00       14939     0.00      12012     0.04
edubuntu-desktop              8168      0.01      5869      0.00     6303      0.00      5976       0.00       6855      0.00      5728      0.03
edubuntu-live                 6592      0.01      5869      0.00     6315      0.00      5972       0.00       6795      0.00      5725      0.03
edubuntu-server               6546      0.01      5868      0.00     6292      0.00      5967       0.00       6835      0.00      5726      0.03
efibootmgr                    31364     0.01      30214     0.00     31401     0.01      35766      0.00       32581     0.00      27393     0.04
eject                         34564     0.01      33221     0.00     34358     0.01      39777      0.00       45580     0.00      28366     0.04
elilo                         107096    0.01      104943    0.00     106461    0.04      128140     0.00       112969    0.00      94072     0.06
elinks                        1315878   0.06      1322421   0.10     1176107   0.65      1661263    0.05       1368751   0.04      986678    0.27
emacs21                       1993476   0.10      1996256   0.16     1866407   1.06      2763043    0.08       3551524   0.20      1511753   0.41
emacs21-bin-common            133252    0.01      133885    0.01     112345    0.04      169468     0.00       148949    0.00      92374     0.06
emacs21-common                10981938  0.54      11141669  0.89     9369288   5.31      15878207   0.51       13498898  0.55      8473606   2.19
emacs21-el                    7152376   0.41      7236322   0.55     6045372   3.54      11254557   0.36       7868795   0.38      5460367   1.41
emacsen-common                17298     0.01      16334     0.00     16297     0.00      18700      0.00       24568     0.00      14957     0.04
emacs-goodies-el              584218    0.03      586189    0.04     494740    0.26      865818     0.03       640611    0.02      459824    0.14
enscript                      405202    0.03      440413    0.03     368502    0.18      617441     0.02       550638    0.02      310412    0.12
eog                           490184    0.03      489928    0.03     458760    0.24      582869     0.01       509965    0.01      410061    0.13
eperl                         133380    0.01      130573    0.01     125760    0.05      152219     0.00       146085    0.00      111386    0.06
epiphany-browser              2037708   0.08      2046036   0.16     1921590   1.11      2373685    0.07       2067709   0.05      1664924   0.42
epiphany-browser-dev          155224    0.01      158758    0.01     143688    0.06      191663     0.00       207156    0.00      143131    0.07
epiphany-extensions           233414    0.02      234083    0.02     195859    0.08      303165     0.01       317537    0.01      169963    0.08
epydoc-doc                    389000    0.06      411717    0.03     260893    0.12      671985     0.02       824884    0.04      190006    0.11
esound                        27132     0.01      26420     0.00     26567     0.01      33550      0.00       27738     0.00      23038     0.04
esound-clients                34928     0.01      33322     0.00     34546     0.01      39804      0.00       47208     0.00      29597     0.04
esound-common                 38760     0.01      38555     0.00     38493     0.01      39447      0.00       40717     0.00      37179     0.04
ethtool                       43398     0.01      42511     0.00     43124     0.01      53986      0.00       44433     0.00      36803     0.04
evince                        602460    0.03      601035    0.05     507559    0.26      728244     0.02       820766    0.03      354380    0.12
evms                          62210     0.01      59209     0.00     61631     0.02      65015      0.00       66944     0.00      56261     0.05
evms-cli                      86604     0.01      85661     0.00     85650     0.03      109943     0.00       86596     0.00      73735     0.05
evms-gui                      181194    0.01      180039    0.01     173052    0.08      252298     0.00       181457    0.00      137705    0.07
evms-ncurses                  87996     0.01      87538     0.00     82679     0.03      117462     0.00       88528     0.00      71707     0.05
evolution                     4535134   0.18      4568916   0.35     4176392   2.38      5625420    0.17       5590127   0.19      3780927   0.91
evolution-data-server         997224    0.14      1002165   0.09     831901    0.47      1367350    0.04       1283988   0.05      660439    0.22
evolution-data-server-dev     37986     0.01      37187     0.00     37798     0.01      37461      0.00       39775     0.00      37078     0.04
evolution-dev                 210770    0.03      212174    0.01     177323    0.08      308525     0.01       448916    0.02      171045    0.08
evolution-exchange            329824    0.03      334446    0.02     292725    0.14      455324     0.01       403129    0.01      260400    0.10
evolution-plugins             262122    0.02      265342    0.02     225413    0.10      344711     0.01       324974    0.01      190675    0.08
evolution-webcal              28328     0.01      26610     0.00     26474     0.01      33864      0.00       28987     0.00      23082     0.04
exim4-base                    833594    0.02      816722    0.06     818507    0.47      866897     0.02       843726    0.01      794685    0.21
exim4-config                  246184    0.01      98404     0.00     86853     0.03      117206     0.00       121822    0.00      79307     0.05
exim4-daemon-heavy            416426    0.02      416974    0.03     400089    0.20      531736     0.01       3293607   0.13      361878    0.12
exim4-daemon-light            367500    0.02      365986    0.02     351890    0.18      466294     0.01       2848636   0.11      321392    0.11
exim4-doc-html                855024    0.05      872322    0.06     610907    0.36      1313504    0.04       967338    0.04      567211    0.18
expat                         19918     0.01      18907     0.00     19850     0.01      21379      0.00       20527     0.00      17160     0.04
expect                        270780    0.02      274017    0.02     269921    0.13      320850     0.01       347719    0.00      245602    0.09
expect-dev                    160190    0.01      160195    0.01     158010    0.06      195268     0.00       222188    0.00      141096    0.07
expect-tcl8.3                 270882    0.02      274627    0.02     269951    0.13      320844     0.01       348349    0.00      245762    0.09
exuberant-ctags               100620    0.01      99083     0.00     101403    0.04      117831     0.00       101184    0.00      91407     0.05
libblkid1                     42820     0.01      41594     0.00     44025     0.01      46666      0.00       57228     0.00      39109     0.04
libblkid-dev                  53976     0.01      53957     0.00     50827     0.02      74360      0.00       69565     0.00      41427     0.04
libcamel1.2-6                 530480    0.03      531824    0.04     466931    0.25      691767     0.02       801085    0.03      403929    0.13
libcamel1.2-dev               101632    0.01      101491    0.00     87573     0.03      144640     0.00       209220    0.01      85669     0.06
libcomerr2                    27822     0.01      26520     0.00     27682     0.01      27668      0.00       30865     0.00      26192     0.04
libebook1.2-5                 107696    0.01      106217    0.00     111373    0.05      131689     0.00       177264    0.00      91740     0.06
libebook1.2-dev               59988     0.01      59488     0.00     57008     0.02      73070      0.00       69559     0.00      54536     0.05
libecal1.2-3                  257116    0.02      257461    0.02     261123    0.12      334952     0.01       480390    0.02      206237    0.08
libecal1.2-dev                103394    0.01      106472    0.00     91528     0.03      145970     0.00       145562    0.00      89506     0.06
libedata-book1.2-2            75008     0.01      73193     0.00     77069     0.03      87331      0.00       111864    0.00      65010     0.05
libedata-book1.2-dev          53972     0.01      53436     0.00     51359     0.02      64164      0.00       63381     0.00      49681     0.05
libedata-cal1.2-1             84352     0.01      82885     0.00     86484     0.03      100986     0.00       130892    0.00      71756     0.05
libedata-cal1.2-dev           58394     0.01      57095     0.00     53588     0.02      72005      0.00       69253     0.00      53207     0.05
libedataserver1.2-4           381694    0.02      382748    0.02     356232    0.19      499186     0.01       730732    0.02      316597    0.11
libedataserver1.2-dev         52792     0.01      51464     0.00     51780     0.02      59613      0.00       72967     0.00      48415     0.04
libedataserverui1.2-6         89908     0.01      88747     0.00     90240     0.03      107362     0.00       142298    0.00      78808     0.05
libedataserverui1.2-dev       45828     0.01      44489     0.00     45594     0.01      49029      0.00       60022     0.00      42949     0.04
libeel2-2                     280114    0.02      279841    0.02     283534    0.13      356438     0.01       490782    0.01      234000    0.09
libeel2-data                  71682     0.01      70741     0.00     71257     0.02      71352      0.00       72554     0.00      70541     0.05
libeel2-dev                   112754    0.02      110671    0.00     107529    0.05      136076     0.00       151169    0.00      103225    0.06
libegroupwise1.2-8            87014     0.01      85760     0.00     87451     0.03      102887     0.00       136544    0.00      76394     0.05
libegroupwise1.2-dev          46780     0.01      45424     0.00     46688     0.01      49860      0.00       55662     0.00      43943     0.04
libenchant1c2                 69696     0.01      69651     0.00     64345     0.02      90183      0.00       192900    0.00      52505     0.05
libenchant-dev                56374     0.01      56113     0.00     51093     0.02      77484      0.00       67416     0.00      41113     0.04
libesd0                       17724     0.01      16893     0.00     16375     0.00      22030      0.00       35922     0.00      14062     0.04
libesd0-dev                   22732     0.01      22027     0.00     21700     0.01      29928      0.00       24983     0.00      18888     0.04
libesd-alsa0                  20214     0.01      19210     0.00     18642     0.00      25178      0.00       40612     0.00      15912     0.04
libevms-2.5                   732882    0.04      738857    0.05     599499    0.32      1002348    0.03       923217    0.04      546987    0.17
libevms-dev                   294624    0.02      293296    0.02     240773    0.11      419082     0.01       473473    0.02      213612    0.09
libexchange-storage1.2-0      145964    0.01      145122    0.01     147143    0.06      182139     0.00       255104    0.01      124571    0.06
libexchange-storage1.2-dev    77676     0.01      77023     0.00     72520     0.02      99907      0.00       97287     0.00      68420     0.05
libexpat1                     60794     0.01      60466     0.00     61675     0.02      78456      0.00       167801    0.00      51646     0.05
libexpat1-dev                 127144    0.01      125951    0.01     119612    0.05      167380     0.00       154366    0.00      102022    0.06
libgadu3                      61164     0.01      61082     0.00     61545     0.02      72032      0.00       95320     0.00      54589     0.05
libgadu-dev                   123676    0.01      124660    0.00     112779    0.04      163928     0.00       132455    0.00      105283    0.06
libss2                        33728     0.01      32281     0.00     34066     0.01      35261      0.00       42268     0.00      31055     0.04
libuuid1                      32646     0.01      31277     0.00     32881     0.01      33489      0.00       38305     0.00      30278     0.04
mozilla-thunderbird-enigmail  318264    0.02      321624    0.02     255183    0.13      469161     0.01       327855    0.01      229990    0.09
myspell-eo                    98676     0.01      99439     0.00     98075     0.04      146351     0.00       185282    0.00      81719     0.06
myspell-es                    207276    0.02      209670    0.01     214181    0.09      329445     0.01       401532    0.02      170624    0.08
python2.4-egenix-mxdatetime   103184    0.01      103972    0.00     91245     0.04      144392     0.00       120025    0.00      84075     0.06
python2.4-egenix-mxproxy      29034     0.01      28114     0.00     26580     0.01      36948      0.00       35363     0.00      23113     0.04
python2.4-egenix-mxstack      19676     0.01      18439     0.00     18475     0.01      23805      0.00       24976     0.00      15919     0.04
python2.4-egenix-mxtexttools  64914     0.01      64874     0.00     58853     0.02      85707      0.00       79520     0.00      53207     0.05
python2.4-egenix-mxtools      86194     0.01      86686     0.00     72731     0.03      122801     0.00       103993    0.00      68208     0.05
python2.4-elementtree         28398     0.01      27094     0.00     24589     0.01      36696      0.00       40628     0.00      22908     0.04
python2.4-epydoc              164728    0.02      166463    0.01     137187    0.05      253968     0.00       181821    0.00      136572    0.07
python2.4-eunuchs             10222     0.01      8930      0.00     9117      0.00      12186      0.00       16590     0.00      7252      0.03
python-egenix-mx-base-dev     36600     0.01      36345     0.00     23863     0.01      51961      0.00       51174     0.00      19178     0.04
python-egenix-mxdatetime      6372      0.01      5317      0.00     5544      0.00      6113       0.00       6764      0.00      4838      0.03
python-egenix-mxproxy         6238      0.01      5305      0.00     5525      0.00      6074       0.00       6692      0.00      4834      0.04
python-egenix-mxstack         6044      0.01      5303      0.00     5517      0.00      6072       0.00       6692      0.00      4835      0.03
python-egenix-mxtexttools     6266      0.01      5324      0.00     5538      0.00      6115       0.00       6788      0.00      4837      0.03
python-egenix-mxtools         6170      0.01      5304      0.00     5508      0.00      6075       0.00       6692      0.00      4836      0.03
python-elementtree            7728      0.01      6860      0.00     7267      0.00      7010       0.00       8406      0.00      6586      0.03
python-elementtree-doc        20416     0.01      19185     0.00     17686     0.01      25281      0.00       28472     0.00      16842     0.04
python-epydoc                 7788      0.01      6932      0.00     7098      0.00      7969       0.00       8810      0.00      6402      0.03
python-eunuchs                3500      0.01      2499      0.00     2776      0.00      2934       0.00       4379      0.00      2311      0.03
ss-dev                        39640     0.01      39368     0.00     36054     0.01      57375      0.00       54256     0.00      29106     0.04
uuid-dev                      46474     0.01      45752     0.00     46905     0.02      52903      0.00       75910     0.00      42126     0.04
Name                          deb-size  deb-time  gz-size   gz-time  bz2-size  bz2-time  lzop-size  lzop-time  zip-size  zip-time  7z-size   7z-time
Total                         49789292  3.26      49963009  3.72     44245673  23.72     66979971   1.83       66621587  2.25      39071796  13.69


More information about the ubuntu-devel mailing list