Canonical plans to enable zstd by default in Ubuntu 18.10

Mar 12, 2018 11:34 GMT  ·  By

Debian and Ubuntu developer Julian Andres Klode reports today that Canonical plans to implement Facebook's zstd compression algorithm by default in future releases of their Ubuntu Linux operating system.

Developed by Yann Collet at Facebook, zstd is an open-source lossless data compression algorithm designed to offer fast real-time compression and decompression speeds, even faster than xz or gzip. Zstd supports up to 19 compression levels, offering a 2.877 compression ratio with up to 430 MB/s compression and 1110 MB/s decompression speeds.

Julian Andres Klode and Balint Reczey report that they managed to increase the speed of a standard Ubuntu 18.04 LTS (Bionic Beaver) 64-bit installation by about 10 percent with a zstd configuration set at max level 19. Even better, the install speed was increased by about 40 percent when the "eatmydata" library designed to disable fsync and related packages was involved.

"In our configuration, we run zstd at level 19. For bionic main amd64, this causes a size increase of about 6%, from roughly 5.6 to 5.9 GB. Installs speed up by about 10%, or, if eatmydata is involved, by up to 40% - user time generally by about 50%," said Julian Andres Klode in a mailing list announcement.

Zstd to be enabled by default in Ubuntu 18.10

Support for Facebook's zstd compression algorithm was implemented in the dpkg and apt command-line package management systems for Debian GNU/Linux and Ubuntu operating systems. Also, Canonical now plans to enable it by default in future Ubuntu releases, starting with Ubuntu 18.10 this fall, even if zstd is reportedly increasing the installation size by about 6 percent.

Zstd support will also be available in the forthcoming Ubuntu 18.04 LTS (Bionic Beaver) operating system, due for release next month on April 26, 2018. The two developers said that their zstd implementations for dpkg and apt are capable of supporting multiple frames, which means that Debian packages will be eventually compressed and decompressed in parallel.