Clzip is a lossless data compressor with a user interface similar to the one of gzip or bzip2. Clzip decompresses almost as fast as gzip and compresses more than bzip2, which makes it well suited for software distribution and data archiving. Clzip uses the lzip file format; the files produced by clzip are fully compatible with lzip-1.4 or newer, and can be rescued with lziprecover. Clzip is, in fact, a C language implementation of lzip, intended for embedded devices or systems lacking a C++ compiler. The lzip file format is designed for long-term data archiving and provides very safe integrity checking.
Plzip is a massively parallel (multi-threaded), lossless data compressor based on the lzlib compression library, with a user interface similar to the one of lzip, bzip2, or gzip. It can compress/decompress large files on multiprocessor machines much faster than lzip, at the cost of a slightly-reduced compression ratio. (Note that the number of usable threads is limited by file size). Plzip uses the lzip file format, and the files produced by plzip are fully compatible with lzip-1.4 or newer, and can be rescued with lziprecover.
excat is a simple tool that auto-detectd (potentially nested) compressed file formats and decompresses any combination of them using libarchive, thus unifying zcat, bzcat, lzcat, xzcat, etc. in a single (static, if you need it) binary. It may act as a drop-in replacement for any *cat.
lxz aims to create xz-compatible compressed files, utilizing multiple threads and liblzma. It was forked from lbzip2-0.23 and inherited the same internal structure. It supports compression only (basic features), and will lose its raison d'etre as soon as xz itself gets multithreading support.
Lbzip2 is a parallel, SMP-based, bzip2-compatible compression utility, with a commandline resembling that of the original bzip2. It is usable both on its own and as a filter passed to GNU tar with the "--use-compress-program" option. It uses Gnulib, and its building and testing process is managed by the GNU build system. Starting with release 2.0, lbzip2 is independent of libbz2 and features yambi, an independent BWT compression stack with improved speed and robustness.
lzo-java is a Java port of liblzo2, a portable lossless data compression library. It provides block and stream interfaces to the lzo1x, lzo1y, and lzo1z algorithms, and it can handle raw and lzop file formats. The implementation is designed for high performance reading and writing, and simplicity of integration. It is integrated with Hadoop for high performance, and transparent compression is included.
S3QL is a file system that stores all its data online. It supports Amazon S3, Google Storage, and OpenStack and effectively provides you with a hard disk of dynamic, infinite capacity that can be accessed from any computer with Internet access. S3QL provides a standard, full featured Unix file system that is conceptually indistinguishable from any local file system. Additional features include compression, encryption, data de-duplication, immutable trees, and snapshotting, which make it especially suitable for online backup and archiving. The design favors simplicity and elegance over performance and feature-creep. Care has been taken to make the source code as readable and serviceable as possible. Solid error detection, error handling, and extensive automated test cases are provided.
Pipa reads data from stdin and does various things with it: rotates by time interval / output file size; compresses it (gz, bz2, lzo, xz); names the output file with strftime(); splits it intelligently when given info about the file structure (newlines / PCAP); calls a user command on the finished output file; passes it to stdout (like tee); and more.