CONNECT WITH US
Tech

Tech

One gigabyte of Wikipedia losslessly compressed to 105.39MB with self-learning AI transformer model

Tom's Hardware logo

Published on

Add as a preferred source on Google
One gigabyte of Wikipedia losslessly compressed to 105.39MB with self-learning AI transformer model

Tufa Labs’ tufazip has compressed 1GB of information from Wikipedia into just 105MB of space, losslessly, without using any hand-built models, according to a research post. The method uses a 163-million-parameter Transformer model as a predictor instead, and similar compression or decompression would take two Nvidia B200 GPUs about a week to manage. It’s the smallest result on the Large Text Compression Benchmark from any entry that uses a neural network as its only predictor.

We shrank 1 GB of Wikipedia to 105.39 MB, losslessly. Introducing tufazip: the best entry on the Large Text Compression Benchmark using a neural network as its sole predictor. Everything above it mixes a transformer with hand-built models.November 19, 2026

Researcher Tommy He built tufazip, and the full package, at 105.39MB after optimization, includes a small, 4.33MB pre-trained starter model — stored at low precision, or quantized, to save space — that’s needed to unpack the file. The full model is a 12-layer Transformer, which means there are 12 stages for each guess to go through. The starter stores just two already-trained stages, copying them back and forth to fill all 12 once the full model spins up in memory; each copy keeps learning on its own.

This doesn’t work like a traditional chatbot or cloud AI but is, rather, a self-contained language model that learns on the fly. Notable here is that this compression is lossless, which means there’s no risk of any data being lost in the process.



Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.