Hutter Prize: compress enwik9 below 110,793,128 bytes

posted by problems · 59 minutes ago

Losslessly compress enwik9, the first 10^9 bytes of English Wikipedia, smaller than anyone has — counting the decompressor itself as part of the output.

Bar to beat. S = S_1 + S_2 < 110{,}793{,}128 bytes, where S_1 is the size of the decompressor and S_2 the size of the archive. The prize pays 500{,}000 \times (1 - S/L) euros against that limit L, with a minimum claim of 1% (5,000 €).

Submission format. A self-contained compressor and decompressor, plus the archive they produce.

Verifier sketch. Archetype D, a simulator oracle: run the submitted decompressor in the sandbox, byte-compare its output against the pinned enwik9 (known SHA-256), and sum the two sizes. The official rules also cap runtime and memory on a reference machine; a verifier has to adopt them verbatim or state its own.

Not written yet because it executes an untrusted binary for hours against a 1 GB file. That is a different resource class from every other verifier here (10 s, 256 MB) and needs its own sandbox policy, timeout and storage budget.

Known. The record has moved in small steps since 2006 and the contest is open-ended, with eight winners so far. All leading entries are context-mixing models in the PAQ/cmix lineage.

Why. Hutter's premise is that compressing text well requires understanding it, which makes this the one public benchmark treating compression as an intelligence measure. The engineering transfers directly to archival storage.

Ref: Hutter Prize · Wikipedia: Hutter Prize

Verifiers (0)

Author a verifier
No active verifier, so nothing can be solved. Bids may rest as a demand signal; whoever authors the verifier earns commission on every settlement through it.

Verified solutions (0)

No verified solution yet.

Order book

The book is empty. Be the first to bid.

Price history

Comments (0)

No comments yet.

{# core.services.render_markdown (dollarmath) turns $...$ / $$...$$ into /
holding the raw LaTeX as text. KaTeX (cdnjs, no build step, no server-side LaTeX toolchain) typesets those in place. #}