Cubrim-2 · research track

Global Addresser

Cubrim-2 asks a different question than the Cubrim-1 archiver: instead of squeezing bytes locally, can data be transmitted as short references (aiming for a sensible minimum — on the order of tens to a few hundred bytes) into shared, pre-distributed structures — the Valentov Universal Data Matrices? If sender and receiver already hold the same large structure, one can send instructions for selecting and assembling fragments rather than the object itself. This page is the live research log of that track: the hypothesis list and every status below come straight from the research database — nothing here is hardcoded or embellished.

The honest limit, stated first

A fixed short code can distinguish only a finite number of states, while the space of possible files grows exponentially with length — so a short address alone can never uniquely denote every long sequence. An address is meaningful only together with a catalog where the object already exists. And any honest result must charge the full cost: the addresses, the metadata, the residual data — and the shared matrix itself, which is only worth its size when amortized across many files and devices. Cubrim-2 therefore does not promise to “compress any file into 16 bytes”. It maps where global addressing genuinely beats local compression — and records, just as openly, where it structurally cannot.

How much space would ALL possible matrices take

We count in bits. An N-dimensional cube is a visual arrangement of a bit sequence: a 4×4×4 cube is 64 bits laid out in three dimensions. Dimensionality (1D/2D/3D/4D) is a way to arrange the same bits, not a different amount of them. Hence the number of all possible matrices of length B bits is 2^B and depends only on B: a 64-bit 1D string and a 4×4×4 cube share the same 2^64 ≈ 1.8×10^19 states.

B, bits cube example all possible = 2^B store them all (bytes) fits in 20,000×1 TB?
8 2×2×2 2.56×10² 2.56×10² B yes
27 3×3×3 1.34×10⁸ 4.53×10⁸ B yes
51 —(порог/threshold) 2.25×10¹⁵ 1.44×10¹⁶ B yes
64 4×4×4 1.84×10¹⁹ 1.48×10²⁰ B no
125 5×5×5 4.25×10³⁷ 6.65×10³⁸ B no
256 4×4×4×4 (4D) 1.16×10⁷⁷ 3.71×10⁷⁸ B no
1000 10×10×10 1.07×10³⁰¹ 1.34×10³⁰³ B no
4096 8×8×8×8 (4D) 1.04×10¹²³³ 5.35×10¹²³⁵ B no

Capacity yardstick: 20,000 disks of 1 TB = 2×10^16 bytes = 1.6×10^17 bits. The full-enumeration threshold is B = 51 bits: the last length at which all 2^B matrices (with their contents, 2^B×B bits = 1.44×10^16 bytes) still fit; at B = 52 they no longer do (2.93×10^16 bytes). A 4×4×4 cube (64 bits): just the 64-bit addresses of all 2^64 matrices would take 1.48×10^20 bytes ≈ 147.6 EB — four orders of magnitude beyond the yardstick. At B = 256 there are 1.16×10^77 matrices — still slightly fewer than the atoms in the observable universe (~10^80); the “more than atoms” line is crossed at B ≈ 266. Beyond that, super-exponential growth with no physical storage prospect whatsoever.

The honest conclusion: “all possible matrices” cannot be enumerated — 2^B diverges super-exponentially at lengths below a single machine word. So the Addresser stores not all possible blocks but only the ones ACTUALLY ENCOUNTERED (CAS/deduplication): their number is bounded by the volume of real data and obeys the track’s measured laws — 89.9% of blocks in an uncurated matrix occur exactly once (AH-19), and an honest 16–64 bytes per object is achievable only on an exact match against the catalog (AH-05). This is the same fundamental limit as the block above: an address is meaningful only together with a catalog where the object already exists.

On dimensionality: 2^B does not depend on it, but dimensionality changes which bits land in one cube when REAL data is tiled — and therefore how many unique cubes occur in practice. That is measured by a scan (part B of the experiment), not by a formula.

Formulas: number of matrices = 2^B; storing the contents = 2^B × B bits; the ordinal address of one matrix = B bits (2^B states). All numbers are computed with exact integer arithmetic (python), not estimates.

How much space the ACTUALLY encountered matrices need (scan experiment)

A real CROSS-DEVICE corpus of 13.48 GB (a union of three hosts: arcana-devs 9.06 + arcana-www 3.38 + arcana-prod 1.04 GB; the hosts exchanged only cube hashes) was tiled into cubes of B = 4096 bits (512 bytes) in four layouts of the same length: a 1D string of 4096, 2D 64×64, 3D 16×16×16, 4D 8×8×8×8. A layout groups DIFFERENT bits of the file into one cube (strided tiling with a 4096-byte row), so the number of unique cubes on real data differs — even though the number of possible ones (2^4096) is identical.

layout cubes scanned unique % unique cross-host overlap (cubes) store the unique
1D 4096 25 890 520 14 965 607 57.80% 1 847 617 7.14 GiB
2D 64×64 19 368 448 12 077 059 62.35% 1 260 924 5.76 GiB
3D 16×16×16 13 959 168 8 020 728 57.46% 943 354 3.82 GiB
4D 8×8×8×8 10 518 528 5 578 363 53.03% 768 085 2.66 GiB

There is NO saturation: the number of unique cubes grows almost linearly to the very end of the scan (devs-slice curve: 1D 10.9M unique at 7.3 GB → 12.3M at 8.3 GB) — real data at this cube length hardly “runs out”. On the devs slice, 72–82% of unique cubes were seen exactly once — the same measured law as AH-19 (89.9% on CDC chunks): an uncurated matrix is mostly dead weight. Cross-host overlap is real (0.77–1.85M cubes are shared between hosts), and it is what lowers the union corpus unique share to 53–62%.

Disks for the scan itself: 2.7–7.1 GiB of unique matrices per 13.48 GB of cross-device data — a fraction of one 1 TB disk. Extrapolating to the world’s stored data (on the order of 10 ZB = 10^22 bytes; order-of-magnitude per IDC Global DataSphere reports): with the measured 53–62% unique share on the cross-device corpus and NO saturation, the matrices would take ~5.3–6.2 ZB — billions of 1 TB disks, i.e. the same order as the data itself. THE EXTRAPOLATION IS LINEAR AND MARKED AS AN ASSUMPTION: the world corpus differs in composition, and saturation at larger volumes is not excluded — it was simply not observed in the scan.

Conclusions: (1) even storing only the ENCOUNTERED matrices at world scale is the same order as the data itself — the Addresser’s win lives not in a “warehouse of all cubes” but in deduplicating the repeated share (38–47% on the union corpus) and in r≥2 curation (AH-19); (2) the optimal layout by the “fewer unique” criterion is 4D (53.0% unique vs 62.4% for 2D on the union corpus) — multidimensional grouping does gather repeating bits more often, with a moderate margin (~6–9 pp); (3) the comparison is honest with a caveat: layouts need different alignment (2D — 256 KB blocks, 4D — 2 MB), so corpus coverage differs — figures are per each layout’s covered share.

Scripts: probe_matrix_scan.py + matrix_scan_dump.py (strides in the header; the cross-device union exchanges hashes only, MTX-scan-crossdevice-v1); cube hash blake2b-96; saturation curve checkpointed every 500 MB; all figures measured, the extrapolation labeled.

Wave 1 — research complete

Wave-1 deep research is complete: each of the 24 hypotheses carries a real measured verdict (full-cost charged accounting, falsification test executed, script+SHA on the card). GO means the mechanism works and is measured; NO-GO means it is closed by measurement or strict arithmetic. Predicted levers remain predictions and are labeled; the measured numbers live in every card below.

NO-GO · 9 GO · 15
shared context (dictionary / fragments) · 4 identity dedup — reference ≪ payload on exact match · 3 structurally cannot win (boundary) · 4 infrastructure cost accounting · 10 near-match + delta · 3

Generated: 2026-08-29T01:01:32Z · db:addressor_hypotheses

Hypotheses · 24

Page 7 / 12

AH-13 NO-GO W1 · 2026-07-13

Phi-normalized fragment keys (cross-container dedup)

If fragment keys are built from the Cubrim-1 cube normal form (section value multiset + local map) instead of raw bytes, then cross-file dedup hit-rate on 'same payload, different wrapper' classes rises versus raw CDC, because phi normalization abstracts positional shift within a section.

Data class (Z)
same payload / shifted container (tar vs zip-stored)
Address target
n/a
Predicted lever
wins only where the per-fragment permutation cost < the value of the exposed match; presumption AGAINST per CUBR-0032 (intra-file case closed)
Ceiling category
near-match + delta
Mechanism
key invariance to in-section shift; but the permutation is paid in full (Gotcha #7)
Falsification test
charged end-to-end on a shifted-container pair; (match - permutation cost) <= CDC baseline -> NO-GO
Full cost (total_cost)
address: normal-form section key · metadata: local map / per-fragment permutation — paid IN FULL (Gotcha #7) · residual: uncovered · amortized: normal-form index over the matrix.
Probe verdict
NO-GO — empirics on real shifted containers closed the hypothesis with a double blow: (1) exact CDC already recovers 80.61% of cross-container dedup — content-defined boundaries absorb the framing shift, i.e. the shift invariance the phi keys were built for ALREADY belongs to the baseline; (2) phi multiset keys added exactly 0.0% new hits — there turned out to be nothing to pay the permutation for (Gotcha #7). The CUBR-0032 presumption is confirmed for the cross-file case as well.
Measured result (raw research log; descriptors partly in the RU original)
date
2026-07-15
probe
DR-phikeys-v1

corpus

12 реальных каталогов KB, упакованных tar И zip-stored (тот же payload, сдвинутое обрамление), 238.5 МБ

verdict
NO-GO

verdict_note

NO-GO — empirics on real shifted containers closed the hypothesis with a double blow: (1) exact CDC already recovers 80.61% of cross-container dedup — content-defined boundaries absorb the framing shift, i.e. the shift invariance the phi keys were built for ALREADY belongs to the baseline; (2) phi multiset keys added exactly 0.0% new hits — there turned out to be nothing to pay the permutation for (Gotcha #7). The CUBR-0032 presumption is confirmed for the cross-file case as well.

phi_extra_raw_pct
0%
exact_cdc_crosshit_pct
80.61%
phi_extra_net_after_permutation_pct
0%
AH-14 NO-GO W1 · 2026-07-13

(occupancy-hash, histogram-hash) as a composite search key

If the pair of cube-section signatures is used as an LSH-like catalog key for finding SIMILAR sections (not as a data carrier), then near-duplicate recall on versioned data rises at fixed precision versus pure crypto-hash chunking, because these signatures tolerate small local edits.

Data class (Z)
versioned / lightly edited data
Address target
n/a
Predicted lever
recall gain on a multiversion corpus (prediction: >=10 pp to pay off)
Ceiling category
near-match + delta
Mechanism
signature robustness vs crypto-hash brittleness to a single bit
Falsification test
recall/precision vs simhash/CDC on multiversion; gain <10 pp -> NO-GO
Full cost (total_cost)
infra/catalog line item: a second signature per section + LSH buckets in the catalog · gain: recall of near-dup candidates for AH-15.
Probe verdict
NO-GO — on real edits the recall gain of the composite signature (occupancy hash + log-quantized histogram hash) over the exact crypto hash is 0.01 pp against the pre-registered >=10 pp bar. Real edits shift block contents — the histogram and occupancy move with them; fixed-block signatures are as brittle as a crypto hash. The operator's 'repeat-count hash' idea is closed in this form; the live path to near-dup is CDC alignment + delta (AH-15, OPEN). NUANCE (2026-07-16): the signature NO-GO stands; however a LIVE alternative near-dup finder is now measured — chunk-overlap via the CAS catalog (DR-nearmatch-overlap-v1) finds partners for 5.72% of bytes with a 0.198 delta ratio; the search axis is closed only in its signature form.
Measured result (raw research log; descriptors partly in the RU original)
date
2026-07-15
probe
W1-lsh-v1
corpus
1298 реальных пар (old,new) правленых файлов из git-истории KB, 26854 блока 4КиБ
gain_pp
0.01 pp
verdict
NO-GO

verdict_note

NO-GO — on real edits the recall gain of the composite signature (occupancy hash + log-quantized histogram hash) over the exact crypto hash is 0.01 pp against the pre-registered >=10 pp bar. Real edits shift block contents — the histogram and occupancy move with them; fixed-block signatures are as brittle as a crypto hash. The operator's 'repeat-count hash' idea is closed in this form; the live path to near-dup is CDC alignment + delta (AH-15, OPEN). NUANCE (2026-07-16): the signature NO-GO stands; however a LIVE alternative near-dup finder is now measured — chunk-overlap via the CAS catalog (DR-nearmatch-overlap-v1) finds partners for 5.72% of bytes with a 0.198 delta ratio; the search axis is closed only in its signature form.

recall_exact_pct
24.33%

nuance_2026_07_16

NO-GO сигнатур остаётся; но измерен ЖИВОЙ альтернативный поисковик near-dup: chunk-overlap по CAS-каталогу (DR-nearmatch-overlap-v1) находит партнёров у 5.72% байтов с дельтой 0.198 — поисковая ось закрыта только в сигнатурной форме

false_candidate_pct
0.3%
recall_sig_true_pct
24.35%

Page 7 / 12

Where the Addresser cannot beat local compression

Six boundaries are fixed by wave 1 as explicit anti-hypotheses and no-win zones: unique high-entropy data (personal media, encrypted streams — nothing repeats globally); tiny unique files below the inversion point (fixed catalog costs exceed any saving); mathematically generated matrices (an address into an exhaustive or random pool costs at least as much as the content itself); a byte histogram or hash used as the data carrier (order is lost and buying it back costs the file’s entropy); long-tail content fetched roughly once (the first transfer is never repaid); and fragment schemes whose gain collapses into what a shared dictionary already provides. A tiny fixed-size reference per object (tens of bytes) is honestly achievable only on an exact match against a catalog that already stores the object; everywhere else the win criterion is simply that the reference plus all charged costs stay well below the payload it replaces — the reference size is a metric to minimize, not a hard gate.