z-of-a Zone of Avoidance

archives historical documents

Thirty-Seven Million Descriptions

A growing catalogue can mean that more records were described, not that more underlying material exists. Archives and documentary editions keep these counts apart because the object being counted changes with the record system.


The diagnostic model
You are seeing
  • A coverage KPI rises after a metadata migration while no new source data arrived
  • Two vendors report radically different record counts for what appears to be the same universe
  • A backtest universe expands because an old filing was split into several rows
  • A downloadable-record total is reported as though it were a count of underlying holdings
  • A historical master table is replaced, leaving no way to reconstruct the prior denominator
The mechanism
Archives separate shelf length, pages, items and descriptions, while documentary scholarship separates an instrument from its editions and copies; both prevent a record total from silently standing in for the objects behind it.
The false friend
A genuine increase in the underlying universe produces the same headline rise, but it also appears in accession, issuance or transaction records independent of the catalogue migration.
The discriminating test
Recompute the headline count after collapsing records to one physical or economic object and then after retaining every described version; a wide gap makes catalogue growth more likely.

On 15 June 1215 King John sealed Magna Carta. Four exemplifications of that charter survive. Four exemplifications of the 1297 confirmation also survive, and between the two sit reissues of 1216, 1217 and 1225.

The usual name makes this sound like one document with a long afterlife. The record does not. The 1215 text was annulled within weeks. The 1297 text went into England’s statute law, and three of its clauses are still in force: the liberty of the Church, the customs of London and other towns, and due process against arbitrary imprisonment.

One name. Five instruments. Eight surviving exemplifications across two versions.

Every one of those is a true count. The error starts when a total arrives without saying what was made countable.

One name, five instruments #

Magna Carta is not a hard case. It is a clean demonstration of something record systems usually hide.

The 1215, 1225 and 1297 texts differ materially in content, and the 1215 charter has no direct legal descendants of its own. Quote it as though it were the operative text and you supply words a court would not recognise as current law. The version number is not a bibliographical courtesy added afterwards. It fixes the object of the claim.

Physical survival is a separate unit again. The British Library, Lincoln Cathedral and Salisbury Cathedral hold the four surviving 1215 exemplifications between them. A catalogue can describe each parchment, its seal, its condition, its digital image and its transcription, which makes the catalogue fuller and leaves the number of surviving originals at four.

The Dead Sea Scrolls show the same split from the other end. The corpus runs to roughly 981 separate manuscripts, mostly leather, ranging from near-complete scrolls to fragments a few centimetres across, and it is catalogued piece by piece. Counting descriptions is genuinely useful there, because the things described are so unlike each other. It is still not a count of manuscripts, or of texts, or of images.

Every archive total picks a unit #

The Vatican Apostolic Archive reports about 85 kilometres of shelving. The US National Archives reports more than 13 billion pages. The Library of Congress reports roughly 173 million items.

Those are not rival estimates of a common substance. Shelf length measures occupied storage. A page count measures surfaces. An item count measures whatever an institution has decided its members are. One bound volume is simultaneously a single item, several hundred pages and a few centimetres of shelf.

The UK National Archives makes the last unit explicit, and the explicitness is the point. Its Discovery catalogue held more than 37 million item descriptions as of October 2024, of which more than 9 million resolve to material available for direct download. The first figure says how many things the catalogue can name. The second says how many of those names lead anywhere.

Neither says the archive acquired 37 million objects.

This is why a catalogue migration can produce a gratifying coverage chart. A volume-level record is split into file-level records. A file gains separate rows for a scan, a transcription and a correction. The previous description is kept as a historical version. The new total is real as a count of records, and it has quietly stopped answering the old question.

The discovery trail is separate #

There is a nearby case that gives the same rising graph an entirely different meaning, which is that more material has actually turned up.

Known surviving Dunlap broadsides of the Declaration of Independence went from 14 in 1949 to 26 today, the most recent identified in the UK’s National Archives in 2009. Those increases are not the result of splitting catalogue rows. Each one is a physical object entering the known-survival record for the first time.

The distinction is not that one number is older or more respectable. It is that the discovery trail exists independently of the description trail. A new broadside is another object in the world. A new catalogue field is another assertion about an object that may have been sitting in a known collection for decades.

Financial data needs the same separation. A single filing is one economic event, several document versions, many line items and an expanding population of vendor records. A history that counts every row is a report about the vendor’s representation. A history that collapses rows without keeping versions destroys the information needed to reconstruct what a backtest actually consumed.

What disappears is the denominator #

Archives hold one advantage a data vendor may not: the accession and custody trail stays inspectable when the catalogue changes underneath it.

The 1297 Magna Carta on display at the National Archives is privately owned by David Rubenstein, who bought it at Sotheby’s in December 2007 and lent it. Ownership, custody, version and description are four records there, and none of them answers for the others.

A financial master table can simply be overwritten. The newer catalogue is better described, more available and larger on every dashboard measure, and the prior denominator has left with the old rows. Nothing downstream can then determine whether the coverage gain was a new issuance, a recovered object, a restatement, or a new way of describing what was already in hand.

Thirty-seven million Discovery descriptions tell a reader how much the catalogue can name.

Four 1215 originals tell a reader what survived. Substitute the first for the second and the chart goes up while the denominator quietly leaves the building.

Questions

Why did coverage jump when no new source data arrived?

A coverage jump can be a change in description rather than a change in holdings. The National Archives (UK) reported more than 37 million Discovery item descriptions in October 2024, while more than 9 million were directly downloadable; those are catalogue records and availability states, not a physical-stock count. Collapsing the new rows to the prior object unit shows whether the universe actually grew.

Why do two vendors count the same universe so differently?

They may be counting different units. The Vatican Apostolic Archive reports approximately 85 kilometres of shelving and 35,000 volumes in a selective catalogue, while NARA reports more than 13 billion pages. A vendor can likewise count issuers, filings, securities, share classes, revisions, or fields. The totals disagree before any data quality question arises because the reported objects differ.

Does splitting an old filing into several rows create more history?

No. It creates more descriptions of the history already present unless the split identifies separately issuable or separately held objects. Magna Carta makes the distinction visible: King John's 1215 charter was reissued in 1216, 1217, 1225 and 1297, making distinct instruments; multiple catalogue rows for one exemplification do not create additional charters. Object identity and version identity must remain separate.

How can catalogue growth be separated from a real expansion of the universe?

The count is run twice: once after records are collapsed to a stable physical or economic object, and once with every described version retained. A large difference indicates catalogue growth. A genuine expansion also leaves an independent trail in accession, issuance, or transaction records. The known Dunlap broadside count rose from 14 in 1949 to 26 after later discoveries, including one in the UK National Archives in 2009.

What has to be saved before a vendor changes its master table?

Each dataset vintage needs an object identifier, a version identifier, a source date, and a description date. Archives preserve the distinction because a holdings figure can otherwise be irrecoverable: the Library of Congress receives roughly 15,000 copyright-deposit items daily and retains an average of 12,000. Without dated source and description records, a later catalogue cannot reconstruct an earlier denominator.

Sources

  1. "A More Perfect Union: The Creation of the U.S. Constitution," National Archives (primary, 2026-08-13)
  2. "Bodleian Library," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  3. "Code of Hammurabi," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  4. "Cotton library," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  5. "David Rubenstein," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  6. "Dead Sea Scrolls," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  7. "Donation of Constantine," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  8. "Dunlap broadside," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  9. "Herculaneum papyri," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  10. "Library of Alexandria," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  11. "Library of Congress," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  12. "Magna Carta," National Archives (featured documents) (primary, 2026-08-13)
  13. "Museum of the Bible," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  14. "National Archives and Records Administration," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  15. "Public Record Office of Ireland," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  16. "Rosetta Stone," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  17. "The National Archives (United Kingdom)," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  18. "Vatican Apostolic Archive," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  19. "Vinland Map," Wikipedia · Wikimedia Foundation (tertiary, 2026-08-13)
  20. Magna Carta 1297, c.9, legislation.gov.uk (primary, 2026-08-13)