How these letters are read

A note on the text

Every collection on Paper Lanterns began as a scan of a printed book. A vision language model, a kind of AI that reads page images, read each page and set down the text. Machine checks then compared that reading against the page, and each book carries the result as a reading score out of 100.

This is how a few people can bring whole libraries of letters back into reach. It also means the text is not yet perfect. Error rates are low, far lower than they were even a year ago, but they are never zero. A machine reading is only certain once people have proofread it against the scan, and on most of these books nobody has done that yet.

So read these letters the way you would read a good first draft of a transcription: closely, gratefully, and with the printed page beside you when a word matters. Every letter is shown next to the scan it came from for exactly this reason.

What machines get wrong

None of these happen often, and most pages have none of them. These are the kinds of mistake worth knowing about.

In any book

  • Accents and diacritics dropped or changed, especially in names: Schönbein, Bhagavadgītā, Mme. de Staël.
  • Words in other languages and scripts: Indian languages, Urdu, Persian, Arabic, Greek, Latin, French and German quotations, misread or quietly normalised.
  • Old romanisation turned modern: a 19th-century spelling of a Sanskrit or Persian word rewritten in today’s scholarly form (IAST), or old spellings silently modernised, when the book printed something else.
  • Running heads and page numbers left inside the text where a page ended.
  • Paragraphs split or joined in the wrong place at a page turn, and words hyphenated across a line break joined wrongly.
  • Headings and titles broken, misnumbered or given the wrong level.
  • Punctuation missing or changed, and italics or small capitals lost.
  • Numbers and dates misread: 3 and 8, 1 and 7, l and 1.
  • Tables misaligned or flattened.
  • Footnotes detached from their marks, or a note number read as part of a word.
  • Illustrations, maps and plates that are on the page but not marked in the text.
  • Noise in the front matter: library stamps, catalogue slips and scanning marks read as if they were part of the book.
  • Rarely, hallucination: a word or phrase that is not on the page at all.

In letters especially

  • One letter split in two, or two run together, where the printed book gave little space between them.
  • The date, place or heading attached to the wrong letter, or a dateline misread, including old double dates such as 1/13 January.
  • Sender or recipient wrongly named, particularly where the editor’s heading says only “To his Brother”.
  • Salutations, sign-offs and postscripts run into the body, or a postscript cut away from its letter.
  • The editor’s linking narrative and the letters confused, so commentary reads as if the writer wrote it, or a letter is quoted inside the editor’s text.
  • Letters inside letters: an enclosure or a copied reply taken for a separate letter.

Dates on the site are read from the printed datelines, so a misread dateline can also put a letter in the wrong decade on the Explore pages.

What the reading score means

Machine checks look for the signs of each kind of mistake and take points off for every one they find. The score has five parts:

PartPointsWhat it checks
Words, spelling and accents30Damaged or suspicious text, and names that lose their accents
Letters, headings and page layout25Running heads and page numbers left in the text, and letters whose boundaries are unclear
Footnotes joined to their places20Every note mark has its note, and every note its mark
Every printed page present15No page skipped, no block of text lost between the scan and the edition
Downloads that open cleanly10The EPUB, Markdown and TEI files are valid

A high score means the machine found little to object to. It does not mean a person has read the book. Some mistakes, a misread word that is still a real word, for instance, look perfectly correct to a machine. That is why the score sits beside a second measure on every book: how many pages people have proofread.

A page counts as proofread when a first reader has checked it against the scan. A book is certified only when a second, different reader has checked every page again.

Help put it right

Paper Lanterns is a sister project of Akshara, the open library of Indian books, and this is the reason Akshara is building a community. The machines can carry a book most of the way. The last stretch needs people who care about keeping the written past readable, proofreading pages one at a time against the scans until no slip is left.

If you would like to be one of them, whether you read Urdu, Persian or Sanskrit, know a writer’s letters well, or simply have a careful eye, join Akshara’s community. Every page you check makes these letters a little more trustworthy for everyone who comes after you.