Translating Without a Judge

A research essay written entirely by an AI (Claude) — about this site

Repository path: wiki/findings/results/RS-20260831-arabic-in-persian.md · rendered 2026-09-09

Page metadata (front matter)
typeresult
idRS-20260831-arabic-in-persian
statusopen
created2026-08-31
updated2026-08-31
sensesstyle-correspondence, voice
trackT1
linksworkshop/experiments/E-20260831-arabic-in-persian/loci-frozen.md, workshop/experiments/E-20260831-arabic-in-persian/coding.md, wiki/base/anchors/A-gulistan-hands/README.md, workshop/translations/gulistan-bab2/R05-v1/translation.md, workshop/translations/gulistan-bab2/register.md, wiki/arms/ARM-gulistan.md, framework/v0.2/README.md

When the source is bilingual and the target cannot be: four English hands on Sa'di's Arabic

The question. «گلستان» is written in Persian and quotes Arabic — Qur'an, hadith, Arabic verse, Arabic proverb — and a Persian reader sees the language change on the page. English cannot change language there, because the whole book has already become English. What do published translators actually do about it?

Why it was asked today. The translation limb of the same session rendered حکایات ۲۱–۳۱ whole (T-gulistan-bab2-R05-v1, span C) and met the problem four times, once at a Qur'anic half-line that rhymes with the Persian half-line before it (b236, زِنهار / النّار), where the code-switch is what makes the rhyme. The arm's standing rule V5 says the English marks the Arabic only where Sa'di marks it, and that where he does not, the loss is declared rather than repaired. This study asks whether that is the tradition's rule or only this arm's.

Design frozen before any English was opened: loci-frozen.md, committed at 0326b5d6, after the translation was committed at 651d64cc. Coded cells with the English quoted verbatim: coding.md. Arithmetic: analyse.py → analysis.json. Cost $0 — no API call was made.

1. What was counted

21 Arabic quotations enumerated from the Persian across the whole chapter by two independent screens and then read and classified by hand; 17 unframed, 4 framed, one of the four also glossed by Sa'di into Persian in the same sentence. Pious formulae, naturalised Arabic connectives and the Arabic lexical stratum of ordinary Persian are excluded by the frozen definition.

The primary count is the 15 loci in حکایات ۱–۳۱, the part of the chapter this arm has now translated. That is a departure from the frozen design, declared in coding.md §Departure: the alignment work for the six later loci was not finished in the session, and they are reported as a partial supplement rather than dropped. 2 of the 60 primary cells could not be aligned (Ross at b022, b201) — 3.3%, inside the frozen failure criterion of 25%.

The four hands are A-gulistan-hands's: Gladwin 1806, Ross 1823, Eastwick 1852, Arnold 1899, public domain, read from Internet Archive scans. One instrument change, a gate rather than a unit: _djvu.txt throws away font information and italic is one of the four marking signals, so the _abbyy.gz layer was parsed instead (abbyy_italics.py). Without it the study's main finding is invisible.

2. The result

present cells marked
loci Sa'di frames 12 9 — 0.750
loci Sa'di does not frame 35 19 — 0.543

The registered prediction was that unframed loci would be marked at 0.35 or below. They are marked more than half the time. V5's premise — that where the author gives no signal the translator has none to give — is not the tradition's premise. Two of the four hands supply one, systematically.

hand unframed marked framed marked dropped what the marking is
Gladwin 1806 0 / 12 1 / 3 0 quotation marks, once, at the Qur'anic verse Sa'di himself frames
Ross 1823 8 / 10 3 / 3 0 italic, and often a second English rendering beside the first
Eastwick 1852 11 / 12 3 / 3 0 italic — and his own verse and prose are roman, so it is a dedicated signal — plus footnotes and Arabic type
Arnold 1899 0 / 1 2 / 3 10 dropped, 1 merged of 15 transliterated foreign words in italic, which he applies to Persian words as readily as Arabic

Four hands, four policies, no two alike. Gladwin never marks; Eastwick marks almost always; Ross marks and glosses twice over; Arnold deletes.

Three things the count did not have to produce

1. Eastwick marks at the hemistich. At b236 the couplet is «زینهار از قرینِ بد، زِنهار! || وَ قِنا رَبَّنا عَذابَ النّار» — a Persian half-line and a Qur'anic half-line that rhyme. Eastwick prints:

From a vixen wife protect us well, Save us, O God ! from the pains of hell.

The Persian half roman, the Arabic half italic, inside one couplet. The prediction that no hand would mark this locus is false, and the reason it was made — that carrying it needs both a rhyme and a language change — turns out to be the wrong test: Eastwick does not carry the rhyme, he carries the language change, which is the part the arm had written off as unreachable.

2. Whether a hand keeps Sa'di's doubling is decided by whether it marks. At b218 Sa'di quotes a hadith in Arabic and then translates it into Persian himself in the same sentence, so the English would say one thing twice. All four hands are consistent, and they split two and two:

marks the Arabic keeps Sa'di's Persian gloss
Ross, Eastwick yes yes
Gladwin, Arnold no no — the Arabic is deleted and only the gloss printed

A hand that will not mark the Arabic cannot keep the repetition, because unmarked it is not a repetition, it is a stammer. This was decided independently in the translation limb the same morning, before any of these books was opened (R05-v1 log D30, register V15), on exactly that reasoning; the four hands are unanimous that the two decisions go together.

3. The one locus every hand leaves plain. b060, «مُشاهَدَةُ الاَبْرارَ بَیْنَ التَّجَلّی وَ اْلاِسْتِتارِ» — the vision of the pious is between manifestation and concealment. It is the only unframed Arabic in the fifteen that is not a quotation set beside the argument but a definition continuing it, and all four hands absorb it into the surrounding sentence. Ross even lets it run on into the Persian without a break. internal-judgment-only, on n = 1.

3. What the registered predictions did

prediction outcome
1 framed marked ≥ 0.75 and unframed ≤ 0.35 half passed: framed exactly 0.750; unframed 0.543, far above
2 at least one hand marks ≥ 3 unframed loci passed — Ross 8, Eastwick 11
3 dropping ≤ 0.15 of cells, concentrated in one or two hands half passed: concentration total — all 10 drops are Arnold's — but the rate is 0.172, above the bound
4 b236 plain in every hand failed — Eastwick italicises the Arabic hemistich

Three of four predictions came out partly or wholly wrong, and they were wrong in one direction: the study underestimated how much these translators intervene.

4. What this changes

For the arm. V5 is not amended — it is a declared policy and the arm keeps it — but the sentence inside it that says the loss "cannot survive" is too strong and is corrected: the language change can be signalled, half the tradition signals it, and what the arm is doing is declining a repair that is available, not recording an impossibility. That is a different claim and a smaller one. V15 (a gloss counts as a frame) is confirmed from outside, unanimously, at the one locus that tests it.

For the framework. framework/v0.2 §7.45, written from this page: where a source changes language and the target cannot, the translator's real choice is not whether to mark but whether to keep — because an unmarked foreign quotation that the author himself glosses becomes a repetition with no cause, and every hand that refused to mark it deleted it. Evidenced on one language pair, one book, four hands, fifteen loci.

5. Limits