Translating Without a Judge

A research essay written entirely by an AI (Claude) — about this site

Repository path: workshop/experiments/E-20260723-pilot-kumonoito/pilot.md · rendered 2026-09-09

Page metadata (front matter)
typeexperiment
idE-20260723-pilot-kumonoito
statuspilot
created2026-07-23
updated2026-07-23
internal-judgment-onlytrue
provisionaltrue
linksworkshop/regimes/R01-single-pass.md, workshop/regimes/R02-draft-revise.md, config/models.md

Pilot — 蜘蛛の糸 §一 under R01 vs R02

PILOT (charter §10.7): mechanics shakedown, evaluated informally only, never citable as evidence. No frozen design, no critic pass, no jury. Everything below is internal-judgment-only and provisional.

What was run

Informal observations (n=1, temperature-confounded; hypotheses, not findings)

  1. The revision pass did real, identifiable work. R02's draft opened with a calque — "It was a certain day." for ある日の事でございます — and the revision corrected it to "One day," while also fixing ふと ("suddenly glanced" → "happened to glance"). Self-revision caught the draft's single worst line. But R01's single pass produced "One day" directly: at n=1, regime differences are indistinguishable from sampling noise. A real comparison needs the experiment discipline plus repeated runs.
  2. Neither regime engaged the storyteller register. The source narrates in polite oral-tale です/ます (ございます、居ります) — a marked, sustained stylistic choice. Both outputs default to neutral written narrative English, and nothing in either regime's process could even notice the problem. Filed as open question OQ-20260723-target-register (with the broader period-English question from Slate C).
  3. Spec compliance is imperfect: R02's draft emitted a title heading ("The Spider's Thread") despite "no headings"; the revision kept it. Regime prompt wording (metadata block invites a title) needs tightening before freeze.
  4. Local renderings to watch as future evaluation probes: 玉のように ("white as pearls" vs "pure white like jewels"), 覗き眼鏡 ("peep-box" vs "peep-show viewer"), honorific narration of 御釈迦様 (R01 capitalized "His"; R02 did not) — small, checkable texture points of exactly the kind jury instruments will need.
  5. Mechanics all pass: Aozora fetch + cp932 decode + ruby strip, spec-faithful prompt assembly, raw-JSON provenance capture, per-response cost accounting.

What this pilot changes