Each sample asks the same question: when two careful people judge the same thing, do they reach the same answer? All material is public or invented.
Raters often get one line of guidance. I took such a line, wrote seven responses that split careful raters, and built the guideline, rubric, edge-case map, and calibration examples that give each response exactly one score.
Guideline writing, rubric design, edge-case analysis, rater calibration, multilingual evaluation (German, Swedish)
A test item is only useful if exactly one answer survives close scrutiny. Two sample items, each with an explanation for every answer choice, and the method behind a ten-book series of 330 items.
Assessment design, distractor analysis, rationale writing, quality auditing, rubric design
Four recordings of my own voice in Upper Swabian, Standard German, and English, and a verbatim transcript that shows where my dialect drifts toward the standard instead of hiding it.
Verbatim transcription, dialect annotation, speech recording, German, Swabian, English
My own desktop app for the moment transcripts fall apart: people talking over each other. Every speaker turn sits on one timeline, so overlaps and handovers get checked instead of guessed.
Diarization review, transcription tooling, annotation workflow design, building with AI assistance