deepseek-v4-flash cloud
Dialogue overall
3.96
10/10 judged
Gaeilge overall
4.98
10 prompt(s)
Best gameplay $/hr
$0.12
no perf cost data
Best p50 latency
3799 ms
no perf data
Dialogue
family deepseek-flash · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 3.96 |
| character | 3.90 |
| authenticity | 3.90 |
| language | 4.00 |
| responsiveness | 4.30 |
| craft | 3.70 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Ah now, that's no small burden to carry, a chroí. I've known many a soul troubled by what comes in the dark—oftentimes it's the mind trying to mend itself. I've a calming tea I brew from chamomile and a whisper of valerian root; might ye like a pouch of it to …
dialogue-0002 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, the Cailleach at the rath? Sure, I've seen her about, gathering herbs at the edge of the fort. She keeps to herself, and I'd advise ye to do the same—there's queer things happen near them sídhe mounds.
---
{"action": "lowers her voice and glances towards t…
dialogue-0003 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Ah, that's sorry news. Is it a dry, tearing cough she has, or a wet one that brings up phlegm? I've a syrup of onion and honey that'll ease her chest, and some elecampane root I dried myself.
---
{"action": "sets down the pestle and gives a sympathetic look", …
dialogue-0004 char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Ah, a stranger, is it? I've not laid eyes on them meself, but there was word at the well this mornin' — a tall man with a fine horse, they said. Mayhap he's just passin' through, or maybe he'll stay a while — sure, time will tell.
---
{"action": "glances up fr…
dialogue-0005 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ah, that's a sorrowful loss, so it is. But I'm not the one to be guessing at what took it — I know births and herbs, not beasts of the field. Ye'd best ask Tom the shepherd, or maybe old Paddy who knows the mountain; they'd have a better notion of such tracks …
dialogue-0006 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Ah, I do indeed, mo chara. 'Twas a nasty break, so it was. I used a good splint of ash and a comfrey poultice to draw the swelling. Buíochas le Dia, he healed well enough to walk again, though he'd a limp for a long while after.
---
{"action": "nods slowly, a …
dialogue-0007 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah, sure I heard tales of lights on that hill before. Some say 'tis the sídhe out and about, but I wouldn't be the one to say for certain. Ye'd best ask old Tom the farmer—he's seen more of such things than I have.
---
{"action": "stops stirring the pot, wipes…
dialogue-0008 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Ah, I'd not be taking chances with the water, so I wouldn't. If it's gone strange, best boil it well before drinking, or fetch from the stream yonder. I've seen queer things in wells after a dry spell.
---
{"action": "sets down the bundle of herbs, wipes her h…
dialogue-0009 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Ah, 'tis a joyful time, so it is. When her pains are comin' steady, every ten minutes or thereabouts, and her waters break, then ye send for me. I'll come quick, never ye fear, a chroí.
---
{"action": "nods reassuringly, hands resting on her apron", "mood": "r…
dialogue-0010 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Mhuise, I've no quarrel with the priest, and I go to Mass every Sunday, but I'd be a poor midwife if I turned my back on what my mother and her mother before her knew. The herbs and the prayers can sit side by side, I reckon.
---
{"action": "leans back slightl…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%
| Axis | Score |
|---|---|
| Overall | 4.98 |
| fluency | 5.00 |
| grammar | 5.00 |
| idiom | 4.90 |
| task_fulfillment | 5.00 |
| english_leakage | 5.00 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an fómhar go maith i mbliana.
Judge: The candidate response is an exact match to the reference answer, with correct past tense, idiomatic phrasing, and all required meaning preserved.
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Caithfidh mé dul go dtí an banc.
Judge: The candidate response is an exact match to the reference answer, perfectly expressing obligation, movement, and first-person singular in natural Irish.
gaeilge-0003 flue 5.0gram 5.0idiom 4.0task 5.0engl 5.0 overall 4.8
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Tá mé ag iarraidh an fhírinne a insint duit.
Judge: Perfectly grammatical and fluent Irish sentence that preserves all required elements (desire, truth as object, second-person recipient); 'tá mé ag iarraidh' is a natural Connacht/Ulster alternative to 'is mian liom' for expressing desire.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular pronoun, and the definite form 'an t-arán'.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag tnúth leis an sneachta.
Judge: 'Ag tnúth le' is a perfectly idiomatic Irish expression for looking forward to something, grammatically correct and natural.
gaeilge-0007 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' to express possession.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul go dtí an siopa.
Judge: The candidate response is an exact match to the reference answer, using correct progressive movement construction, first-person singular, and the shop destination with no English leakage.
gaeilge-0009 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl leis an mbean.
Judge: The candidate response exactly matches the reference answer, correctly identifying the man as the walker and the woman as the companion in perfect Irish.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: Perfect match with the reference answer: negative interrogative correctly converted to positive declarative with past-tense verb and subject retained.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 3799 | — | — | — | — | $0.0019 | $0.12 | 0% | legacy |