deepseek-v4-pro cloud
Dialogue overall
3.92
10/10 judged
Gaeilge overall
5.00
10 prompt(s)
Best gameplay $/hr
$1.44
no perf cost data
Best p50 latency
6335 ms
no perf data
Dialogue
family deepseek-thinking · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 3.92 |
| character | 4.00 |
| authenticity | 4.00 |
| language | 4.00 |
| responsiveness | 4.10 |
| craft | 3.50 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Ah, sure the dreams are at ye again, mo chara? Come in and sit by the fire — I've a pot of chamomile steepin' that'll settle the mind. Tell me what's troublin' yer sleep, if ye've a wish to share it.
---
{"action": "gestures to a stool near the hearth, reache…
dialogue-0002 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, the old Cailleach near the fairy fort? I know her well enough. She keeps to herself, but she's a grand hand with the herbs, and she's helped me with a few difficult births over the years. Some say she has the ear of the sídhe, but I'd not go filling my hea…
dialogue-0003 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Ah, a bad cough, is it? I've a syrup here of honey and thyme that'll quiet it, and an infusion of coltsfoot if the lungs are tight. Bring this to your mother, and see she drinks it warm — that'll soothe her chest, mo chara.
---
{"action": "reaches for a brown …
dialogue-0004 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Mhuise, I did hear a whisper of it at the well. Myself, I've been up all night with a birthin', so I've no mind for strangers just yet. Nuala says he's a quiet sort, askin' after the old O'Dwyer holding.
---
{"action": "turns from the hearth, wiping hands on h…
dialogue-0005 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Mhuise, a sheep lost? That's a troubling thing. I'm little use with livestock—I tend to mothers and babes, not beasts. If it's not a wolf, ye'd best ask the shepherd down by the river; he'll know the tracks and the lore of these hills.
---
{"action": "looks up…
dialogue-0006 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Ah, sure I do, and well. Yer poor father howlin' like a banshee till we got the comfrey poultice on him. He's a hardy soul, God bless him — walkin' sound as a bell ever since, Buíochas le Dia.
---
{"action": "smiles at the memory while wiping her hands on her …
dialogue-0007 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah, ye saw those lights, did ye? The old folk'll tell ye 'tis the sídhe dancin' on the hill — I'd give them a wide berth meself. But just as like it was a lad with a lantern searchin' for a stray cow. I keep to me own hearth after dark, and that's my counsel t…
dialogue-0008 char 4.0auth 4.0lang 4.0resp 5.0craft 3.0 overall 4.0
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Aye, a strange taste in the water will have the whole parish on edge — and rightly so, for a tainted well can bring more sickness than a wet spring lamb. Has there been a heavy rain of late, or any cattle near the source? Let none of the house drink from it un…
dialogue-0009 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Ah, yer wife's time is near, then? Come for me when her pains are strong and steady — or sooner if her waters break, no matter the hour. Beannacht Dé ort, mo chara, and I'll look in on her tomorrow.
---
{"action": "looks up from her herb table, wiping her hand…
dialogue-0010 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Ah, Seamus, Father Cathal means well, but a piseog or two has kept many a fretful mother calm. So long as the prayers are said alongside, I see no great sin in it.
---
{"action": "leans in, voice soft but steady", "mood": "content", "internal_thought": "He'd c…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%
| Axis | Score |
|---|---|
| Overall | 5.00 |
| fluency | 5.00 |
| grammar | 5.00 |
| idiom | 5.00 |
| task_fulfillment | 5.00 |
| english_leakage | 5.00 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an fómhar go maith i mbliana.
Judge: The candidate response is an exact match to the reference answer, with correct past tense, idiomatic phrasing, and all required meaning preserved.
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Tá orm dul go dtí an banc.
Judge: 'Tá orm dul go dtí an banc' is a perfectly natural, idiomatic Irish expression of obligation using the 'tá orm' construction, which is arguably more colloquial than 'caithfidh mé' and fully correct.
gaeilge-0003 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a insint duit.
Judge: Perfect natural Irish sentence using 'ba mhaith liom' (a common alternative to 'is mian liom') with correct mutation, word order, and second-person recipient.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular pronoun, and the definite form 'an t-arán'.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag tnúth go mór leis an sneachta.
Judge: 'Ag tnúth leis' is a perfectly idiomatic Irish expression for 'looking forward to', and 'go mór' adds natural emphasis; grammar and word order are fully correct.
gaeilge-0007 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' for possession.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul go dtí an siopa.
Judge: The candidate response is an exact match to the reference answer, using correct progressive movement construction, first-person singular, and the shop destination with no English leakage.
gaeilge-0009 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl leis an mbean.
Judge: The candidate response exactly matches the reference answer, correctly identifying the man as the walker and the woman as his companion in a single grammatically correct Irish sentence with no English leakage.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 6335 | — | — | — | — | $0.0240 | $1.44 | 0% | legacy |