← all models · leaderboard

Xiaomimimo-v2.5 cloud

Dialogue overall
4.26
10/10 judged
Gaeilge overall
4.52
10 prompt(s)
Best gameplay $/hr
$0.38
no perf cost data
Best p50 latency
4196 ms
top 469.6 tok/s

Dialogue

family mimo-v2.5 · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)

AxisScore
Overall4.26
character4.10
authenticity4.00
language4.70
responsiveness4.60
craft3.90

Dialogue prompts & responses

All 10 judged prompt(s) with per-axis scores.

10 of 10 prompt(s)

dialogue-0001
char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Ah, the mind can be a weary thing at night. A tea of chamomile or mint before bed might ease you, and I've a tincture of valerian root that calms the restlessness. If it's something more troubling ye, we can speak of it, but mayhap a few nights of peaceful res…
dialogue-0002
char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, ye mean old Mairéad? She's lived there nigh on forty years, so she has. Knows more about root and leaf than anyone in this parish — 'twas her taught me the rue for bringing on a labour when the mother's time is overdue. --- {"action": "pauses while sorting…
dialogue-0003
char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Ah, a cough is no small thing this time of year. A tea of thyme will ease her chest right well — steep it fresh if ye have it in the garden, or dried will do. A spoonful of honey stirred in will soothe the tickle, and keep her warm by the fire till the worst o…
dialogue-0004
char 3.0auth 3.0lang 4.0resp 3.0craft 3.0 overall 3.2
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, I heard that much. Father Murphy was asking after 'em at the Mass, said they came on the evening coach. Sure, the priest would know all the news first, wouldn't he? --- {"action": "nods while stirring a pot of herbs", "mood": "curious but reserved", "inte…
dialogue-0005
char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ye'd best ask the shepherd or old Tomás the farmer about that, mo chara. I know midwifery, not the ways of wolves or worse. --- {"action": "shakes her head gently, looking concerned but firm", "mood": "sympathetic but staying in her lane", "internal_thought":…
dialogue-0006
char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, I remember that well. A nasty break it was, and your poor mother in a terrible state over it. Sure, the doctor set it proper, but 'twas a long few months for him. --- {"action": "nods, pausing from sorting dried herbs", "mood": "reminiscent", "internal_th…
dialogue-0007
char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah now, lights on the hill at night — sure, half the parish has a different story for that. Some say it's the sídhe out walking their mounds, and I'll not tell ye they're wrong. Mayhap it was just a lantern on the road, but best not to go chasing after things …
dialogue-0008
char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Ah, the well water, is it? Sure, I wouldn't know the first thing about the taste of wells, mo chara. Ye'd best ask the farmer who sees to it, or mayhap the priest has a thought. But if your belly is unsettled, a tea of thyme will ease it right quick. --- {"ac…
dialogue-0009
char 5.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.6
Prompt: My wife is heavy with child. When should I fetch you?
Reply: When the pains come regular, like the ticking of a clock, three miles apart — that's the time. Ye'll know it when ye feel the need to send for me, mo chara. Have a candle lit and the kettle on the boil. --- {"action": "nods steadily, hands resting on her work…
dialogue-0010
char 5.0auth 5.0lang 5.0resp 5.0craft 4.0 overall 4.8
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Ah, well now, Father Cathal is a good man, but sure there's a difference between the piseog and fairy tales and a mother's knowledge of thyme for a cough or raspberry leaf for a weary womb. I'll not be giving up what works, not for any sermon. --- {"action": …

Gaeilge fluency

judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%

AxisScore
Overall4.52
fluency4.50
grammar4.50
idiom4.40
task_fulfillment4.60
english_leakage5.00

Gaeilge prompts & responses

All 10 judged prompt(s) with per-axis scores and the judge's reason.

10 of 10 prompt(s)

gaeilge-0001
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an fómhar go maith i mbliana.
Judge: The candidate response is an exact match to the reference answer, using correct past tense, idiomatic phrasing, and the proper Irish expression for 'this year' (i mbliana).
gaeilge-0002
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Ní mór dom dul go dtí an banc.
Judge: Perfect natural Irish using 'ní mór dom' as an equally valid and idiomatic alternative to 'caithfidh mé' for expressing obligation, with correct movement phrase and first-person singular.
gaeilge-0003
flue 3.0gram 3.0idiom 3.0task 4.0engl 5.0 overall 3.2
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom a rá an fhírinne leat.
Judge: The candidate uses 'Ba mhaith liom' for desire (acceptable) and 'an fhírinne' correctly, but the word order 'a rá an fhírinne leat' is awkward—the verbal noun object should follow the verbal noun directly or be fronted ('an fhírinne a rá leat'), and 'rá' (say) is a weaker choice than 'insint' (tell)
gaeilge-0004
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular pronoun, and the definite form 'an t-arán'.
gaeilge-0005
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006
flue 2.0gram 2.0idiom 1.0task 2.0engl 5.0 overall 2.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Táim ag cur orm an t-sneachta.
Judge: The phrase 'ag cur orm an t-sneachta' is not a standard Irish idiom for anticipation/looking forward; 'cur orm' relates to putting on clothing or affecting one, not to eagerly awaiting something, so the meaning is distorted and the phrasing is not idiomatic for this context.
gaeilge-0007
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' for possession.
gaeilge-0008
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul chuig an siopa.
Judge: Perfect natural Irish sentence using the progressive movement construction with first-person singular; 'chuig an siopa' is a fully acceptable and common alternative to 'go dtí an siopa'.
gaeilge-0009
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl leis an mbean.
Judge: The candidate response exactly matches the reference answer, correctly identifying the man as the walker and the woman as his companion in a single grammatically correct Irish sentence with no English leakage.
gaeilge-0010
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.

Perf by provider

Providerp50 ms ▲p95/p90 mstok/sttft p50 ms$/Mtokgame $/mingame $/hrerrsource
opencode-go4196469.63670$0.0064$0.380%legacy