← all models · leaderboard

MiniMaxminimax-m2.5 cloud

Dialogue overall
4.32
10/10 judged
Gaeilge overall
3.73
10 prompt(s)
Best gameplay $/hr
$0.27
no perf cost data
Best p50 latency
5504 ms
top 43.3 tok/s

Dialogue

family minimax-m2.5 · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)

AxisScore
Overall4.32
character4.30
authenticity4.40
language4.40
responsiveness4.90
craft3.80

Dialogue prompts & responses

All 10 judged prompt(s) with per-axis scores.

10 of 10 prompt(s)

dialogue-0001
char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Dreams can be hard on the body and spirit alike, so they can. Are they troubled dreams, or joyful ones that leave ye out of sorts when ye wake? Sometimes a tea of valerian root or chamomile before bed can quiet the mind. But the body often speaks what the waki…
dialogue-0002
char 5.0auth 5.0lang 5.0resp 5.0craft 3.0 overall 4.4
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, the old Cailleach near the sí at the edge of the McDonagh land. 'Tis said she's a hard woman, but fair enough if ye treat her with respect. She knows the old ways uncommon well — herbs and such like that the rest of us have forgot. Mo ghrá, I'd not be fear…
dialogue-0003
char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Ah, the croup, is it? A tea of thyme with a spoonful of honey will ease her chest a treat. A-infusion of mullein flowers too, that softens the passage right enough. But if the phlegm runs yellow or green, ye'll want to simmer a bit of garlic in milk — bitter-t…
dialogue-0004
char 3.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.6
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, I've heard the whispers on the wind. 'Tis hard to keep a secret in a place this small, sure. Myself, I havnae laid eyes on them yet, but the kettle was boilin' at the shop yesterday and there was plenty of talk. Mayhap ye'd know more than I do, mo chara? …
dialogue-0005
char 5.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.4
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ah, mo chara, that's a sad loss and no mistake, but ye'd best ask the right person hereabouts — 'tis a farmer's concern, that, not a midwife's. I know nought of wolves nor what takes sheep of a night, sure. Mayhap young Donal Ó Murchú at the next farm tracks s…
dialogue-0006
char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, sure I do. Yer poor father, the pain he was in that day. 'Twas a terrible fall, aye, and I came round with poultices of comfrey and arnica for the swelling. Hard times for the whole family, so it was. Is he walking well enough these days, then?
dialogue-0007
char 4.0auth 5.0lang 4.0resp 5.0craft 4.0 overall 4.4
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah, the fairy lights, sure everyone has seen them from time to time. 'Tis often the sídhe, the good people moving between the raths, or mayhap just a shepherd with a lantern on the hill. Faith, it could be anything from a late walker carryin' a torch to them l…
dialogue-0008
char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Well now, strange how? A bit of mineral tang is common enough if the stones be porridgy, but if 'tis cloudy or smells foul, I'd not be drinking it. May I ask — has it been rainin' somethin' fierce of late? Sometimes the surface water finds its way down when th…
dialogue-0009
char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: My wife is heavy with child. When should I fetch you?
Reply: When the pains come regular-like, and not a moment before, mo chara. Call for me when she's well into her labour — not the first gripes, sure those can come and go for hours. But when she cannot walk nor talk through them, that's the time. I'll be there before…
dialogue-0010
char 5.0auth 5.0lang 5.0resp 5.0craft 3.0 overall 4.4
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Ah, Father Cathal's a good man, sure enough, but he Preaches from the chapel while the sídhe Preach from the hollows, and I'll tell ye this much — the old herb-lore has seen more sickbeds through than his sermons have. 'Tisn't that I disrespect the Church, mo …

Gaeilge fluency

judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 10.0%

AxisScore
Overall3.73
fluency3.70
grammar3.70
idiom3.80
task_fulfillment4.00
english_leakage4.60

Gaeilge prompts & responses

All 10 judged prompt(s) with per-axis scores and the judge's reason.

10 of 10 prompt(s)

gaeilge-0001
flue 5.0gram 5.0idiom 4.0task 5.0engl 5.0 overall 4.8
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an fómhar maith i mbliana.
Judge: The translation is correct and natural Irish; omitting 'go' before 'maith' (predicative adjective after 'bhí') is a minor grammatical deviation from the standard copula-like construction, but the sentence is otherwise fluent and fully conveys the meaning.
gaeilge-0002
flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: The user wants me to translate "I have to go to the bank." into Irish Gaeilge. In Irish, "I have to" can be expressed as "caithfidh mé" (I must) or "tá orm" (I have to). The phrase "caithfidh mé dul" is the most natural way to say "I have to go." "I have to …
Judge: The candidate response is entirely in English with extensive meta-commentary and reasoning; no Irish-only sentence was produced as required by the constraints.
English leakage: The user wants me to translate · In Irish, 'I have to' can be expressed as · Let me think about which is more natural · Actually, let me reconsider
gaeilge-0003
flue 1.0gram 2.0idiom 2.0task 1.0engl 5.0 overall 1.5
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírin
Judge: The response is incomplete, cutting off mid-word ('an fhírin' instead of 'an fhírinne a insint duit'), making it an unfinished sentence that fails to fulfill the task.
gaeilge-0004
flue 3.0gram 3.0idiom 3.0task 4.0engl 5.0 overall 3.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: Ith mé an t-arán.
Judge: The sentence is mostly correct but missing the past tense particle 'd'' before 'ith' — it should be 'D'ith mé an t-arán' to properly form the past tense in Irish; 'Ith' without the lenition/particle reads as an imperative rather than past tense.
gaeilge-0005
flue 4.0gram 3.0idiom 4.0task 5.0engl 5.0 overall 3.5
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Cheannóidh tú an leabhar inniu.
Judge: The sentence is almost correct but uses 'Cheannóidh' (lenited form, which would be used after certain particles or in dependent clauses) instead of the correct independent future tense 'Ceannóidh'; the lenition is a grammatical error in this context.
gaeilge-0006
flue 3.0gram 3.0idiom 4.0task 4.0engl 5.0 overall 3.5
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag tnúth leis an t sneachta.
Judge: The response uses the idiomatic 'ag tnúth leis' which is a valid and natural Irish expression for looking forward to something, but 'an t sneachta' is incorrectly written with a space before the t-prefix; it should be 'an tsneachta' (sneachta is masculine, so actually no t-prefix is needed after 'an
gaeilge-0007
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' for possession.
gaeilge-0008
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul go dtí an siopa.
Judge: The candidate response is an exact match to the reference answer, using correct progressive movement construction, first-person singular, and the correct destination phrase.
gaeilge-0009
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl leis an mbean.
Judge: The candidate response exactly matches the reference answer, correctly identifying the man as the walker and the woman as his companion in perfect Irish.
gaeilge-0010
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: Perfect match with the reference answer: negative interrogative correctly converted to positive declarative with past-tense verb and subject retained.

Perf by provider

Providerp50 ms ▲p95/p90 mstok/sttft p50 ms$/Mtokgame $/mingame $/hrerrsource
opencode-go550443.31392$0.0046$0.270%legacy