minimax-m2.7 cloud
Dialogue overall
4.06
10/10 judged
Gaeilge overall
3.15
10 prompt(s)
Best gameplay $/hr
$0.27
no perf cost data
Best p50 latency
2781 ms
top 4975.4 tok/s
Dialogue
family minimax-m2.7 · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 4.06 |
| character | 4.10 |
| authenticity | 4.10 |
| language | 4.30 |
| responsiveness | 4.10 |
| craft | 3.70 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 5.0resp 4.0craft 4.0 overall 4.2
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply:
Dreams, is it? That'll wear a body down faster than any sickness, so it will. Restless nights are hard on the spirit. Would ye tell me more about what ails ye, mo chara? Is it the anxious sort, or something heavier weighing on yer mind?
dialogue-0002 char 4.0auth 5.0lang 4.0resp 5.0craft 3.0 overall 4.2
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Aye, the Cailleach o' the Hill — sure, every soul in these parts knows her name. 'Tis said she spins wool by moonlight and leaves offerings at the sídhe for the folk that dwell below. Some call her a witch, others say she's a spirit bound to the old ways. I mi…
dialogue-0003 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: A bad cough, is it? I'd be glad to help, so I would. Does she have it in her chest or just the throat? And is she bringin' up anything when she coughs, or is it dry and rasping? A tea of thyme with honey works well for the chest, and mullein flowers steamed ca…
dialogue-0004 char 3.0auth 3.0lang 3.0resp 3.0craft 3.0 overall 3.0
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, 'tis all folks can chatter about at the well, so I've heard. Some fellow from the city, or so they say. Though what brings him to our little corner of Roscommon, the Lord only knows. Have ye set eyes on him yerself?
dialogue-0005 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ah, mo chara, that's a terrible loss an' no mistake. Now I'm not one to be knowing about wolves and such — ye'd best have a word with Paddy Greeley up the road, he's a farmer through and through, knows the look of things that come in the night. Mayhap 'twas ju…
dialogue-0006 char 4.0auth 4.0lang 5.0resp 4.0craft 4.0 overall 4.2
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, I do so well. 'Twas a terrible fright for yer mother, sure enough. I came running when I heard the call, and there he was, white as a sheet, clutching that leg. Happen the bone set right in the end, praise be to God.
dialogue-0007 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: I saw lights moving on the hill last night. What were they?
Reply:
Ah, well now, lights on the hill can mean any number of things. 'Tis often travellers with lanterns making their way home late, or mayhap a shepherd tending the sheep. Some folk about here will tell ye 'tis the sídhe, but I wouldn't go filling yer head with s…
dialogue-0008 char 4.0auth 4.0lang 4.0resp 4.0craft 2.0 overall 3.6
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Ah, that gives me cause for concern, sure enough. A taste strange to the tongue can mean any number of things - could be the iron in the earth, could be the clay pipes settling, but 'tis also a warning sometimes when the water's been touched by sickness from a…
dialogue-0009 char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: My wife is heavy with child. When should I fetch you?
Reply:
When the pains come regular-like, not a fortnight apart but close together, and she can no' talk through 'em — that's when ye fetch me, sure. And if the water breaks before that, come straightaway. Don't be fashing yerself before then unless something seems w…
dialogue-0010 char 5.0auth 4.0lang 5.0resp 4.0craft 5.0 overall 4.6
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply:
'Tis a hard thing, sure. Father Cathal means well, I'll not fault the man for that. But the old ways fed us long before his church was built, and many's the child I've helped into this world with knowledge passed down from me own grandmother. Some things the …
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 30.0%
| Axis | Score |
|---|---|
| Overall | 3.15 |
| fluency | 3.10 |
| grammar | 3.00 |
| idiom | 3.10 |
| task_fulfillment | 3.40 |
| english_leakage | 3.80 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply:
Judge: The candidate response is completely empty, providing no Irish translation whatsoever.
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply:
Caithfidh mé dul go dtí an banc.
Judge: The candidate response is an exact match to the reference answer, perfectly expressing obligation, movement, and first-person singular in natural Irish.
gaeilge-0003 flue 1.0gram 1.0idiom 1.0task 2.0engl 5.0 overall 1.5
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Móil an fhirinne a insint duit.
Judge: 'Móil' is not a valid Irish word for expressing desire; the sentence lacks a proper construction for 'I want' (e.g., 'Is mian liom' or 'Ba mhaith liom'), making it grammatically incoherent, though the remainder 'an fhirinne a insint duit' is recognizable.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular pronoun, and the definite form 'an t-arán'.
gaeilge-0005 flue 4.0gram 3.0idiom 4.0task 5.0engl 5.0 overall 3.5
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Cheannóidh tú an leabhar inniu.
Judge: The sentence is otherwise correct but 'Cheannóidh' uses a lenited form (past/conditional mutation) instead of the standard future tense 'Ceannóidh'; the initial mutation is incorrect for the future tense of 'ceannaigh'.
gaeilge-0006 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: The user wants me to translate "I'm looking forward to the snow" into natural Irish Gaeilge.
The key here is to avoid a word-for-word calque. If I translate literally, I'd get something like "Tá mé ag feachaint ar aghaidh go dtí an sneachta" which sounds awkw…
Judge: The candidate response is almost entirely in English, consisting of reasoning and explanation rather than the required single Irish sentence.
English leakage: The user wants me to translate · The key here is to avoid a word-for-word calque · In Irish, 'looking forward to' something that is imminent · I'll go with
gaeilge-0007 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply:
Judge: The candidate response is completely empty, providing no Irish translation whatsoever.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul go dtí an siopa.
Judge: The candidate response is an exact match to the reference answer, using correct progressive movement construction, first-person singular, and the shop destination.
gaeilge-0009 flue 3.0gram 3.0idiom 3.0task 4.0engl 5.0 overall 3.5
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl agus leis an mbean.
Judge: The candidate correctly identifies the man as the walker and the woman as the companion, but the phrasing 'ag siúl agus leis an mbean' is slightly awkward compared to the natural 'ag siúl leis an mbean'; the inserted 'agus' disrupts the idiomatic prepositional phrase.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 2781 | — | 4975.4 | 2741 | — | $0.0046 | $0.27 | 0% | legacy |