mimo-v2.5-pro cloud
Dialogue overall
4.58
10/10 judged
Gaeilge overall
2.92
10 prompt(s)
Best gameplay $/hr
$0.87
no perf cost data
Best p50 latency
7714 ms
top 354.6 tok/s
Dialogue
family mimo-v2.5-pro · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 4.58 |
| character | 4.50 |
| authenticity | 4.40 |
| language | 4.90 |
| responsiveness | 5.00 |
| craft | 4.10 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Ah, 'tis a terrible thing when sleep won't come to ye. Sure, the mind can be a cruel companion in the dark hours. Have ye tried a tea of chamomile before bed? And I could make ye up a wee sachet of lavender and hops for under the pillow — my own mother swore b…
dialogue-0002 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, sure, there's talk. Some say she's been there since before memory, others call it just a lonely widow's house near the old rath. I don't go near the place myself. Best to leave what's at the sídhe be, and not be meddling with piseog.
---
{"action": "Looks …
dialogue-0003 char 5.0auth 5.0lang 5.0resp 5.0craft 4.0 overall 4.8
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Ach, sorry to hear that about yer mother. A tea of thyme with a good spoonful of honey will ease her chest something lovely — I've a bundle dried here if she's none in the house. Tell her to keep it warm by the fire and breathe the steam through a cloth over h…
dialogue-0004 char 4.0auth 4.0lang 4.0resp 5.0craft 3.0 overall 4.0
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, I did hear tell of it. Mrs. Flanagan mentioned it when she came for her herbs this mornin' — said she saw a man with a fine coat and a leather bag comin' in by the Carrick road. Could be a merchant, could be a landlord's man. Ye know how it is in a small …
dialogue-0005 char 5.0auth 4.0lang 5.0resp 5.0craft 5.0 overall 4.8
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ah, sure that's a terrible loss, and I'm sorry to hear it. But ye'd best ask someone who knows the ways of beasts and the hills — maybe Fergus Dooley or old Seán Burke, they'd have the knowledge of tracks and predators. 'Tis not my area at all, so it isn't — I…
dialogue-0006 char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, I do indeed. 'Twas a terrible break, so it was — the bone came through the skin, poor man. Your mother ran all the way to my door in her bare feet, white as a sheet. Dr. Madden set it, and I made the poultice of comfrey and egg to draw the swelling down. …
dialogue-0007 char 4.0auth 5.0lang 5.0resp 5.0craft 4.0 overall 4.6
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Och, sure there's always lights movin' about on the hills of a night. May be poitín men tendin' their stills — best not go askin' after that too loudly, mind. Or mayhap it was just someone walkin' late with a lantern, takin' a shortcut home from the public hou…
dialogue-0008 char 4.0auth 4.0lang 5.0resp 5.0craft 3.0 overall 4.2
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Dia dhuit. 'Tis well ye're payin' attention to it — strange-tastin' water is never to be ignored, especially with little ones about. Is it a musty sort of taste, or more metallic, like iron? Mayhap something's got into the well upstream — a dead creature or su…
dialogue-0009 char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Dia dhuit, and sure that's grand news! When her pains start coming regular — like every ten minutes or so — or if her waters break, that's the time to come for me. Don't be waiting too long thinking it'll pass, mind — I'd rather come early than late. And if th…
dialogue-0010 char 5.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.6
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Sure, Father Cathal means well enough, but I'd be lost without the old knowledge when I'm tendin' to a woman in labour. There's a power in the herbs and the ways our mothers taught us that no sermon can take away. He can preach what he likes — but when a child…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 40.0%
| Axis | Score |
|---|---|
| Overall | 2.92 |
| fluency | 2.90 |
| grammar | 2.90 |
| idiom | 2.90 |
| task_fulfillment | 3.00 |
| english_leakage | 3.40 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Okay, the user wants a translation into Irish Gaeilge for "The harvest was good this year." Let me break this down. First, the sentence structure in Irish typically puts the subject first, so "The harvest" would be "Bhí an fómhar." Next, "was good" needs to be…
Judge: The candidate response is entirely in English, consisting of reasoning/explanation rather than an Irish translation, violating the constraint to answer in Irish only.
English leakage: Okay, the user wants a translation into Irish Gaeilge · Let me break this down · The word 'good' can be 'maith' or 'go maith'
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Caithfidh mé dul go dtí an banc.
Judge: The candidate response is an exact match to the reference answer, perfectly expressing obligation, movement, and first-person singular in natural Irish.
gaeilge-0003 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a insint duit.
Judge: Perfect natural Irish sentence using 'ba mhaith liom' (a common alternative to 'is mian liom') with correct mutation, word order, and second-person recipient.
gaeilge-0004 flue 1.0gram 1.0idiom 1.0task 1.0engl 5.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an
Judge: The response is incomplete, cutting off after 'an' and missing the noun 'arán', making it an unfinished sentence that fails to fulfill the task.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: First, the task is to translate "I'm looking forward to the snow." into natural Irish Gaeilge, preferring idiomatic phrasing over word-for-word translation. The constraints are to answer in Irish only, use one sentence, and not explain the translation.
The ke…
Judge: The candidate response is entirely in English, explaining the translation process rather than providing the Irish sentence as required.
English leakage: First, the task is to translate · The key phrase here is · Putting it together · To make it more idiomatic
gaeilge-0007 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: First, the task is to translate "Does she have money?" into natural Irish Gaeilge. I must answer in Irish only, use one sentence, and not explain the translation.
The prompt is a question asking if someone has money. In Irish, this would typically be phrased …
Judge: The candidate response is entirely in English with extensive explanation and reasoning, completely failing the constraint to answer in Irish only with one sentence and no explanation.
English leakage: First, the task is to translate · The standard way to say · Let me verify this · I need to ensure it's one sentence
gaeilge-0008 flue 1.0gram 1.0idiom 1.0task 1.0engl 1.0 overall 1.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: First, the task is to translate "I am going to the shop." into natural Irish Gaeilge. I need to answer in Irish only, use one sentence, and not explain the translation.
Key points from the prompt: Translate into natural Irish Gaeilge, so I should use idiomati…
Judge: The candidate response is entirely in English, explaining the translation rather than providing it; no Irish sentence was actually delivered as required.
English leakage: First, the task is to translate · Key points from the prompt · In Irish, the present tense often uses · A natural way to say this in Irish might be
gaeilge-0009 flue 4.0gram 4.0idiom 4.0task 5.0engl 5.0 overall 4.2
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl agus an mbean leis.
Judge: The candidate correctly identifies the man as the walker and the woman as his companion in one Irish sentence with no English leakage, though the phrasing 'agus an mbean leis' is a slight restructuring of the original rather than the most natural restatement.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 7714 | — | 354.6 | 6314 | — | $0.0145 | $0.87 | 0% | legacy |