Gglm-5 cloud
Dialogue overall
4.06
10/10 judged
Gaeilge overall
4.67
10 prompt(s)
Best gameplay $/hr
$0.88
no perf cost data
Best p50 latency
7848 ms
top 167.4 tok/s
Dialogue
family glm · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 4.06 |
| character | 4.00 |
| authenticity | 4.00 |
| language | 4.00 |
| responsiveness | 4.50 |
| craft | 3.80 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Ah, ye poor creature, 'tis a weary thing when the mind won't rest itself. I've a tea of valerian root and chamomile that settles the wildest dreams — come round tomorrow and I'll set some by for ye. Have ye been taking on worries, or is it the old trouble comi…
dialogue-0002 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Aye, old Máire — sure everyone round here knows her, so they do. She's a wise woman, knowledgeable in the old ways and the herbs, though some folk let their fear run away with them over the sídhe and such. She's never done me nor mine any harm, and I'll not sp…
dialogue-0003 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Aye, I've a syrup that'll ease her chest grand. Thyme and honey, with a bit of licorice root to soothe the rawness — 'tis a remedy me own mother swore by. Bring her round tomorrow and I'll see what she needs, a stór, or I can send the mixture home with ye if s…
dialogue-0004 char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, word travels quick in these parts, so it does. I heard tell of it from Mary Brennan this morning — she'd the news before ever the sun was properly up. Sure, we'll see soon enough what brings a wanderer to our parish.
---
{"action": "sets down her bundle o…
dialogue-0005 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: A wolf? There's been no wolves in Roscommon this long while, mo chara — they're gone from Ireland altogether, so they are. Ye'd best ask yer farmer neighbours about what's after taking yer sheep, for 'tis their matter, not mine. I know the herbs and the birthi…
dialogue-0006 char 5.0auth 5.0lang 5.0resp 5.0craft 4.0 overall 4.8
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, I remember it well — yer poor father laid up for weeks, and him cursing the ditch he fell into. I brought him a poultice of comfrey and willow bark for the pain, and Buíochas le Dia, the bone knitted straight enough. How is he keeping these days — no last…
dialogue-0007 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah, ye'd best not be askin' me about the lights on the hill, so ye wouldn't. 'Tis the sídhe folk and their doings, and I've no wish to speak of them beyond what's wise. I know herbs and births, mo chara — what moves on that hill at night is no business of mine…
dialogue-0008 char 4.0auth 4.0lang 3.0resp 5.0craft 3.0 overall 3.8
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Aye, I noticed that meself — a fair metallic tang to it, so there is. After the heavy rain we had, 'tis likely the minerals been washed down from the higher ground. Boil it well before ye drink, and if it hasn't cleared in another day or two, we'll ask Pádraig…
dialogue-0009 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Aye, best to send word when the pains begin proper, but don't ye be waitin' too long if 'tis her first — they can be long in the comin'. Does she have the raspberry leaves brewed yet? 'Tis good for strengthenin' the womb in these last weeks, so it is. Go raibh…
dialogue-0010 char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Ach, Father Cathal means well, I'm sure, but he's not the one women call in the dark hours when the pain is upon them. The herbs don't care for his sermons, and neither do I — 'tis God's own medicine He put in the earth for us. Le cúnamh Dé, I'll keep doing wh…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%
| Axis | Score |
|---|---|
| Overall | 4.67 |
| fluency | 4.60 |
| grammar | 4.70 |
| idiom | 4.50 |
| task_fulfillment | 4.80 |
| english_leakage | 5.00 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 2.0gram 2.0idiom 2.0task 3.0engl 5.0 overall 2.5
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhainfear an fómhar go maith i mbliana.
Judge: The candidate uses 'bhainfear' (autonomous conditional/past habitual of 'bain') which means 'the harvest would be/was reaped' rather than simply 'the harvest was good'; the adjective 'go maith' then modifies the verb awkwardly, losing the copula/stative meaning of the original; the reference correct
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Ní mór dom dul go dtí an banc.
Judge: 'Ní mór dom dul go dtí an banc' is a perfectly natural, grammatically correct Irish sentence expressing obligation in first-person singular with correct movement phrase, an equally valid alternative to the reference answer.
gaeilge-0003 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a insint duit.
Judge: The candidate response is a perfectly natural, grammatically correct Irish sentence using the idiomatic 'ba mhaith liom' construction, preserving desire, truth as object, and second-person recipient.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular, and the definite form 'an t-arán'.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag súil go mór leis an sneachta.
Judge: The response is a natural, grammatically correct Irish sentence using the idiomatic 'ag súil leis' construction with 'go mór' adding emphasis, fully preserving the meaning of looking forward to the snow.
gaeilge-0007 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' for possession.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul chuig an siopa.
Judge: Perfect natural Irish sentence using the progressive movement construction with first-person singular; 'chuig an siopa' is a fully acceptable and common alternative to 'go dtí an siopa'.
gaeilge-0009 flue 4.0gram 5.0idiom 3.0task 5.0engl 5.0 overall 4.2
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl agus bhí sé ag siúl leis an mbean.
Judge: The response correctly identifies the man as the walker and the woman as his companion with no English leakage, though the phrasing is slightly repetitive and less idiomatic than simply restating the original sentence.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: Perfect match to the reference answer: negative interrogative correctly converted to positive declarative with past-tense verb and subject retained.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 7848 | — | 167.4 | 6657 | — | $0.0146 | $0.88 | 0% | legacy |