Gglm-5.1 cloud
Dialogue overall
4.16
10/10 judged
Gaeilge overall
4.55
10 prompt(s)
Best gameplay $/hr
$1.23
no perf cost data
Best p50 latency
7571 ms
top 279.7 tok/s
Dialogue
family glm · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 4.16 |
| character | 4.00 |
| authenticity | 4.10 |
| language | 4.10 |
| responsiveness | 4.70 |
| craft | 3.90 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Aye, troubled sleep is a cruel affliction, so it is. I've a tea of valerian and chamomile that quiets the mind — 'tis helped many a soul rest easy again. Will ye tell me what manner of dreams they are, or would ye rather I just mix the herbs for ye, a stór? --…
dialogue-0002 char 4.0auth 5.0lang 5.0resp 4.0craft 4.0 overall 4.4
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, ye mean Máire Ní Chonail — 'tis an odd way to speak of her, callin' her a Cailleach when she's not so ancient as all that. She knows the herbs better than most, I'll grant her that, though she keeps to herself near the sídhe mound. I've crossed paths with …
dialogue-0003 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Aye, I can mix her something for that chest. I'll make a syrup of horehound and honey — 'tis the best thing for shifting a stubborn cough. Come round to my door tomorrow mornin' and I'll have it ready for ye, a stór.
---
{"action": "wipes hands on apron, moves…
dialogue-0004 char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, word travels fast in a small parish, so it does. I heard tell of it from Mary McCarthy — she saw someone on the road near the crossroads this morning. Sure I've no notion who it might be, but 'tis the way of things hereabouts — a new face sets tongues wag…
dialogue-0005 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: A sheep lost, is it? That's a hard thing, surely. But ye'd best ask the right person hereabouts — I know births and herbs, not the wild creatures that roam the night. Paddy Brennan or one of the herders would have more to say on it than I would.
---
{"action":…
dialogue-0006 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, I remember it well. 'Twas a nasty break, that one — I brought him willow bark for the pain and set a poultice of comfrey to knit the bone. Your poor mother was half demented with the worry of it. Sure he was mending within the fortnight, Le cúnamh Dé. Why…
dialogue-0007 char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Lights on the hill, is it? Aye, there's some would tell ye 'tis the sídhe out walking, and others'd say swamp gas catching fire. I mind my own business and keep to the road at night, so I do. Ye'd best ask Father Byrne or one of the older men — they'd know the…
dialogue-0008 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Aye, I noticed it meself — had a queer mineral tang to it, so it did. After the heavy rains we had, the runoff can wash things into the well that shouldn't be there. Boil it well before drinking, and if yer stomach turns queasy, come tell me straight away — I'…
dialogue-0009 char 5.0auth 5.0lang 4.0resp 5.0craft 5.0 overall 4.8
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Aye, that's good news — may she have an easy time of it, so. Watch for when the waters break or the pains come regular, close together like — that's when ye'd want me there quick. Don't be waiting till the last minute now, for first babes can be slow or swift,…
dialogue-0010 char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Aye, he'd have us all praying to saints and leaving off what the mothers and grandmothers knew. But I'll tell ye this — when a woman's labour goes hard or the fever takes hold, 'tis not Father Cathal they send for at midnight, 'tis me and my herbs. The old way…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%
| Axis | Score |
|---|---|
| Overall | 4.55 |
| fluency | 4.60 |
| grammar | 4.50 |
| idiom | 4.40 |
| task_fulfillment | 4.70 |
| english_leakage | 5.00 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 3.0gram 2.0idiom 2.0task 3.0engl 5.0 overall 2.5
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhain an fómhar go maith i mbliana.
Judge: The candidate uses 'bhain' (cut/reaped) instead of 'bhí' (was), making the sentence grammatically awkward and semantically off — 'bhain an fómhar go maith' does not naturally mean 'the harvest was good'; the reference correctly uses 'bhí an fómhar go maith i mbliana'.
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Caithfidh mé dul go dtí an banc.
Judge: The candidate response is an exact match to the reference answer, perfectly expressing obligation, movement, and first-person singular in natural Irish.
gaeilge-0003 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a insint duit.
Judge: Perfect natural Irish sentence using 'ba mhaith liom' to express desire, correct lenition on 'fhírinne', correct verbal noun construction, and second-person recipient 'duit'.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular pronoun, and the definite form 'an t-arán'.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006 flue 5.0gram 5.0idiom 4.0task 5.0engl 5.0 overall 4.5
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá súil agam leis an sneachta.
Judge: 'Tá súil agam leis' is a valid and natural Irish idiom for anticipation/hope, very close to the reference 'Táim ag súil leis an sneachta', and fully preserves the meaning with correct grammar and no English leakage.
gaeilge-0007 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' to express possession.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul chuig an siopa.
Judge: The candidate response is a natural, grammatically correct Irish sentence using the progressive movement construction with first-person singular; 'chuig an siopa' is a perfectly acceptable and common alternative to 'go dtí an siopa'.
gaeilge-0009 flue 3.0gram 3.0idiom 3.0task 4.0engl 5.0 overall 3.5
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl agus é leis an mbean.
Judge: The candidate correctly identifies the man as the walker and the woman as the companion, but the phrasing 'agus é leis an mbean' is awkward and less natural than simply repeating or paraphrasing the source sentence directly.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 7571 | — | 279.7 | 6225 | — | $0.0204 | $1.23 | 0% | legacy |