kimi-k2.5 cloud
Dialogue overall
4.36
10/10 judged
Gaeilge overall
4.90
10 prompt(s)
Best gameplay $/hr
$0.57
no perf cost data
Best p50 latency
6759 ms
no perf data
Dialogue
family kimi-k2.5 · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 4.36 |
| character | 4.10 |
| authenticity | 4.10 |
| language | 4.90 |
| responsiveness | 4.70 |
| craft | 4.00 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: A leanbh, troubled sleep is a heavy thing to carry. A tea of chamomile and a little valerian root before bed might ease ye — 'tis an old remedy I give to many a weary soul. But if the dreams hold a darkness that herbs cannot touch, ye'd best speak with Father …
dialogue-0002 char 4.0auth 4.0lang 5.0resp 4.0craft 4.0 overall 4.2
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Sure, 'tis yourself, come askin' after the old woman. She keeps to herself mostly, and I keep to my births and herbs, so I couldn't say much on her. Ye'd best ask the right person hereabouts — old Séamus the seanchaí, or maybe Father Kearney if ye're worried f…
dialogue-0003 char 4.0auth 5.0lang 5.0resp 5.0craft 4.0 overall 4.6
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Aye, a bad cough is a weary thing. A tea of thyme and honey'll ease her chest, and if she's any phlegm, a bit of horehound boiled slow. I'll gather some for ye now.
---
{"action": "turns to her herb shelf, selecting dried bundles", "mood": "concerned but capa…
dialogue-0004 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, the post boy had it from the mail coach. A young man with a leather satchel and no kin about him, lodgin' with the widow Byrne above the forge. 'Tis a thing of interest, so it is, but what brings him is beyond my knowin'. Ye'd best ask the seanchaí at the…
dialogue-0005 char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: A wolf or a fox, most like, but ye'd best ask the right person hereabouts — old Máirtín the shepherd or yer neighbour with the dogs. 'Tis not my line of knowledge, mo chara.
---
{"action": "shakes head slightly, turns back to sorting dried herbs on the table"…
dialogue-0006 char 5.0auth 5.0lang 5.0resp 5.0craft 5.0 overall 5.0
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, I remember it well. 'Twas a wet autumn, and yer mother near wore herself out with worry and running between the house and the south field. I brought comfrey and elder bark to make a poultice, and bed rest with the leg bound straight — Le cúnamh Dé, he hea…
dialogue-0007 char 4.0auth 4.0lang 5.0resp 4.0craft 4.0 overall 4.2
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah, ye saw the lanterns, did ye? Most like it was the night watchmen from the big house, or mayhap some lads comin' back late from a céilí with their torches. Sure there's no harm in it, mo chara, though the old ones might whisper of sídhe — ye'd best ask the …
dialogue-0008 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Strange, ye say? 'Tis likely the rains stirred the bottom, or mayhap a beast fell in upstream. Boil it well before ye drink, and mind the little ones. If the belly gripes come, send for me — I'll bring wormwood and a strong brew of chamomile.
---
{"action": "…
dialogue-0009 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Ah, 'tis grand news, mo chara! Ye'll fetch me when the waters break, or when the pains come close together — every few minutes, like. If the head shows before that, run fast as ye can, mind.
---
{"action": "sets down bundle of dried raspberry leaf, wipes hand…
dialogue-0010 char 5.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.6
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Father Cathal means well, sure, but the old ways and the new aren't always at each other's throats. I've seen a prayer to the Virgin ease a woman's mind, and a sprig of rowan ease her labour — both have their place, aye? 'Tis not piseog to know what the elders…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%
| Axis | Score |
|---|---|
| Overall | 4.90 |
| fluency | 4.90 |
| grammar | 4.90 |
| idiom | 4.90 |
| task_fulfillment | 4.90 |
| english_leakage | 5.00 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an fómhar go maith i mbliana.
Judge: The candidate response is an exact match to the reference answer, with correct past tense, idiomatic phrasing, and all required meaning preserved.
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Caithfidh mé dul chuig an mbanc.
Judge: Perfect natural Irish with correct obligation form, first-person singular, movement expressed idiomatically with 'chuig', and correct lenition after 'chuig an'.
gaeilge-0003 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a rá leat.
Judge: Perfectly natural Irish sentence using 'ba mhaith liom' for desire, correct lenition on 'fhírinne', and idiomatic 'a rá leat' for telling someone something.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular, and the definite form 'an t-arán'.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct words for 'book' and 'today'.
gaeilge-0006 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag súil leis an sneachta.
Judge: The response is a natural, grammatically correct Irish sentence using the idiomatic 'ag súil le' construction to express anticipation, matching the reference answer closely (Táim vs Tá mé are both acceptable forms).
gaeilge-0007 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' for possession.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Táim ag dul go dtí an siopa.
Judge: Perfect natural Irish translation using the contracted first-person form 'Táim' which is idiomatic and correct, with proper progressive movement construction and shop destination.
gaeilge-0009 flue 4.0gram 4.0idiom 4.0task 4.0engl 5.0 overall 4.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl agus bhí an bean leis.
Judge: The candidate correctly identifies the man as the walker and the woman as his companion in one Irish sentence with no English leakage, though the phrasing 'bhí an bean leis' slightly restructures the original rather than preserving the prepositional phrase 'leis an mbean' intact.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 6759 | — | — | — | — | $0.0095 | $0.57 | 0% | legacy |