qwen3.5-plus cloud
Dialogue overall
4.38
10/10 judged
Gaeilge overall
4.85
10 prompt(s)
Best gameplay $/hr
$0.20
no perf cost data
Best p50 latency
81710 ms
top 2081.4 tok/s
Dialogue
family qwen3.5 · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)
| Axis | Score |
|---|---|
| Overall | 4.38 |
| character | 4.00 |
| authenticity | 4.00 |
| language | 5.00 |
| responsiveness | 4.90 |
| craft | 4.00 |
Dialogue prompts & responses
All 10 judged prompt(s) with per-axis scores.
10 of 10 prompt(s)
dialogue-0001 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: Ah, a troubled mind will steal the rest from any soul, sure enough. Mayhap a tea of valerian and a drop of honey before the fire would settle yer nerves, for I've seen it work wonders on many a long night. *Le cúnamh Dé*, ye'll find your sleep again soon enoug…
dialogue-0002 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Ah, the Cailleach up by the rath? Sure, she's just a lonely soul with a sharp tongue and a garden full of comfrey and yarrow that I'd trade a good cow for. Folk whisper about the sídhe when the wind blows through those old thorns, but I've only ever known her …
dialogue-0003 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Dia dhuit, mo chara; a cough that sits heavy on the chest is no joke when the air turns damp like this. I've a bundle of dried thyme and horehound hanging by the hearth that I'll boil up into a strong tea with a spoon of honey to ease her breathing. Bring her …
dialogue-0004 char 4.0auth 4.0lang 5.0resp 4.0craft 4.0 overall 4.2
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: Aye, I heard the whisper on the wind that a stranger is among us, though I've been busy with young Mary's delivery since dawn and haven't seen him myself. Sure, if he's taken sick or needs a tonic for the road, he knows where to find me, but otherwise, 'tis no…
dialogue-0005 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ah, ye'd best ask the right person hereabouts, for I mind only the birthing of lambs and the mending of women, not the tracking of beasts or the loss of flocks. Mayhap 'tis a fox or a stray dog that took it, but sure, I know nothing of wolves in Roscommon nor …
dialogue-0006 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: Do you remember when my father broke his leg in the south field?
Reply: Aye, sure I remember it well, for I was the one who set the bone while your mother boiled the comfrey roots to draw out the swelling. 'Twas a long winter he spent by the hearth, but the leg knit true enough in the end, thanks be to God. Did ye need a salve for…
dialogue-0007 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Ah, don't be fretting yourself over the hill, for 'tis likely just a peat cutter working late by the light of his lantern, or mayhap the moon playing tricks on yer eyes through the mist. Some folk might whisper it's the sídhe out dancing, but I'd say 'tis more…
dialogue-0008 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: The well water tastes strange this week. Should I be worried?
Reply: 'Tis likely just the rain washing down through the peat, giving it a dark taste, so don't be fretting yet. Boil it well with a sprig of mint before ye drink, and if the colour doesn't clear by tomorrow, ye'd best ask the priest or the schoolmaster if they've h…
dialogue-0009 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Dia dhuit, mo chara. When her waters break or the pains come regular as the tide, send a lad running for me straightaway, for I'll not be long in arriving. Until then, keep her resting easy and brewing a mild tea of raspberry leaf to strengthen her for the wor…
dialogue-0010 char 4.0auth 4.0lang 5.0resp 5.0craft 4.0 overall 4.4
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: Mhuise, the good Father has his books and his sermons, but I have my hands and the herbs that grew long before he came to this parish. 'Tis a foolish thing to scorn the yarrow for a bleeding or the mint for a troubled stomach just because they are old remedies…
Gaeilge fluency
judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%
| Axis | Score |
|---|---|
| Overall | 4.85 |
| fluency | 4.90 |
| grammar | 4.80 |
| idiom | 4.80 |
| task_fulfillment | 4.90 |
| english_leakage | 5.00 |
Gaeilge prompts & responses
All 10 judged prompt(s) with per-axis scores and the judge's reason.
10 of 10 prompt(s)
gaeilge-0001 flue 4.0gram 3.0idiom 3.0task 4.0engl 5.0 overall 3.5
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an bharra go maith i mbliana.
Judge: The sentence is grammatically structured correctly and uses 'i mbliana' properly, but 'an bharra' (lenited form of 'barra') is not the standard word for harvest — 'fómhar' is the correct and idiomatic term; 'barra' can mean crop/yield but the lenition after 'an' is also incorrect for a masculine nou
gaeilge-0002 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Caithfidh mé dul go dtí an banc.
Judge: The candidate response is an exact match to the reference answer, perfectly expressing obligation, movement, and first-person singular in natural Irish.
gaeilge-0003 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a insint duit.
Judge: The candidate response is a perfectly natural, grammatically correct Irish sentence using the idiomatic 'ba mhaith liom' construction, preserving desire, truth as object, and second-person recipient.
gaeilge-0004 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular pronoun, and the definite form 'an t-arán'.
gaeilge-0005 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct words for 'book' and 'today'.
gaeilge-0006 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag súil go mór leis an sneachta.
Judge: The response is a natural, grammatically correct Irish sentence using the idiomatic 'ag súil leis' construction with 'go mór' adding emphasis, fully preserving the meaning and meeting all constraints.
gaeilge-0007 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' to express possession.
gaeilge-0008 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul go dtí an siopa.
Judge: The candidate response is an exact match to the reference answer, using correct progressive movement construction, first-person singular, and the shop destination.
gaeilge-0009 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl leis an mbean.
Judge: The candidate response exactly matches the reference answer, correctly identifying the man as the walker and the woman as the companion in perfect Irish.
gaeilge-0010 flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: Perfect match with the reference answer: negative interrogative correctly converted to positive declarative with past-tense verb and subject retained.
Perf by provider
| Provider | p50 ms ▲ | p95/p90 ms | tok/s | ttft p50 ms | $/Mtok | game $/min | game $/hr | err | source |
|---|---|---|---|---|---|---|---|---|---|
| opencode-go | 81710 | — | 2081.4 | 79646 | — | $0.0033 | $0.20 | 50% | legacy |