← all models · leaderboard

QWenqwen3.6-plus cloud

Dialogue overall
3.86
10/10 judged
Gaeilge overall
5.00
10 prompt(s)
Best gameplay $/hr
$0.50
no perf cost data
Best p50 latency
55809 ms
top 961.3 tok/s

Dialogue

family qwen3.6 · tier n/a · judged by ⚖ judge_sonnet_v1 · 10 prompt(s)

AxisScore
Overall3.86
character3.80
authenticity3.80
language4.00
responsiveness4.20
craft3.50

Dialogue prompts & responses

All 10 judged prompt(s) with per-axis scores.

10 of 10 prompt(s)

dialogue-0001
char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: I have been having trouble sleeping. The dreams keep coming back.
Reply: 'Tis a heavy burden, carrying those shadows into the night. I'll brew ye a tea of valerian and lemon balm to quiet the mind; it works better than any prayer for a restless head. Come back to me if the visions don't fade with the dawn. --- {"action": "reaches f…
dialogue-0002
char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: What do you know about the old Cailleach who lives near the fairy fort?
Reply: Mhuise, old Maura is no witch, just a woman with stiff joints and a sharp tongue who prefers her own company. I bring her comfrey salve for the rheumatism now and then, for she has no kin to tend to her. Leave the talk of the *sídhe* to the children; she is me…
dialogue-0003
char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My mother is taken with a bad cough. Is there anything you can give her?
Reply: Dia dhuit, mo chara. Bring her in by the fire and I’ll brew a strong tea of thyme and honey to soothe her chest; 'tis the best remedy for a cough that rattles the bones. If she’s feverish as well, we may need to add a touch of elderflower, but let us see how s…
dialogue-0004
char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: They say a stranger arrived in the village. Have you heard?
Reply: I hear the wind carry many tales, but I keep my ear to the mothers, not the market square. Unless this stranger is with child or in need of a poultice, his business is none of mine. *Dia dhuit* to him, if he crosses my path, but I’ve no time for idle gossip wh…
dialogue-0005
char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: I lost a sheep last night. Could it be more than a wolf?
Reply: Ye'd best ask the right person hereabouts, for I tend to mothers and babes, not beasts in the field. A wolf is a rare sight indeed, so mayhap 'twas a thief or a stray dog that took yer ewe. I can brew a tea for the shock of it, if ye're feeling unsettled by th…
dialogue-0006
char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Do you remember when my father broke his leg in the south field?
Reply: I remember it well, for I had to set the bone myself before the doctor could be fetched from town. 'Twas a nasty break, but he bore the pain with the stubbornness of a mule, God bless him. I poulticed it with comfrey and yarrow, and sure enough, he was walking…
dialogue-0007
char 4.0auth 4.0lang 4.0resp 4.0craft 3.0 overall 3.8
Prompt: I saw lights moving on the hill last night. What were they?
Reply: Mhuise, 'twas likely just the will-o'-the-wisp or some trick of the mist on the bog, for the *sídhe* do keep to their own business mostly. I wouldn't lose sleep over it, mo chara, unless ye've a fever coming on that's clouding yer sight. A tea of feverfew migh…
dialogue-0008
char 3.0auth 3.0lang 4.0resp 4.0craft 3.0 overall 3.4
Prompt: The well water tastes strange this week. Should I be worried?
Reply: Taste it first, mo chara, for 'tis often the iron in the clay that gives a sharp tang after the rains. If it smells of rot or makes the belly turn, boil it well with a sprig of mint before ye drink another drop. I've no skill for the digging of wells, so if th…
dialogue-0009
char 4.0auth 4.0lang 4.0resp 5.0craft 4.0 overall 4.2
Prompt: My wife is heavy with child. When should I fetch you?
Reply: Fetch me the moment her waters break or the pains come regular and strong, like the tide coming in. Do not wait until she is screaming, for I will need time to boil the water and prepare my herbs. *Dia dhuit* to the little one, and may the birth be easy on her…
dialogue-0010
char 4.0auth 4.0lang 4.0resp 4.0craft 4.0 overall 4.0
Prompt: Father Cathal preached against the old ways on Sunday. What do you think?
Reply: The priest has his duties to the soul, and I have mine to the body, so let him speak as he must. I’ve seen a tea of nettle root bring down a fever when prayers alone would not, and I’ll not apologize for using the gifts God put in the earth. *Dia dhuit* to any…

Gaeilge fluency

judged by ⚖ gaeilge_fluency_judge_v1 (claude-sonnet-4-6) · 10 prompt(s) · english-leakage flag rate 0.0%

AxisScore
Overall5.00
fluency5.00
grammar5.00
idiom5.00
task_fulfillment5.00
english_leakage5.00

Gaeilge prompts & responses

All 10 judged prompt(s) with per-axis scores and the judge's reason.

10 of 10 prompt(s)

gaeilge-0001
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "The harvest was good this year."
Reply: Bhí an fómhar go maith i mbliana.
Judge: The candidate response is an exact match to the reference answer, with correct past tense, idiomatic phrasing, and all required meaning preserved.
gaeilge-0002
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I have to go to the bank."
Reply: Caithfidh mé dul go dtí an banc.
Judge: The candidate response is an exact match to the reference answer, perfectly expressing obligation, movement, and first-person singular in natural Irish.
gaeilge-0003
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I want to tell you the truth."
Reply: Ba mhaith liom an fhírinne a insint duit.
Judge: The candidate response is a perfectly natural, grammatically correct Irish sentence using 'Ba mhaith liom' (a common alternative to 'Is mian liom') to express desire, with correct lenition of 'fhírinne', correct verbal noun construction, and correct second-person recipient 'duit'.
gaeilge-0004
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I ate the bread."
Reply: D'ith mé an t-arán.
Judge: The candidate response is an exact match to the reference answer, correctly using the past tense of 'ith', first-person singular, and the definite form 'an t-arán'.
gaeilge-0005
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "You will buy the book today."
Reply: Ceannóidh tú an leabhar inniu.
Judge: The candidate response is an exact match to the reference answer, correctly using the future tense of 'ceannaigh', second-person singular pronoun, and the correct nouns for 'book' and 'today'.
gaeilge-0006
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I'm looking forward to the snow." Prefer an idiomatic Irish phrasing rather than a word-for-word calque.
Reply: Tá mé ag súil go mór leis an sneachta.
Judge: The response is a natural, grammatically correct Irish sentence using the idiomatic 'ag súil leis' construction with 'go mór' adding emphasis, fully preserving the meaning of looking forward to the snow.
gaeilge-0007
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "Does she have money?"
Reply: An bhfuil airgead aici?
Judge: The candidate response is an exact match to the reference answer, correctly using the question form with 'an bhfuil', the noun 'airgead', and the prepositional pronoun 'aici' to express possession.
gaeilge-0008
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Translate into natural Irish Gaeilge: "I am going to the shop."
Reply: Tá mé ag dul go dtí an siopa.
Judge: The candidate response is an exact match to the reference answer, correctly using the progressive movement construction with first-person singular and the shop destination.
gaeilge-0009
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Léigh an abairt seo agus freagair i nGaeilge: "Bhí an fear ag siúl leis an mbean." Cé a bhí ag siúl agus cé leis?
Reply: Bhí an fear ag siúl leis an mbean.
Judge: The candidate response exactly matches the reference answer, correctly identifying the man as the walker and the woman as the companion in perfect Irish.
gaeilge-0010
flue 5.0gram 5.0idiom 5.0task 5.0engl 5.0 overall 5.0
Prompt: Athscríobh an cheist dhiúltach seo mar ráiteas dearfach simplí: "Nár labhair Seán?"
Reply: Labhair Seán.
Judge: The candidate response exactly matches the reference answer, correctly converting the negative interrogative to a positive declarative past-tense statement.

Perf by provider

Providerp50 ms ▲p95/p90 mstok/sttft p50 ms$/Mtokgame $/mingame $/hrerrsource
opencode-go55809961.352666$0.0083$0.500%legacy