Chinese routing
This model is not LayaAir. Chinese tickets go to laya-multilingual because the script is Han, not because a language id was configured by hand. The notes below are from the README and the router’s documented behavior.
Han text does not stay on the English checkpoint
The router sends non-Latin script to convaiinnovations/laya-multilingual (mmBERT-base, 322M, context 1024, raisable to 8192 with max_len=8192). The English checkpoint is ModernBERT-large with context 512. The README’s Khmer measurement is the warning: accuracy 0.000 at confidence 0.952 on the English checkpoint. A high confidence does not mean the right model ran.
The 中文工单 in the workbench is Han text, so the labeled demo reports the multilingual route. That demo is a keyword stand-in. Run the export if you need the checkpoint.
The README links community write-ups for Chinese benchmarks. This site does not copy their scores: feishu_zh (中文) and zh_short_commands (中文).
Score questions on the multilingual checkpoint
Issue #131: laya-multilingual has a position bias on score questions and rarely picks the first level. A Chinese ticket that also asks for urgency will hit that checkpoint. For an English score, pin model="english". The workbench check names this when the route is multilingual and a question type is score.
noul can follow its option labels, especially on the English checkpoint (#156). Avoid true/false and yes/no as choice labels. Calibration of the number you gate on is a separate page: calibration.