Validator v0.5.14 released with new model stack
Share
TrajectoryRL released validator v0.5.14, switching the S1 evaluation stack to Qwen3.5-35B-A3B testee and GLM-5.1 judge via OpenRouter. Validators must update `.env.validator` configuration by replacing old `CLAWBENCH_*` variables and restart Docker containers. Meanwhile, community members flagged suspected hardcoded submissions from multiple miners and discussed evaluation errors including JSON parsing failures and iteration limits.
- •Validator v0.5.14 uses Qwen3.5-35B-A3B + GLM-5.1 judge through OpenRouter
- •Required `.env.validator` config changes; old CLAWBENCH variables no longer supported
- •Docker restart needed after updating environment file
- •Multiple miners suspected of hardcoded or copied submission packs under review
- •Evaluation errors reported: JSON parsing failures, 15-iteration agent limits, missing conversation traces
Distilled from 42 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1499210396601548953
- Discord message 1499210459121979412
- Discord message 1499215557826838541
- Discord message 1499225647518584872
- Discord message 1499227755236298912
- Discord message 1499246289676796135
- Discord message 1499269623122624522
- Discord message 1499386701133648013
- Discord message 1499386804229378148
- Discord message 1499387216525529158
- Discord message 1499410207326076959
- Discord message 1499435784615366818
- Discord message 1499441927597199460
- Discord message 1499443620124819516