Cacheon deploys teacher-forcing correctness gate
Share
Cacheon is replacing its gameable correctness evaluation with a two-pass system: speed measurement first, then re-scoring of miner outputs using a baseline model's logprobs to detect implausible tokens. The team identified vLLM stability issues under repeated scoring requests and is hardening validators across different infrastructure providers. Threshold calibration and dry-runs are underway before mainnet deployment.
- •New eval: speed pass measures all miners, correctness pass re-scores outputs with baseline logprobs
- •vLLM crashes on garbage outputs; fix uses --enforce-eager mode for scoring baseline
- •TPS metric revised to count baseline token count only, preventing padding inflation
- •Infra hardening: validator compatibility across Targon and Shadeform pod differences
Distilled from 14 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1506758997494206487
- Discord message 1506759859087999167
- Discord message 1506760757361115358
- Discord message 1506762956539560058
- Discord message 1506770771740065823
- Discord message 1506912137967046738
- Discord message 1506961669971116042
- Discord message 1506961764993208442
- Discord message 1506966534960971907
- Discord message 1506974360827596871
- Discord message 1506976599168389250
- Discord message 1506976666491031572
- Discord message 1507009526350479400
- Discord message 1507044622197854339