Cacheon Deploys Teacher-Forcing Correctness Gate
Share
Cacheon is rolling out a new evaluation pipeline to close gaming vectors in the old correctness gate, which could be exploited by matching a few tokens then dumping garbage. The replacement uses teacher-forcing: after a speed pass, a dedicated baseline (Qwen2.5-72B) re-scores each miner's full output against its own logprobs to catch implausible tokens. vLLM stability issues on the scoring side are being addressed with `--enforce-eager` mode. Docs and thresholds are still being calibrated before mainnet rollout, targeting before Monday.
- •New two-pass eval: speed first, then dedicated baseline re-scores miner outputs via teacher-forcing.
- •Fixes vLLM instability by running scoring baseline with `--enforce-eager` (no CUDA graphs).
- •Spec decoding now allowed; divergence is fine if logprobs stay above threshold.
- •UID 105 deregistration was intentional; leader/RU re-eval every round with 1% fixed moat.
Distilled from 35 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1506446486823764059
- Discord message 1506446568717291621
- Discord message 1506461983489392702
- Discord message 1506462001814044932
- Discord message 1506465375854792756
- Discord message 1506557175533670572
- Discord message 1506559161243140147
- Discord message 1506610893583155292
- Discord message 1506610982418645033
- Discord message 1506611156998029442
- Discord message 1506611274660712468
- Discord message 1506611383582588939
- Discord message 1506611549265989633
- Discord message 1506611750135398410