Connito Fixes Validator Data Loader Bug, Reranking Ahead
Share
Connito discovered and patched a critical bug in the validator's evaluation data loader that was reading only the head of data streams, limiting the candidate pool to ~2-3K rows and allowing miners to overfit specific checkpoints. The fix shuffles data sources and applies random read offsets per round, drawing from full C4 and Nemotron-CC-Math datasets. Validators expect multi-cycle reranking as leaderboard scores normalize from artificial lows (0.01 val_loss) to realistic ranges (3-5).
- •Eval data loader bug fixed; now shuffles sources with random offsets
- •Previous overfitting window closed; val_loss expected to climb 0.01→3-5
- •Exploit and registration war both resolved; fair emissions resuming
Distilled from 4 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.