Eval pod outage, validator config fixes underway
Share
Eval-server pod went offline at 05:08 UTC, causing submission failures recorded as `eval_error`; operator migrated to new hardware. Team removed king hash check and identified mining config inconsistencies (vocab_size mismatch). Multiple exploits surfaced: miners reusing hotkeys with different commits to trigger re-evals and climb rankings, and direct model copying. Team is revising evaluation logic and mining documentation.
- •8×B300 eval pod down ~30min; migrated to B200 hardware; OOM issues encountered
- •Removed king hash check; fixing re-eval logic enabling gaming and copy-cat attacks
- •Vocab_size config mismatch: 151936 vs active 262144; MINING.md updated
- •Model copying detected; miners submitting identical losses under different hotkeys
Distilled from 107 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1502129009876799680
- Discord message 1502130178854490252
- Discord message 1502130449596682340
- Discord message 1502130590973952040
- Discord message 1502132601551589436
- Discord message 1502132726575271957
- Discord message 1502133595567816745
- Discord message 1502133802388951040
- Discord message 1502135818884481105
- Discord message 1502135959930667099
- Discord message 1502135991236825214
- Discord message 1502136309181972490
- Discord message 1502136986507677786
- Discord message 1502137205039304885