SWE Bug Fixed, Champion Model Flagged for Copying
Share
Team discovered and patched a critical SWE bug where agents reaching max 50 steps had their fixes skipped, affecting many task IDs across multiple UIDs. Separately, the current champion model (UID 15) was flagged for copying UID 228's weights—identical model parameters with only config changes to avoid SHA detection. Team lead committed to manual dethrone and return throne to UID 213, pending team discussion on transparency and fairness concerns raised by miners.
- •SWE bug: fixes discarded at 50-step limit; dirty data removal underway across affected UIDs
- •Champion UID 15 identified as copy of UID 228; parameters identical, only configs modified
- •High SWE variance remains core issue; pass@k considered to reduce randomness
- •Major system refactor planned; transparency improvements for evaluation pipeline ongoing
Distilled from 127 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1503613063469863085
- Discord message 1503615487047630849
- Discord message 1503616230295081021
- Discord message 1503618365690875924
- Discord message 1503651202477457508
- Discord message 1503658490680574033
- Discord message 1503660762697044049
- Discord message 1503661040003715183
- Discord message 1503674779486650529
- Discord message 1503684444639461376
- Discord message 1503684732314194100
- Discord message 1503685611796566086
- Discord message 1503686066522034208
- Discord message 1503686249540751461