SWE sampling issues plague Affine, dirty data cleared
Share
Affine addressed critical SWE (software engineering) environment instability where Docker images terminated mid-rollout, affecting most models except the champion. Team cleared corrupted samples from the last two days across multiple model IDs and is investigating root causes. Champion tasks in MEMORY and NAVWORLD environments also reported stuck, with some marked complete but unfinished. Champion dethrone requirements reduced from 2 to 1 winning environment to accelerate iteration.
- •SWE sampling rate dropped to 3-10 per hour; Docker terminations corrupted model evaluations
- •Cleared 100+ dirty sample IDs; investigating Codex environment for similar issues
- •Champion dethrone now requires 1 winning env instead of 2
- •MEMORY/NAVWORLD champions stuck; tasks falsely marked complete
Distilled from 22 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1500693721748996168
- Discord message 1500768296046428161
- Discord message 1500768891209777172
- Discord message 1500769066779152455
- Discord message 1500772064343363674
- Discord message 1500772223915397130
- Discord message 1500772384607572010
- Discord message 1500773786000031815
- Discord message 1500774411307847802
- Discord message 1500775505773854721
- Discord message 1500786041299275967
- Discord message 1500802484871102466
- Discord message 1500849541711134750
- Discord message 1500849900479316122