τeuτonic Eval Issues, New King Dethroned
Share
Network operators reported multiple backend evaluation failures: top-performing models disappeared from incentive lists despite valid Huggingface repos, weight-matching showed false 0.0000 similarity scores, and incentive distribution malfunctioned. A new king model (jenny) emerged mid-period after extended drought. Community debated whether network reached training loss limits or if evaluation infrastructure bugs prevented legitimate model advancement.
- •Top models vanishing from incentive list despite valid registration and HuggingFace repos
- •Remote eval misreporting similarity scores as 100% identical when weights differ
- •Six-hour gap without new king model; backend system flagged as working incorrectly
- •Suspected vector attacks and shard variance exploits for overfit training
- •New king (jenny) appeared; debate over training limits vs. eval infrastructure failures
Distilled from 56 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1501403727469219850
- Discord message 1501405407137234954
- Discord message 1501407783898320926
- Discord message 1501408281028071584
- Discord message 1501415341241401364
- Discord message 1501442524483682347
- Discord message 1501442745795870751
- Discord message 1501443129063116972
- Discord message 1501444240184578059
- Discord message 1501458878167257139
- Discord message 1501463278768095333
- Discord message 1501464169294331924
- Discord message 1501491090132308018
- Discord message 1501491255677554688