vLLM speedup shipped, validator plagued by API throttling
Share
SN97 deployed vLLM for student evaluation, cutting per-round wall-time from ~3 hours to ~30–45 minutes on fresh 8×B200 hardware. UID 244 (will_king_v2) holds the throne with composite score 0.561. However, OpenRouter teacher API throttling (HTTP 429) has stalled rounds repeatedly over the past ~16 hours; per-student checkpointing to survive restarts remains unshipped.
- •vLLM enabled on student-axis benchmark; 19 pending eval backlog clears days instead of weeks.
- •King UID 244 retains title; 9 challengers cleared KL threshold but lost on Pareto gate.
- •OpenRouter Kimi-K2.6 endpoint intermittently throttles; rounds reroll but full checkpoint recovery not yet live.
- •Pod environment forwarding and one-shot publisher script landed to reduce false disqualifications.
Distilled from 47 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1504282861988216832
- Discord message 1504351404813320303
- Discord message 1504367343814312017
- Discord message 1504367344812687390
- Discord message 1504371096877666404
- Discord message 1504398790902284289
- Discord message 1504400864654266468
- Discord message 1504406358823272448
- Discord message 1504424220132769882
- Discord message 1504424482238890095
- Discord message 1504431105871446147
- Discord message 1504431272015958116
- Discord message 1504433859326906458
- Discord message 1504434955600662619