Eirel SN36 Product Release Incoming, Eval Guidance
Share
Eirel.ai announced an imminent product release for SN36. Team provided detailed evaluation criteria and agent-routing guidance: agents must handle seven prompt categories (math, search, refusal, edge cases) via proper tool chaining. Validators flagged build failures on queue dashboard. Miners advised to test locally before submission (only 2 lifetime attempts per hotkey) and track scores across 10+ runs for signal.
- •Product release announced; evaluation harness code in eiretes repo
- •Agent eval spans 7 categories: math, search, refusal, tool-chaining, speed
- •Only 2 submission slots per hotkey—validate locally first
- •Score trending over 10+ runs > single high scores; optimize weakest axis
Distilled from 14 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1506164055432233130
- Discord message 1506168819511595119
- Discord message 1506168821432455232
- Discord message 1506271667419353149
- Discord message 1506271669453328424
- Discord message 1506306763253612654
- Discord message 1506311270750621776
- Discord message 1506311273053159465
- Discord message 1506313722858049628
- Discord message 1506315836749512775
- Discord message 1506327454082531439
- Discord message 1506335984462205008
- Discord message 1506341178583416913
- Discord message 1506341179854295090