CacheOn Launches Two-Pass Eval Framework
Share
CacheOn (SN14) is rolling out a new two-pass evaluation system for miners, splitting assessment into speed (Pass 1) and correctness (Pass 2) with strict gating rules. Mainnet evaluation begins Monday June 8 at 10% incentive weight, ramping linearly to 100%. Team is pushing infrastructure improvements and better logging over the weekend ahead of the formal launch.
- •Pass 1 gates on ≥10% token match; Pass 2 uses teacher-forced logprob validation.
- •Final score: 50% TTFT improvement + 50% TPS improvement vs vLLM baseline.
- •Soft rollout this weekend; formal evaluation starts Monday with 10% weight.
- •Team shipping logging, telemetry, and GPU setup optimizations before next week.
Distilled from 5 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.