Score Subnet Addresses Ground Truth and Deployment Issues
Share
The score subnet team acknowledged inconsistencies in ground truth data generation, citing a hybrid model-human process under revision. They pushed back challenges to refine workflows and confirmed a deployment error affecting chutes is their top priority. Miner scoring mechanisms and track consistency remain under discussion.
- •Ground truth data generation process is being revamped to improve consistency
- •Challenges delayed to align with updated annotation workflows
- •Deployment error for chutes deployment reported and prioritized for resolution
- •Miner scoring mechanisms questioned due to declining public track performance
- •Private track ground truth reliability remains unverified by participants
Distilled from 38 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.
View original messages
- Discord message 1508181471138152559
- Discord message 1508182299768918217
- Discord message 1508182417851289723
- Discord message 1508182638861746206
- Discord message 1508182759380877335
- Discord message 1508183045339873290
- Discord message 1508183243810279534
- Discord message 1508183324005503036
- Discord message 1508183384172662895
- Discord message 1508183838306734260
- Discord message 1508184209989042306
- Discord message 1508184644603084901
- Discord message 1508184695790243900
- Discord message 1508184741290053744