Distil SN97: Flash Attention 2 compatibility issue
Share
A GPU error surfaced during model initialization: MoonViT3dPretrainedModel does not support Flash Attention 2, blocking deployment on some hardware. Team fielded questions about student model requirements, miner model specs, codebase updates, and repository commit frequency, but no fixes or changes were documented in the 24-hour window.
- •MoonViT3dPretrainedModel raises ValueError with Flash Attention 2
- •Questions raised on GPU availability and update frequency
Distilled from 8 team messages in the official Bittensor Discord. Generated by Claude Haiku 4.5.