TurboSparse-LLM: Accelerating Mixtral and Mistral Inference via dReLU Sparsity

Boost LLM decoding speed by 2-5× with TurboSparse. Discover how the dReLU activation function and high-quality data mixtures achieve 90% sparsity in Mistral and Mixtral models without losing performance.