Performance Evaluation of PowerInfer‑2: Offloading, Prefill, and In‑Memory Efficiency

PowerInfer‑2 achieves up to 29× speedups over llama.cpp and 13× over LLMFlash by leveraging neuron‑level pipelines and NPU‑centric prefill optimization.