AI Inference Optimization Framework

Pruna is an inference optimization framework built for AI developers, enabling you to deliver faster, more efficient models with minimal overhead. The open-source package offers two main features: the combination of optimization algorithms (including caching, quantization, pruning, distillation and compilation techniques) as well as evaluation metrics (to help understand how compression affects your models across different dimensions - from output quality to resource requirements)