文章大纲
简介
Sparsity-aware deep learning inference runtime for CPUs
Documentation Slack Support YouTube Twitter
DeepSparse is a CPU inference runtime that takes advantage of sparsity to accelerate neural network inference. Coupled with SparseML, our optimization library for pruning and quantizing your models, DeepSparse delivers exceptional inference performance on CPU hardware.
文档:
- https://docs.neuralmagic.com/get-started/install/
软硬件限制
硬件要求:CPU 支持 avx2 指令集
软件:操作系统只支持Linux
可以通过查看CPU的规格或者使用特定的命令来检测CPU是否支持AVX2指令集。具体方法如下:<