update REAMDE

This commit is contained in:
2025-08-06 11:55:51 +08:00
parent 37ad87e75c
commit 4828ec9ef0

View File

@@ -1,3 +1,40 @@
## 天数智芯 智铠100 sherpa-onnx
### 编译指令
在corex:4.3.0镜像中使用以下命令
```
export LD_LIBRARY_PATH=/usr/local/corex-4.3.0/lib64/python3/dist-packages/tvm/:$LD_LIBRARY_PATH
SHERPA_ONNX_CMAKE_ARGS='-DCMAKE_BUILD_TYPE=Release -DBUILD_SHARED_LIBS=ON -DSHERPA_ONNX_ENABLE_GPU=ON' python3 setup.py bdist_wheel
```
即可编译出适用于天垓100的sherpa-onnx whl包
### pip使用方式
```shell
pip install sherpa_onnx-1.12.5+corex4.3.0-cp310-cp310-linux_x86_64.whl
```
具体的推理过程代码与sherpa-onnx python包没有任何区别
### 智铠100的模型适配情况
我们在智铠100上针对sherpa-onnx offline asr部分进行了所有大类的适配测试方式为在CPU和智铠100加速卡上对同一段长音频进行语音识别任务获取运行时间1-cer指标。运行环境为
- CPU: Intel(R) Xeon(R) Gold 5318Y CPU @ 2.10GHz 使用4线程推理
- 智铠100在上述CPU硬件的同时下使用一张智铠100加速卡
| 模型大类 | 模型名称 |CPU运行时间(秒)|智铠100运行时间(秒)|CPU 1-cer|智铠100 1-cer| 备注 |
|------|---------------|-----|----|-------|-------|---------------------|
| sense_voice |sherpa-onnx-sense-voice-zh-en-ja-ko-yue-2024-07-17| 38.0647 | 2.0983 | 0.990017 | 0.990017 | |
| whisper | sherpa-onnx-whisper-small | 102.5295 | 31.1180 | 0.662230 | 0.662230 | |
| whisper | sherpa-onnx-whisper-medium-aishell | 333.6795 | 81.0457 | 0.788686 | 0.782030 | 智铠100相比于CPU推理精度略有一点损失 |
| dolphin_ctc | sherpa-onnx-dolphin-small-ctc-multi-lang-2025-04-02 | 18.9561 | 2.1923 | 0.923461 | 0.923461 | |
| fire_red_asr | sherpa-onnx-fire-red-asr-large-zh_en-2025-02-16 | 262.2483 | 60.8946 | 0.961730 | 0.961730 | |
| zipformer_ctc | sherpa-onnx-zipformer-ctc-zh-int8-2025-07-03 | 11.9980 | 18.0075 | 0.965058 | 0.965058 | 智铠100比4线程CPU推理速度要慢 |
| paraformer | sherpa-onnx-paraformer-zh-2024-03-09 | 7.1863 | 8.6246 | 0.948419 | 0.948419 | 智铠100推理速度略微慢于4线程CPU |
| telespeech_ctc | sherpa-onnx-telespeech-ctc-zh-2024-06-04 | 20.6491 | 65.8070 | 0.948419 | 0.948419 | 智铠100推理速度明显慢于4线程CPU |
| wenet_ctc | sherpa-onnx-zh-wenet-aishell2 | 4.4012 | 4.4689 | 0.813644 | 0.813644 | 智铠100推理速度与4线程CPU几乎持平 |
| transducer | sherpa-onnx-conformer-zh-2023-05-23 | 10.8479 | 2.3755 | 0.880200 | 0.880200 | |
| nemo_ctc | sherpa-onnx-nemo-parakeet_tdt_ctc_110m-en-36000 | 6.2488 | 1.3116 | 0.961176 | 0.961176 | |
| nemo_canary | sherpa-onnx-nemo-canary-180m-flash-en-es-de-fr | N/A | N/A | N/A | N/A | 无法适配 |
| moonshine | sherpa-onnx-moonshine-base-en-int8 | 18.7996 | 37.3384 | 0.982353 | -0.134118 | 智铠100对该模型仅仅能运行但完全无法生成任何正确结果 |
### Supported functions
|Speech recognition| [Speech synthesis][tts-url] | [Source separation][ss-url] |