EngineX-Iluvatar/enginex_bi_series-sherpa-onnx
Archived
16
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Fix reading tokens.txt on Windows (#448)

Browse Source
This commit is contained in:
Fangjun Kuang
2023-11-25 14:22:26 +08:00
committed by GitHub
parent 8444d54c4e
commit 66cad9fa93
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
sherpa-onnx/csrc/lexicon.cc
View File

@@ -50,6 +50,8 @@ static std::unordered_map<std::string, int32_t> ReadTokens(std::istream &is) {
iss >> id; iss >> id;
} }
// eat the trailing \r\n on windows
iss >> std::ws;
if (!iss.eof()) { if (!iss.eof()) {
SHERPA_ONNX_LOGE("Error: %s", line.c_str()); SHERPA_ONNX_LOGE("Error: %s", line.c_str());
exit(-1); exit(-1);