LLM-Research/Codestral-22B-v0.1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Update mistral_inference package

Browse Source 
Update mistral_inference.model to mistral_inference.transformer.
This commit is contained in:
ai-modelscope
2024-07-31 20:14:43 +08:00
parent 04ccb687cb
commit 374bbbb674
41 changed files with 2 additions and 62 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@@ -33,7 +33,7 @@ tokens = tokenizer.encode_chat_completion(completion_request).tokens
## Inference with `mistral_inference`
```py
from mistral_inference.model import Transformer
from mistral_inference.transformer import Transformer
from mistral_inference.generate import generate
model = Transformer.from_folder(mistral_models_path)
@@ -124,7 +124,7 @@ This function uses recursion to calculate the Fibonacci number. However, it's no
After installing `mistral_inference` and running `pip install --upgrade mistral_common` to make sure to have mistral_common>=1.2 installed:
```py
from mistral_inference.model import Transformer
from mistral_inference.transformer import Transformer
from mistral_inference.generate import generate
from mistral_common.tokens.tokenizers.mistral import MistralTokenizer
from mistral_common.tokens.instruct.request import FIMRequest