doc: emphasize and notify the usage of chat_template (#3589)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
This commit is contained in:
@@ -56,6 +56,9 @@ Please consult the documentation below to learn more about the parameters you ma
|
||||
* `json_model_override_args`: Override model config with the provided JSON.
|
||||
* `delete_ckpt_after_loading`: Delete the model checkpoint after loading the model.
|
||||
|
||||
> [!IMPORTANT]
|
||||
> **Make sure the correct `chat_template` is passed, or performance degradation may occur.**
|
||||
|
||||
## Serving: HTTP & API
|
||||
|
||||
### HTTP Server configuration
|
||||
|
||||
Reference in New Issue
Block a user