EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

feat: use CUDA 12.4 by default (for FA3) (#2682)

Browse Source
This commit is contained in:
Yineng Zhang
2024-12-31 15:52:09 +08:00
committed by GitHub
parent bedc4c7a50
commit d49b13c6f8
4 changed files with 14 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/README.md
View File

@@ -11,5 +11,5 @@
- `check_env.py`: Check the environment variables.
- `global_config.py`: The global configs and constants.
- `launch_server.py`: The entry point for launching the local server.
- `llama3_eval.py`: Llama 3.1 evaluation with meta-llama dataset.
- `llama3_eval.py`: Evaluation of Llama 3.1 using the Meta Llama dataset.
- `utils.py`: Common utilities.