EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Updated Nvidia Jetson docs (#4422)

Browse Source
This commit is contained in:
Shakhizat Nurgaliyev
2025-09-09 08:41:21 +05:00
committed by GitHub
parent 97fff98c68
commit 2fe17735a6
1 changed files with 7 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
docs/platforms/nvidia_jetson.md
View File

@@ -20,12 +20,16 @@ Run the installation script:
``` ```
bash jetson-containers/install.sh bash jetson-containers/install.sh
``` ```
Build the container: Build the container image:
``` ```
CUDA_VERSION=12.6 jetson-containers build sglang jetson-containers build sglang
``` ```
Run the container: Run the container:
``` ```
jetson-containers run $(autotag sglang)
```
Or you can also manually run a container with this command:
```
docker run --runtime nvidia -it --rm --network=host IMAGE_NAME docker run --runtime nvidia -it --rm --network=host IMAGE_NAME
``` ```
* * * * * * * * * *
@@ -69,7 +73,7 @@ Structured output with XGrammar
Please refer to [SGLang doc structured output](../advanced_features/structured_outputs.ipynb). Please refer to [SGLang doc structured output](../advanced_features/structured_outputs.ipynb).
* * * * * * * * * *
Thanks to the support from [shahizat](https://github.com/shahizat). Thanks to the support from [Nurgaliyev Shakhizat](https://github.com/shahizat), [Dustin Franklin](https://github.com/dusty-nv) and [Johnny Núñez Cano](https://github.com/johnnynunez).
References References
---------- ----------