EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Updated Nvidia Jetson docs (#4422)

Browse Source
This commit is contained in:
Shakhizat Nurgaliyev
2025-09-09 08:41:21 +05:00
committed by GitHub
parent 97fff98c68
commit 2fe17735a6
1 changed files with 7 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
docs/platforms/nvidia_jetson.md
View File

@@ -20,12 +20,16 @@ Run the installation script:
```
bash jetson-containers/install.sh
```
Build the container:
Build the container image:
```
CUDA_VERSION=12.6 jetson-containers build sglang
jetson-containers build sglang
```
Run the container:
```
jetson-containers run $(autotag sglang)
```
Or you can also manually run a container with this command:
```
docker run --runtime nvidia -it --rm --network=host IMAGE_NAME
```
* * * * *
@@ -69,7 +73,7 @@ Structured output with XGrammar
Please refer to [SGLang doc structured output](../advanced_features/structured_outputs.ipynb).
* * * * *
Thanks to the support from [shahizat](https://github.com/shahizat).
Thanks to the support from [Nurgaliyev Shakhizat](https://github.com/shahizat), [Dustin Franklin](https://github.com/dusty-nv) and [Johnny Núñez Cano](https://github.com/johnnynunez).
References
----------