Change description of nvidia jetson docs (#3761)

This commit is contained in:
Shakhizat Nurgaliyev
2025-02-21 17:44:22 +05:00
committed by GitHub
parent 1df6eabd5d
commit d8d75d256a

View File

@@ -10,15 +10,24 @@ Before starting, ensure the following:
```bash
sudo nvpmodel -m 0
```
- A custom PyPI index hosted at https://pypi.jetson-ai-lab.dev/jp6/cu126, tailored for NVIDIA Jetson Orin platforms and CUDA 12.6.
To install torch from this index:
```bash
pip install torch --index-url https://pypi.jetson-ai-lab.dev/jp6/cu126
```
* * * * *
## Installation
Please refer to [Installation Guide](https://docs.sglang.ai/start/install.html) to install FlashInfer and SGLang.
## Installing and running SGLang with Jetson Containers
Clone the jetson-containers github repository:
```
git clone https://github.com/dusty-nv/jetson-containers.git
```
Run the installation script:
```
bash jetson-containers/install.sh
```
Build the container:
```
CUDA_VERSION=12.6 jetson-containers build sglang
```
Run the container:
```
docker run --runtime nvidia -it --rm --network=host IMAGE_NAME
```
* * * * *
Running Inference