Move parsers under a single folder (#9912)

This commit is contained in:
Lianmin Zheng
2025-09-02 18:25:04 -07:00
committed by GitHub
parent 369b143366
commit 60e37f8028
28 changed files with 31 additions and 30 deletions

View File

@@ -22,7 +22,7 @@ Reference: https://pytorch.org/docs/stable/distributed.tensor.parallel.html
Here is a quick example to enable TP:
```python
from sglang.srt.model_parallel import tensor_parallel
from sglang.srt.layers.model_parallel import tensor_parallel
device_mesh = torch.distributed.init_device_mesh("cuda", (tp_size,))
tensor_parallel(model, device_mesh)