Commit Graph

74 Commits

Author SHA1 Message Date
HAI
5c54ef0352 AMD/ROCm: update AITER repo to ROCm/aiter (#3747) 2025-02-21 00:18:08 -08:00
Peter Pan
bb3e526823 [k8s] remove unnecessary hostIPC for security concern (#3700) 2025-02-20 02:11:21 +08:00
Yineng Zhang
a5375adc3a chore: bump v0.4.3.post2 (#3645)
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
2025-02-18 02:48:30 +08:00
Yineng Zhang
2e6be53e7d fix Dockerfile.rocm 2025-02-17 22:13:03 +08:00
Yineng Zhang
e782eb7e6a chore: bump v0.4.3.post1 (#3638) 2025-02-17 21:58:19 +08:00
Shenggui Li
c9565e49e7 [docker] added rdma support (#3619) 2025-02-17 15:36:16 +08:00
HAI
d973c78e79 ROCm docker: triton update (#3584) 2025-02-14 10:26:32 -08:00
Jesse Lopez
6ce6eabbcc Copy config files for MI300X to support in virtualized environments (#3505) 2025-02-15 01:23:32 +08:00
Yineng Zhang
ac963be234 update flashinfer-python (#3557) 2025-02-14 09:52:56 +08:00
Yineng Zhang
e0b9a423c8 chore: bump v0.4.3 (#3556) 2025-02-14 09:43:14 +08:00
Yineng Zhang
cddb1cdf8f chore: bump v0.4.2.post4 (#3459) 2025-02-10 14:12:16 +08:00
Yineng Zhang
fa1b40e00d use nvcr.io/nvidia/tritonserver:24.04-py3-min as base image (#3457) 2025-02-10 13:52:33 +08:00
Yineng Zhang
c1f5f99f60 chore: bump v0.4.2.post3 (#3369) 2025-02-07 08:20:03 -08:00
Yineng Zhang
7aad8d1854 chore: bump v0.4.2.post2 (#3313) 2025-02-05 17:35:02 +08:00
Yineng Zhang
6186a8f889 update flashinfer install index url (#3293) 2025-02-05 00:44:35 +08:00
HAI
2c1a695ff1 ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) 2025-02-04 21:44:44 +08:00
HAI
566d61d90f ROCm: bump 6.3.0 (#3259) 2025-02-03 04:13:40 +08:00
HAI
17dbf976c5 update ENV to ROCm dockers (#3248) 2025-02-01 17:27:43 +08:00
Yineng Zhang
cf0f7eafe6 chore: bump v0.4.2.post1 (#3233) 2025-01-31 20:35:55 +08:00
Yineng Zhang
b49d6d0fee support 12.5 CUDA runtime (#3231) 2025-01-31 20:31:38 +08:00
Yineng Zhang
cf142b6eb8 fix: update Dockerfile for cu118 (#3181) 2025-01-27 23:46:44 +08:00
Yineng Zhang
4ab43cfb3e chore: bump v0.4.2 (#3180) 2025-01-27 21:42:05 +08:00
Byron Hsu
c0bf9bf15c [devcontainer] add non-root user (#2989) 2025-01-22 17:47:54 -08:00
Yineng Zhang
e94fb7cb10 chore: bump v0.4.1.post7 (#3009) 2025-01-20 21:50:55 +08:00
Yineng Zhang
3fc2b62589 update docker dev image (#2985) 2025-01-19 23:45:39 +08:00
Byron Hsu
53cc91e504 [devcontainer] Fix mount and GPU & Support rust dev (#2978) 2025-01-19 16:34:01 +08:00
Yineng Zhang
b3e99dfb22 chore: bump v0.4.1.post6 (#2899) 2025-01-15 16:23:42 +08:00
kk
b8cd09f27a update ROCm docker for layernorm kernel optimization (#2885)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-01-14 16:59:43 +08:00
kk
e808c1df3e Integrate ROCm ater package for ck moe function feasibility (#2854)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
2025-01-13 08:23:07 +00:00
sogalin
a18ab81ddd Update base image for ROCm (#2852)
Co-authored-by: HAI <hixiao@gmail.com>
2025-01-13 14:39:44 +08:00
Yineng Zhang
f624901cdd chore: bump v0.4.1.post5 (#2840) 2025-01-11 23:10:02 +08:00
Yineng Zhang
2f0d386496 chore: bump v0.4.1.post4 (#2713) 2025-01-06 01:29:54 +08:00
kk
148254d4db Improve moe reduce sum kernel performance (#2705)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-01-02 01:11:06 -08:00
kk
b6e0cfb5e1 ROCm base image update (#2692)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-01-01 12:12:19 +08:00
Lianmin Zheng
03d5fbfd44 Release 0.4.1.post3 - upload the config.json to PyPI (#2647) 2024-12-29 14:25:53 -08:00
Yineng Zhang
3ccf566b0d chore: bump v0.4.1.post2 (#2643) 2024-12-30 00:11:46 +08:00
Yineng Zhang
3464e57b62 minor: add nsys cli for docker dev (#2639) 2024-12-29 17:28:11 +08:00
Yineng Zhang
ef5b0ff90b chore: bump v0.4.1.post1 (#2616) 2024-12-28 00:11:06 +08:00
kk
b438a2e512 Fix triton kernel performance regression (#2611)
Co-authored-by: wunhuang <wunhuang@amd.com>
2024-12-27 15:54:38 +08:00
Yineng Zhang
efc52f85e2 chore: bump v0.4.1 (#2582) 2024-12-26 07:14:51 +08:00
Yineng Zhang
4e1e3cff20 fix #2528 (#2541) 2024-12-22 00:14:41 +08:00
Yineng Zhang
8f4d04e540 chore: bump v0.4.0.post2 (#2525) 2024-12-21 21:16:34 +08:00
Lianmin Zheng
e5f227c0ee Release v0.4.0.post1 (#2375) 2024-12-06 06:08:19 -08:00
Yineng Zhang
f8b0326934 chore: bump v0.4.0 (#2338) 2024-12-03 11:55:41 -08:00
Yineng Zhang
fda628d8f2 fix: resolve cmake url for Dockerfile.dev (#2335) 2024-12-03 21:22:19 +08:00
HAI
0639bf15d1 ROCm Container: set SGLANG_SET_CPU_AFFINITY=1 (#2328) 2024-12-02 23:20:33 -08:00
Yineng Zhang
7301a39b13 fix: resolve CodeQL cpp issue (#2305) 2024-12-01 23:55:19 +08:00
Yineng Zhang
00181098dd feat: add Dockerfile for development (#2289) 2024-12-01 15:27:52 +08:00
Yineng Zhang
fae4e5e99a chore: bump v0.3.6.post3 (#2259) 2024-11-30 01:41:16 +08:00
HAI
b79fffdcb5 Update Install Method 2. From source (#2232) 2024-11-27 22:46:55 -08:00