Skip to content

Pull requests: ModelTC/LightLLM

New pull request New
57 Open 1,060 Closed
57 Open 1,060 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

support ds4
#1355 opened Jun 15, 2026 by WANDY666 Contributor Loading…
feat: add gguf support
#1354 opened Jun 15, 2026 by zhangts20 Loading…
14
feat: add fused moe shared-expert and add-rmsnorm optimization
#1353 opened Jun 15, 2026 by blueswhen Collaborator Loading…
10
feat: enable prefill cudagraph by default
#1352 opened Jun 15, 2026 by sufubao Collaborator Loading…
3
feat: qwen3.5 perf opt
#1351 opened Jun 15, 2026 by blueswhen Collaborator Loading…
10
test(sampling_params): repair broken test collection and add verify() coverage
#1350 opened Jun 13, 2026 by SuperMarioYL Contributor Loading…
6
perf(qwen3next): drop q/k/v/a/b contiguous copies in GDN fused_recurrent decode
#1349 opened Jun 13, 2026 by sufubao Collaborator Loading…
3
fix(visualserver): contain visual worker failures
#1347 opened Jun 13, 2026 by sufubao Collaborator Loading…
6
feat(qwen3_5_mtp): Qwen3.5 / Qwen3.5-MoE MTP speculative decoding
#1338 opened Jun 9, 2026 by sufubao Collaborator Loading…
3
feat: add multi-platform support with ascend and maca
#1335 opened Jun 8, 2026 by zhangts20 Loading…
8
feat: update disk cache params and benchmark_multiturn.py
#1333 opened Jun 8, 2026 by blueswhen Collaborator Loading…
3
Fa4 support
#1327 opened Jun 2, 2026 by blueswhen Collaborator Loading…
10
add in-process URL pool caching
#1325 opened Jun 1, 2026 by Owleye4 Contributor Loading…
3
update cpu cache load use async way.
#1318 opened May 25, 2026 by hiworldwzj Collaborator Loading…
3
support mtp for gemma4
#1316 opened May 22, 2026 by WANDY666 Contributor Loading…
4
fix: replace pickle deserialization with RestrictedUnpickler in PD WebSocket endpoints (CVE-2026-26220)
#1306 opened May 11, 2026 by nexadodigital Loading…
1
3
Propagate FINISHED_ERROR from detokenization init failure
#1299 opened May 9, 2026 by sufubao Collaborator Loading…
6 tasks
2
feat(RL): add RL support for verl
#1298 opened May 8, 2026 by shihaobai Collaborator Loading…
9
import flashqla to speedup gdn prefill
#1295 opened May 8, 2026 by WANDY666 Contributor Loading…
3
import flashqla and support cudagraph for gdn
#1292 opened May 6, 2026 by WANDY666 Contributor Loading…
3
ViT/multimodal token-budget admission + max_pixels clamp
#1290 opened May 6, 2026 by sufubao Collaborator Loading…
3 of 5 tasks
4
Logging colorization + access middleware cleanup + windowed cache stats
#1289 opened May 6, 2026 by sufubao Collaborator Loading…
6 tasks done
9
fix(api): forward extra_body.chat_template_kwargs on /v1/messages
#1276 opened Apr 18, 2026 by sufubao Collaborator Loading…
2 of 3 tasks
[Feature] Add support for Neo++
#1274 opened Apr 17, 2026 by XHPlus Contributor Loading…
3
【draft】Mtp optimization
#1266 opened Apr 9, 2026 by hiworldwzj Collaborator Loading…
6
ProTip! Follow long discussions with comments:>50.