Skip to content

Pull requests: mlc-ai/mlc-llm

New pull request New
18 Open 1,668 Closed
18 Open 1,668 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[KVCache] Per Layer Sliding Window
#3248 opened Jun 10, 2025 by joshua-j-hong Loading…
1
Add support for gemma3_instruction to genconfig
#3224 opened May 9, 2025 by akshatsehgal Loading…
[CLI] Report KV cache memory usage in mlc_llm compile
#3221 opened May 4, 2025 by CharlieFRuan Loading…
Perf: load weights, create KV cache, initialize tokenizer in parallel
#3215 opened Apr 27, 2025 by Bekaboo Loading…
[Refactor] PagedKVCache spec for MLC-LLM
#3203 opened Apr 14, 2025 by annanyapr Loading…
Update mlc_llm.rst correcting for mlc from mlc_llm
#3196 opened Apr 7, 2025 by agrajagco Loading…
1
[Serving] Support tool function calls under strict format constraints
#3190 opened Mar 26, 2025 by Irfnfnkemed Loading…
3
[Serving] Add Structural-Tag api to RequestResponseFormat
#3187 opened Mar 24, 2025 by Irfnfnkemed Loading…
Refactored random.h to have PhiloxRandomGenerator
#3181 opened Mar 18, 2025 by annanyapr Loading…
[Model] Qwen-2-VL Support
#3125 opened Feb 10, 2025 by nihalgeorge01 • Draft
5
[CPP_CLI] MLC Cli App over JSONEngine interface
#3114 opened Jan 30, 2025 by srkreddy1238 Loading…
@MasterJH5574 @mengshyu
5
[Bench] Add support for multiple backend
#3037 opened Nov 20, 2024 by cyx-6 • Draft
[SERVE][CPP][Android] add native executable program to benchmark models
#2987 opened Oct 18, 2024 by pfk-beta Loading…
[Model] Add use_qk_norm option for Cohere model
#2877 opened Sep 2, 2024 by tlopex Loading…
4
[Serving] PagedKVCache Quantization
#2663 opened Jul 16, 2024 by davidpissarra Loading…
12
[Bench] Add bench for GSM8K eval
#2585 opened Jun 16, 2024 by Hzfengsy Loading…
[Bench] Add bench for MMLU eval
#2584 opened Jun 16, 2024 by Hzfengsy Loading…
Add docker container support
#1271 opened Nov 15, 2023 by Sing-Li Loading…
@junrushao
5
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.