GitHub · Where software is built

Labels Milestones New issue

[Bug]: 单卡启动模型成功，调用模型崩溃；多卡启动模型报错

#482

· ZHUHF123 opened

on Dec 4, 2025

[Feature] Provide docker image for easy-deploying xllm

#472

· xueliangyang-oeuler opened

on Dec 2, 2025

[Bug]: DeepSeek-R1 MTP模型 PD分离Decode启动报错

#469

· wilkingwang opened

on Dec 1, 2025

[Feature]: Help xLLM to update usage documents.

Make Your First Contribution

#466

· yq33victor opened

on Dec 1, 2025

[Feature]: Remove some unused code, redundant headers when including, etc.

Make Your First Contribution

#465

· yq33victor opened

on Dec 1, 2025

[Feature]: Support kv cache quantization.

Make Your First Contribution

#464

· yq33victor opened

on Dec 1, 2025

[Feature]: Add 'xllm --help' command to display all flags informations.

Make Your First Contribution

#463

· yq33victor opened

on Dec 1, 2025

[Feature]: Pin xLLM process to the right NUMA Region.

Make Your First Contribution

#462

· yq33victor opened

on Dec 1, 2025

[Feature]: Add an interface for the thread pool to bind cpu-core.

Make Your First Contribution

#461

· yq33victor opened

on Dec 1, 2025

[Feature]: Compute and log the serving FLOPs.

Make Your First Contribution

#460

· yq33victor opened

on Dec 1, 2025

[Feature]: Help xLLM to improve logging for info/warning/error/ messages.

Make Your First Contribution

#459

· yq33victor opened

on Dec 1, 2025

[Feature]: Help xLLM to fix typo.

Make Your First Contribution

#458

· yq33victor opened

on Dec 1, 2025