Summary
CVE-2026-92983 is a resource-exhaustion vulnerability (CWE-772: Missing Release of Resource after Effective Lifetime) affecting InternLM’s LMDeploy LLM inference toolkit when deployed with DistServe prefill/decode disaggregation. An unauthenticated attacker can send ordinary completion requests to the DistServe proxy that cause the prefill engine to accumulate unreleased scheduler metadata, eventually exhausting memory and crashing the prefill worker. The flaw carries a CVSS v4.0 base score of 8.7 (High), reflecting its network-based, no-privilege, no-user-interaction denial-of-service impact.
Technical details
- Root cause: The DistServe proxy tracks sessions using the user-facing/response session ID (
remote_session_id) instead of the internal scheduler key that actually owns the preserved sequence/cache metadata on the prefill engine. - Trigger conditions: Standard traffic to the proxy’s
/v1/completionsendpoint in DistServe (prefill/decode disaggregation) mode is sufficient — no malformed input or authentication is required. Each request is split into a prefill and a decode phase; when the decode side later issues a "free cache" request using the mismatched session ID, the prefill engine logs an "invalid free" and never releases the associated metadata. - Attack vector: Network (AV:N), low attack complexity, no privileges or user interaction required.
- Impact: Sustained/repeated requests cause unbounded growth of prefill-side scheduler sessions, sequences, and
seq_mapentries, driving continuous RSS growth until the prefill engine process is killed by an out-of-memory condition. The DistServe container may appear to be running while it is unresponsive, and health checks can begin failing (HTTP 503), leading to proxy node loss and service degradation/denial of service for all users of the deployment.
Affected software
- InternLM LMDeploy (PyPI package
lmdeploy) — all versions through 0.17.0 when running in DistServe (prefill/decode disaggregation) mode. - Standard (non-disaggregated) LMDeploy deployments that do not use DistServe are not affected by this specific issue.
Severity
- CVSS v4.0: 8.7 (High) —
CVSS:4.0/AV:N/AC:L/AT:N/PR:N/UI:N/VC:N/VI:N/VA:H/SC:N/SI:N/SA:N - CVSS v3.1 (equivalent): 7.5 (High) —
CVSS:3.1/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
Mitigation and recommended actions
- Immediate: As of this writing, no patched LMDeploy release addressing this specific DistServe session-tracking flaw has been published (the latest available release is 0.17.0, which remains vulnerable). Monitor the InternLM LMDeploy GitHub repository and upgrade to a fixed release as soon as one is issued.
- If no patch is available:
- Restrict network access to the DistServe proxy and its
/v1/completionsendpoint to trusted clients only (e.g., via network segmentation, firewall rules, or an authenticating reverse proxy) rather than exposing it directly to the internet. - Monitor prefill worker memory (RSS) usage and configure alerting/auto-restart on abnormal growth to reduce the impact of an exhaustion event.
- Consider disabling DistServe prefill/decode disaggregation mode where it is not operationally required, reverting to standard serving mode until a fix is available.
- Apply rate limiting on completion requests reaching the proxy to slow the rate of metadata accumulation.
- Restrict network access to the DistServe proxy and its

