NEAR AI says SGLang flaw let attacker into its infrastructure, including a server handling confidential-mode requests

The company says the attacker could have seen requests on one inference server, including ones running in confidential mode.

By · Published

Primary source: near.ai

Why it matters

NEAR markets confidential inference as protection for user data, and its report says a flaw in the open-source inference engine reached requests inside that environment.

A gloved hand grips a metal latch on a perforated server cabinet, with cables and indicator lights behind it.

NEAR AI said an attacker exploited a vulnerability in the open-source SGLang inference engine to run code on one of its servers and gain access to its infrastructure.

In a Nov. 9th incident report, the company said it had fixed the vulnerability on its servers and reported it to the SGLang project. The report did not identify the flaw, confirm an upstream fix or establish whether a fix was available to other SGLang operators.…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Reader comments

Conversation for this story loads after sign-in.