Irregular's Gemini test reached three real companies through an open internet connection
Founders Dan Lahav and Omer Nevo built Irregular to test frontier AI safely; a May configuration error exposed the difficulty of that job.
By RuntimeWire Staff · Published
Primary source: Ars Technica
Why it matters
Irregular's error shows that AI safety evaluations are themselves privileged production systems. As agents gain offensive skills, a bad network rule or reused company name can turn a benchmark into an unauthorized intrusion.
A Gemini evaluation run in May by Dan Lahav (@dan_lahav) and Omer Nevo's Irregular gave Google's models unintended internet access, leading them into systems at three real companies, Google confirmed on September 18th.…
When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.