GPT-6 Astra reads spectrograms as sound

A user test suggests OpenAI's image-only input can infer audio from visual frequency patterns, four days after Astra's release.

By · Published

Primary source: X

Why it matters

Astra's ability to reason over visual representations of unsupported data could widen how developers use general models, while the tiny test set and corrected answer show why demonstrations still need controlled evaluation.

GPT-6 Astra reads spectrograms as sound, though the lightsaber took a hint

OpenAI's GPT-6 Astra identified a dog bark from a mel spectrogram without receiving the underlying audio, then recognized a lightsaber sound from a second image after its first answer missed the mark.

https://x.com/maxxrubin_/status/2096892510241268094

…

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Reader comments

Conversation for this story loads after sign-in.