More Dimensions, Same Blind Spot: What Embeddings Miss in 25 Years of Queens of the Stone Age

TL;DR, ordered by how much I trust each finding Solid: every embedding I tested (6 representations, 8 OpenAI dimension variants) detects that later lyrics stop returning to earlier stanzas. That is mostly the refrain disappearing. Solid, and negative: none of them detects the direction a song takes, or tells apart the songs where readers see an argument. 256 dimensions see what 3,072 see. Strong lead: the band’s topics barely move in 25 years; how it handles them does. Songs with an arc rise from 2 of 34 to 11 of 29. Exploratory: half of those arcs are open: offers and promises the lyric never resolves. Embeddings are good at telling you what a text is about. They are also good at noticing when a text repeats itself. What they lose is the relation between two passages: who does what to whom, in what order, and on what condition. Giving the vector more dimensions does not bring that relation back. ...

November 3, 2026 · 18 min

When Lyrics Change Language: An Embedding Study of Aquamosh

A song can change language while continuing an image, a joke, or an argument. It can also stay in one language while changing subject. Aquamosh, by Plastilina Mosh, offers a setting for asking how a similarity-based representation handles those possibilities. The question is narrower than whether a model understands the album: how do thresholded embedding similarities vary with language transitions, and where do they disagree with another model’s reading? What changed in this revision The previous title claimed a falsification of the distributional hypothesis. Its interpretation also treated GPT-4o-mini as equivalent to a human reference and generalized the results to commercial recommendation, moderation, and support systems. Those claims exceed the evidence available from this experiment and are withdrawn. ...

May 20, 2026 · 6 min · Updated September 27, 2026