Martin Wattenberg — The Shape of Song

2001

Artists: Martin Wattenberg · Year: 2001 · Medium: Interactive data visualization — musical structure rendered as arc diagrams · Substrate: Custom Java applet; MIDI data; arc-diagram visualization algorithm · Place: Cambridge, Massachusetts, USA · Institution: IBM TJ Watson Research Center (later Google); independent practice Martin Wattenberg's The Shape of Song (2001) is an interactive data visualization that takes a piece of music — classical, popular, or otherwise — and renders its structural repetitions as a diagram of arcs connecting identical passages. Where a sonata repeats a motif, an arc connects the repetition to its original occurrence; where a pop song returns to its chorus, arcs accumulate. The resulting image reveals the architectural shape of the music: how Bach's fugues differ from Britney Spears's choruses, how Philip Glass's minimalism produces near-dense arc fields, how Beethoven's late quartets produce sparse architectures. The Shape of Song was among the first data visualizations to be widely received as art rather than as information design. It appeared in gallery contexts, was acquired by MoMA for its permanent collection, and established Wattenberg as one of the early-2000s figures who could move fluently between academic research, commercial practice (at IBM and later Google), and art-world exhibition. Wattenberg's subsequent career has continued across those three registers. His work with Fernanda Viégas at Google's People + AI Research group has produced many of the most significant interactive visualizations of machine-learning systems. His 2024 book with Viégas — Teaching Machines — is one of the best popular accounts of machine-learning practice. He remains at Google and at Harvard, where he teaches. Lore Wattenberg was at IBM Watson when he made The Shape of Song, working on text-and-data visualization research. The project's Java applet ran in-browser in 2001, when Java-in-browser was still commonly supported; modern versions of the visualization have been reimplemented for contemporary browsers. Wattenberg's partnership with Fernanda Viégas, begun around 2005, is one of the most consistent collaborative research pairings in the field. Sources • Wattenberg, Martin — bewitched.com • MoMA — The Shape of Song collection record • Wattenberg, Martin; Viégas, Fernanda — Teaching Machines (MIT Press, 2024)