SoTA : State of the Art
SoTA. XD Lab, 2024
Multi-Device Web Artwork, Mobile interaction
4 displays, 2 projections, 4-channel sound
KAIST Art Museum
SoTA, created by XD Lab at KAIST
SoTA is a fully interactive, immersive audio-visual artwork that translates AI architectures into a multi-sensory experience. Its aim is to make the invisible visible, transforming the unfathomable complexity of AI into a powerful experience.
State-of-the-Art (SoTA) refers to cutting-edge AI models, analogous to achieving an artistic pinnacle. Early SoTA architectures (CNN/RNN) were designed to mimic human cognition, echoing the representational approach. Yet, as Rich Sutton’s “Bitter Lesson” argues, ever-growing GPU power now eclipses human-designed intricacies, nudging SoTA from carefully crafted forms toward vast, computation-driven abstractions.
This shift parallels how art moved from representation into Modernism’s more abstract modes, especially after photography’s rise. A century ago, Benjamin spotted the profound influence of mechanical reproduction on aesthetics. Decades later, abstract expressionism emerged at the extreme of modernism, epitomised by Pollock’s action paintings and Greenberg’s emphasis on flatness. Likewise, today’s AI reproduction propels neural networks beyond human comprehension—a realm of “AI for AI’s sake”—hintable from Eric Schmidt’s warning.
SoTA is an XAI (Explainable AI)-driven interactive multi-device web artwork that makes our evolving metaphor tangible. Two projectors, four monitors, and audiences’ mobiles present 118 neural architectures in a 3D, interactive, and representational form—initially mirroring SoTA’s earlier pre-modernist era (the Frontend). Using their own phone, the audience enters the artwork and vividly interacts with neural network models. This experience is mesmerizing, intuitively and beautifully rendering the structure of deep neural networks.
But once audiences stop interacting and leave the site, unprecedentedly, the screens flip to chaotic monochrome visuals that abstractly depict LLM token cross-similarities (the Backend). Like Pollock’s expressive drips, the swirling lines of connectionism immerse audiences in a vortex of high-dimensional complexity no longer fathomable to us. In an instant, the audience loses the interaction they just had with the artwork and loses their sense of control.
SoTA reveals how AI can reshape society, identity, and creativity. It questions whether massive models will foster inclusive, human-centred progress or slip into self-referential abstraction—a Black Box. By uncovering AI’s hidden layers, SoTA urges us to reflect on the implications of State-of-the-Artificial Intelligence and responsibly guide these systems.
SoTA
State-of-the-Art
Multi-Device Web Artwork, Mobile interaction
4 displays, 2 projections, 4-channel sound
Created by
XD Lab (Experience Design Lab)
Department of Industrial Design, KAIST
Concept Design, Visualization, Software Development: Jeanyoon Choi
Sound Design: Euan Kang
Avatar Design: Sejoon Park
UI Design: Minhyeok Seo
Artistic Director, Advisor: Prof. Yiyun Kang
Tech Stack
Next.js, Three.js, Socket.io, Gemini, Claude 3.5, OpenAI API, Langchain, TouchDesigner, Blender, Ableton Live, Viseme, D3.js
Inspiration for SoTA
AI architecture models and diagrams.
Neural Network Zoo, Asimov Institute (2016) Transformer Architecture, Google Brain (2017)
SoTA. XD Lab, 2024
Installation View
4 displays, 2 projections, 4-channel sound
KAIST Art Museum
SoTA. XD Lab, 2024
Visualisations of Neural network models
SoTA. XD Lab, 2024
Backend images abstractly represents
the operating principle of an LLM (Large Language Model).
SoTA. XD Lab, 2024
Backend images abstractly represents
the operating principle of an LLM (Large Language Model).



















































