top of page

SoTA : State of the Art

SoTA. XD Lab, 2024

Multi-Device Web Artwork, Mobile interaction 

4 displays, 2 projections, 4-channel sound

KAIST Art Museum

SoTA, created by XD Lab at KAIST

SoTA is a fully interactive, immersive audio-visual artwork that translates AI architectures into a multi-sensory experience. Its aim is to make the invisible visible, transforming the unfathomable complexity of AI into a powerful experience.

State-of-the-Art (SoTA) refers to cutting-edge AI models, analogous to achieving an artistic pinnacle. Early SoTA architectures (CNN/RNN) were designed to mimic human cognition, echoing the representational approach. Yet, as Rich Sutton’s “Bitter Lesson” argues, ever-growing GPU power now eclipses human-designed intricacies, nudging SoTA from carefully crafted forms toward vast, computation-driven abstractions.

This shift parallels how art moved from representation into Modernism’s more abstract modes, especially after photography’s rise. A century ago, Benjamin spotted the profound influence of mechanical reproduction on aesthetics. Decades later, abstract expressionism emerged at the extreme of modernism, epitomised by Pollock’s action paintings and Greenberg’s emphasis on flatness. Likewise, today’s AI reproduction propels neural networks beyond human comprehension—a realm of “AI for AI’s sake”—hintable from Eric Schmidt’s warning.

SoTA is an XAI (Explainable AI)-driven interactive multi-device web artwork that makes our evolving metaphor tangible. Two projectors, four monitors, and audiences’ mobiles present 118 neural architectures in a 3D, interactive, and representational form—initially mirroring SoTA’s earlier pre-modernist era (the Frontend). Using their own phone, the audience enters the artwork and vividly interacts with neural network models. This experience is mesmerizing, intuitively and beautifully rendering the structure of deep neural networks.

But once audiences stop interacting and leave the site, unprecedentedly, the screens flip to chaotic monochrome visuals that abstractly depict LLM token cross-similarities (the Backend). Like Pollock’s expressive drips, the swirling lines of connectionism immerse audiences in a vortex of high-dimensional complexity no longer fathomable to us. In an instant, the audience loses the interaction they just had with the artwork and loses their sense of control.

SoTA reveals how AI can reshape society, identity, and creativity. It questions whether massive models will foster inclusive, human-centred progress or slip into self-referential abstraction—a Black Box. By uncovering AI’s hidden layers, SoTA urges us to reflect on the implications of State-of-the-Artificial Intelligence and responsibly guide these systems.

SoTA

State-of-the-Art

Multi-Device Web Artwork, Mobile interaction 

4 displays, 2 projections, 4-channel sound

 

Created by

XD Lab (Experience Design Lab)

Department of Industrial Design, KAIST

Concept Design, Visualization, Software Development: Jeanyoon Choi

Sound Design: Euan Kang

Avatar Design: Sejoon Park

UI Design: Minhyeok Seo

Artistic Director, Advisor: Prof. Yiyun Kang

Tech Stack

Next.js, Three.js, Socket.io, Gemini, Claude 3.5, OpenAI API, Langchain, TouchDesigner, Blender, Ableton Live, Viseme, D3.js

Anchor 1
LightArchitecture_research.png

Inspiration for SoTA

AI architecture models and diagrams.

Neural Network Zoo, Asimov Institute (2016)  Transformer Architecture, Google Brain (2017)

SoTA diagram.png

The physical multi-device layout of the SoTA installation,

four screens and projector outputs indicated on an actualexhibition image.

SoTA. XD Lab, 2024

Installation View

4 displays, 2 projections, 4-channel sound

KAIST Art Museum

SoTA. XD Lab, 2024

Visualisations of Neural network models

SoTA. XD Lab, 2024

Backend images abstractly represents

the operating principle of an LLM (Large Language Model).

SoTA. XD Lab, 2024

Backend images abstractly represents

the operating principle of an LLM (Large Language Model).

bottom of page