Audible Garden: Transcoding Literati Tradition in Landscape Representation Through a Multimodal Approach
Audible Garden
by Youngjun Choi (Ph.D. Candidate), Honggi Lee(MS Student) and professor Jinjoon Lee has been accepted for publication in Leonardo (2025, forthcoming).
[Abstract]
This paper analyzes the integration of East Asian literati traditions with contemporary multimedia through two artworks. It proposes a multimodal transcoding framework converting video frames into multisensory outputs via data-driven visualization and sonification. Using a modified turntable, the system interprets an artificial marble disc, created from the artist's daily creation to depict mental space using sumi ink. This aligns with literati traditions of expressing inner worlds through landscape paintings as contemplative practice. The study explores how translating these embodied practices into multimodal manifestations offers new perspectives in new media art while broadening the representations of landscape in intercultural context.
[Abstract]
This paper analyzes the integration of East Asian literati traditions with contemporary multimedia through two artworks. It proposes a multimodal transcoding framework converting video frames into multisensory outputs via data-driven visualization and sonification. Using a modified turntable, the system interprets an artificial marble disc, created from the artist's daily creation to depict mental space using sumi ink. This aligns with literati traditions of expressing inner worlds through landscape paintings as contemplative practice. The study explores how translating these embodied practices into multimodal manifestations offers new perspectives in new media art while broadening the representations of landscape in intercultural context.