Beyond the Visual: A Multi-Sensory Digital World
While often framed as a visual medium, digital life engages all our senses. The Institute pioneers sensory anthropology in digital contexts, studying how the haptic feedback of a smartphone, the ambient sound of a notification, the kinesthetic feel of swiping, and the visual aesthetics of an interface collectively shape our emotional, cognitive, and social experiences. We argue that digital interfaces are not neutral conduits of information but sensory environments that discipline our attention, evoke feelings, and create embodied habits. Our research uses phenomenological methods, often combined with design probes and sensory journals, to document the intimate, felt experience of interacting with technology throughout the day.
Key Sensory Modalities and Their Cultural Coding
We break down the sensory dimensions of digital interaction:
- Haptics and Tactility: The programmed vibrations of a phone—a short buzz for a text, a long pulse for a call—create a language of the skin. We study how this tactile language is learned and how it creates a constant, low-level somatic connection to the digital world. The satisfying 'click' of a mechanical keyboard or the smooth glide of a trackpad also contribute to a sense of control or pleasure.
- Digital Soundscapes: The pings, chimes, and ringtones that populate our sonic environment are not just signals; they carry affective weight. A WhatsApp tone can induce anxiety if associated with a demanding boss. We study the personalization of soundscapes and the cultural meanings attached to different notification sounds. The rise of ASMR (Autonomous Sensory Meridian Response) videos highlights a deliberate quest for digitally-mediated sensory pleasure.
- Visual Aesthetics and Affordances: The color palette, typography, and layout of an app (e.g., the calming blues of a meditation app vs. the urgent reds of a news app) directly influence mood and behavior. Skeuomorphic design (making digital objects look like real ones) versus flat design represents different cultural moments in our relationship to technology.
- Embodied Rituals: The physical rituals of charging a device, putting in earbuds, or the 'phone fidget' are incorporated into daily life, becoming new embodied habits that signify states like 'available,' 'focused,' or 'anxious.'
Sensory Design, Accessibility, and Exclusion
Our research has practical implications for inclusive design. A sensory anthropology perspective highlights how standard interfaces often presume normative sensory abilities. We work with disabled communities to understand how alternative sensory pathways—screen readers for the blind, haptic navigation for the deafblind, motion controls for those with limited mobility—create different digital experiences and forms of knowledge. This reveals that there is no single 'human' way to experience the digital; it is always culturally and sensorially mediated.
We also study emerging immersive technologies like Virtual and Augmented Reality, which aim to fully engage the sensorium. In VR, the disconnect between visual motion and inner-ear stillness can cause nausea, a literal embodied conflict. The design of social VR spaces involves creating avatars with proxemics (personal space) and gesture, importing culturally specific sensory norms into digital space. By foregrounding the sensory, we challenge the mind-body dualism that often underpins discussions of the 'virtual.' We demonstrate that digital experience is always embodied, material, and affective. This understanding is crucial for designing technologies that are more humane, accessible, and attuned to the full richness of human perception, ultimately creating digital environments that support, rather than diminish, our embodied being in the world.