Hiroshi IshiiProfessor

Hiroshi Ishii
Jerome B. Wiesner Professor of Media Arts and Sciences
Associate Director of MIT Media Laboratory
Director of Tangible Media Group
Massachusetts Institute of Technology
Publications (Google Scholar)
Hiroshi Ishii is the Jerome B. Wiesner Professor of Media Arts and Sciences at the MIT Media Laboratory. After joining the Media Lab in October 1995, he founded the Tangible Media Group to make digital tangible by giving physical form to digital information and computation. Here, he pursues his visions of Tangible Bits (1997) and Radical Atoms (2012) that will transcend the Painted Bits of GUIs (Graphical User Interfaces), the current dominant paradigm of HCI (Human-Computer Interaction).
He is recognized as a founder of “Tangible User Interfaces (TUI),” a new research genre based on the CHI ’97 “Tangible Bits” paper presented with Brygg Ullmer in Atlanta, Georgia, which led to the spinoff ACM International Conference on Tangible, Embedded and Embodied Interaction (TEI) from 2007. In addition to academic conferences, “Tangible Bits” was exhibited at the NTT ICC (2000) in Tokyo, Japan, at the Ars Electronica Center (2001-2003) in Linz, Austria, and many other international arts & design venues. For his Tangible Bits work, he was awarded tenure from MIT in 2001, and elected to the CHI Academy in 2006.
In 2012, he presented his new vision of “Radical Atoms” to leap beyond “Tangible Bits” by assuming a hypothetical generation of materials that can change form and properties dynamically and computationally, becoming as reconfigurable as pixels on a GUI screen. His team’s Radical Atoms works, including Shape Displays and Programmable Materials, contributed to form the new stream of “Shape-Changing UI” research in the HCI community. His “Radical Atoms” vision was selected as the overarching theme of Ars Electronica Festival 2016, with the subtitle “The Alchemists of our Time.” Ishii’s team ran a 3 year long Radical Atoms Exhibition at the Ars Electronica Center, which has been extended to run through the summer of 2019.
Ishii and his team have presented their visions of “Tangible Bits” and “Radical Atoms” at a variety of academic, design, and artistic venues (including ACM SIGCHI, ACM SIGGRAPH, Industrial Design Society of America, AIGA, Ars Electronica, ICC, Centre Pompidou, Victoria and Albert Museum, Cooper Hewitt Design Museum, Milan Design Week) emphasizing that the design of engaging and inspiring tangible interactions requires the rigor of both scientific and artistic review, encapsulated by his motto, “Be Artistic and Analytic. Be Poetic and Pragmatic.”
In 2019, he won SIGCHI Lifetime Research Award for his fundamental and influential research contributions to the field of human-computer interaction in the past quarter century.
Prior to joining the MIT Media Lab, Ishii led the CSCW (Computer-Supported Cooperative Work) research group at NTT Human Interface Laboratories Japan from 1988-1994, where he and his team invented the TeamWorkStation (1990) and ClearBoard (1992). He received a B.E. degree in electronic engineering, and M.E. and Ph.D. degrees in computer engineering from Hokkaido University, Japan, in 1978, 1980 and 1992, respectively.

Projects

aSpire

aSpire

inDepth

inDepth

Therms-Up!

Therms-Up!

HERMITS

HERMITS

DefeXtiles

DefeXtiles

KI/OSK

KI/OSK

Prototyping Interactive Fluidic Mechanisms

Prototyping Inter...

WraPr: Spool-Based Fabrication for Object Creation and Modifcation

WraPr: Spool-Base...

TRANS-DOCK

TRANS-DOCK

Venous Materials

Venous Materials

ambienBeat

ambienBeat

SCALE

SCALE

reSpire: Self-awareness and Interpersonal Connectedness through Shape-changing Fabric Display

reSpire: Self-awa...

SociaBowl: A Dynamic Table Centerpiece to Mediate Group Conversations

SociaBowl: A Dyna...

Bubble Talk

Bubble Talk

inFORCE

inFORCE

SensorKnits: Architecting textile sensors with machine knitting

SensorKnits: Arch...

milliMorph

milliMorph

kinetiX - Designing Auxetic-inspired Deformable Material Structures

kinetiX - Designi...

Programmable Droplets for Interaction

Programmable Drop...

Programmable Droplets

Programmable Drop...

reMi

reMi

Hacking Manufacturing

Hacking Manufactu...

AnimaStage

AnimaStage

Simulation of Transformable Material Structures

Simulation of Tra...

Printflatables

Printflatables

Auto-Inflatables

Auto-Inflatables

ChainFORM

ChainFORM

aeroMorph

aeroMorph

Materiable

Materiable

xPrint

xPrint

Haptic Edge Display

Haptic Edge Displ...

SoundFORM

SoundFORM

Pneuduino

Pneuduino

HydroMorph

HydroMorph

Phixels

Phixels

LineFORM

LineFORM

Exoskin

Exoskin

TRANSFORM as Dynamic and Adaptive Furniture

TRANSFORM as Dyna...

Sticky Actuator

Sticky Actuator

Linked-Stick

Linked-Stick

Bio-actuators: bioLogic

Bio-actuators: bi...

uniMorph

uniMorph

Kinetic Blocks

Kinetic Blocks

bioLogic Media Lab Exhibition

bioLogic Media La...

inFORM at Cooper Hewitt

inFORM at Cooper ...

Physical Telepresence

Physical Telepres...

bioPrint

bioPrint

TRANSFORM

TRANSFORM

jamSheets

jamSheets

Weight/Volume Changing UI

Weight/Volume Cha...

Andante

Andante

inSide

inSide

THAW

THAW

inFORM

inFORM

PneUI

PneUI

synchroLight

synchroLight

Sublimate

Sublimate

MirrorFugue

MirrorFugue

Perpetual Canon

Perpetual Canon

Tangible CityScape

Tangible CityScape

FocalSpace

FocalSpace

Radical Atoms

Radical Atoms

Jamming User Interfaces

Jamming User Inte...

T(ether)

T(ether)

Kinected Conference

Kinected Conferen...

MirrorFugue II

MirrorFugue II

Recompose

Recompose

ZeroN: Levitated Interaction Element

ZeroN: Levitated ...

OnObject

OnObject

IdeaGarden

IdeaGarden

Relief

Relief

Idea Hatchery

Idea Hatchery

Trackmate

Trackmate

g-stalt

g-stalt

Gestural Interaction

Gestural Interact...

Beyond - Collapsible Input Device for 3D Direct Manipulation

Beyond - Collapsi...

PY-ROM

PY-ROM

FretNot

FretNot

External Legibility

External Legibili...

GrabIt

GrabIt

Picture This!

Picture This!

Touch·Sensitive

Touch·Sensitive

Jabberstamp

Jabberstamp

Slurp

Slurp

SpeakCup

SpeakCup

Senspectra

Senspectra

Disaster Simulation

Disaster Simulati...

Remix+Robo Topobo

Remix+Robo Topobo

AR-Jig

AR-Jig

SP3X

SP3X

Psychohaptics

Psychohaptics

BodyBeats

BodyBeats

Glume

Glume

PICO

PICO

Topobo Backpacks

Topobo Backpacks

I-Camera

I-Camera

I/O Brush

I/O Brush

AirportSim

AirportSim

CircuitTUI

CircuitTUI

Topobo

Topobo

Tangible Business Process Analyzer

Tangible Business...

Pins

Pins

egaku

egaku

IP Network Design Workbench

IP Network Design...

Super Cilia Skin

Super Cilia Skin

Plant Sensors

Plant Sensors

Vehicle Safety Sensor

Vehicle Safety Se...

Tangible Video Browser

Tangible Video Br...

Phoxel Space

Phoxel Space

Illuminating Clay

Illuminating Clay

ComTouch

ComTouch

Supply Chain Visualization

Supply Chain Visu...

Audiopad

Audiopad

Sensetable

Sensetable

Tangible query interfaces

Tangible query in...

Actuated Workbench

Actuated Workbench

Ars Electronica 2001-03 Get in Touch Exhibition

Ars Electronica 2...

Dolltalk

Dolltalk

CADcast

CADcast

PegBlocks

PegBlocks

LumiTouch

LumiTouch

Senseboard

Senseboard

genieBottles

genieBottles

Tangible Viewpoints

Tangible Viewpoin...

TellTale

TellTale

Urban Simulation

Urban Simulation

pinwheels

pinwheels

bottlogues

bottlogues

Strata

Strata

GeoSCAPE

GeoSCAPE

Triangles and Narratives

Triangles and Nar...

musicBottles

musicBottles

TouchCounters

TouchCounters

curlybot

curlybot

HandSCAPE

HandSCAPE

Personal Ambient Display

Personal Ambient ...

musicbox

musicbox

mediaBlocks

mediaBlocks

I/O Bulb and Luminous Room

I/O Bulb and Lumi...

Triangles

Triangles

inTouch

inTouch

PSyBench

PSyBench

PingPongPlus

PingPongPlus

FishFace

FishFace

Ambient Fixtures

Ambient Fixtures

Expressive KineticObjects

Expressive Kineti...

metaDESK

metaDESK

ambientROOM

ambientROOM

transBOARD

transBOARD

mediaFlow

mediaFlow

Proxy-Distributed Computation

Proxy-Distributed...

Tangible Bits

Tangible Bits

Bricks

Bricks

ClearBoard

ClearBoard

TeamWorkStation

TeamWorkStation

Papers

Therms-Up!: DIY Inflatables and Interactive Materials by Upcycling Wasted Thermoplastic BagsACM TEI 2021 2021
inDepth: Force-based Interaction with Objects beyond A Physical BarrierACM TEI 2021 2021
aSpire: Clippable, Mobile Pneumatic-Haptic Device for Breathing Rate Regulation via Personalizable Tactile FeedbackACM CHI EA 2021 2021
HERMITS: Dynamically Reconfiguring the Interactivity of Self-propelled TUIs with Mechanical Shell Add-onsUIST 2020
DefeXtiles: 3D Printing Quasi-Woven Fabric via Under-ExtrusionUIST 2020
KI/OSK: Practice Study of Load Sensitive Board for Farmers MarketCHI 2020
ambienBeat:Wrist-worn Mobile Tactile Biofeedback for Heart Rate Rhythmic RegulationTEI 2020
TRANS-DOCK: Expanding the Interactivity of Pin-based Shape Displays by Docking Mechanical TransducersTEI 2020
WraPr: Spool-Based Fabrication for Object Creation and ModificationTEI 2020 2020
Prototyping Interactive Fluidic MechanismsTEI 2020
Venous Materials: Towards Interactive Fluidic MechanismsCHI 2020
milliMorph - Fluid-Driven Thin Film Shape-Change Materials for Interaction Design UIST 2019 2019
SCALE: Enhancing Force-based Interaction by Processing Load Data from Load Sensitive ModulesUIST 2019 2019
reSpire: Self-awareness and Interpersonal Connectedness through Shape-changing Fabric Display ACM C&C and DIS 2019 2019
SociaBowl: A Dynamic Table Centerpiece to Mediate Group ConversationsCHI 2019 2019
Bubble Talk: Open-source Interactive Art Toolkit for Metaphor of Modern Digital ChatTEI 2019 2019
inFORCE: Bi-directional 'Force' Shape Display For Haptic InteractionTEI 2019
SensorKnits: Architecting textile sensors with machine knitting3D Printing and Additive Manufacturing 2019
Auto-Inflatables: Chemical Inflation for Pop-Up FabricationCHI 2019 2019
AUFLIP - An Auditory Feedback System Towards Implicit Learning of Advanced Motor SkillsCHI 2019 2019
reMi: Translating Ambient Sounds of Moment into Tangible and Shareable Memories through Animated PaperUIST 2018 2018
KinetiX - Designing Auxetic-inspired Deformable Material StructuresComputer & Graphics 2018
Programmable Droplets for InteractionCHI 2018 2018
Scaling Electrowetting with Printed Circuit Boards for Large Area Droplet ManipulationMRS Advances 2018
Mediate: A Spatial Tangible Interface for Mixed Reality (paper)CHI 2018 2018
Mediate: A Spatial Tangible Interface for Mixed Reality (poster)CHI 2018 2018
Hygromorphic living materials for shape changingRobotic Systems and Autonomous Platforms: Advances in Materials and Manufacturing 2018
Designing Line-Based Shape-Changing InterfacesIEEE Pervasive Computing 2017
AnimaStage: Hands-on Animated Craft on Pin-based Shape DisplaysDIS 2017 2017
Harnessing the hygroscopic and biofluorescent behaviors of genetically tractable microbial cells to design biohybrid wearablesScience Advances 2017
Transformative Appetite: Shape-Changing Food Transforms from 2D to 3D by Water Interaction through CookingCHI 2017 2017
ChainFORM: A Linear Integrated Modular Hardware System for Shape Changing InterfacesUIST 2016
aeroMorph - Heat-sealing Inflatable Shape-change Materials for Interaction DesignUIST 2016
Inspect, Embody, Invent: A Design Framework for Music Learning and BeyondCHI 2016
Cilllia - 3D Printed Micro-Pillar Structures for Surface Texture, Actuation and SensingCHI 2016
xPrint: A Modularized Liquid Printer for Smart Materials DepositionCHI 2016
Haptic Edge Display for Mobile Tactile InteractionCHI 2016
SoundFORMS: Manipulating Sound Through TouchCHI 2016
Materiable: Rendering Dynamic Material Properties in Response to Direct Physical Touch with Shape Changing InterfacesCHI 2016
Inflated CuriosityTEI 2016
Inflated CuriosityTEI 2016
HydroMorph: Shape Changing Water Membrane for Display and Interaction TEI 2016
bioPrint: A Liquid Deposition Printing System for Natural Actuators 3D Printing and Additive Manufacturing 2015
LineFORM: Actuated Curve Interfaces for Display, Interaction, and ConstraintUIST 2015
uniMorph - Fabricating Thin Film Composites for Shape-Changing InterfacesUIST 2015
Shape Displays: Spatial Interaction with Dynamic Physical Form
Methods of 3D Printing Micro-pillar Structures on SurfacesUIST 2015
Exoskin: Pneumatically Augmenting Inelastic Materials for Texture Changing Interfaces
TRANSFORM: Embodiment of “Radical Atoms” at Milano Design WeekCHI 2015
bioLogic: Natto Cells as Nanoactuators for Shape Changing InterfacesCHI 2015
Sticky Actuator: Free-Form Planar Actuators for Animated ObjectsTEI 2015
TRANSFORM as Adaptive and Dynamic FurnitureCHI 2015
Linked-Stick: Conveying a Physical Experience using a Shape-Shifting StickCHI 2015
bioLogic: Natto Cells as Nanoactuators for Shape Changing InterfacesCHI 2015
Physical Telepresence: Shape Capture and Display for Embodied, Computer-mediated Remote CollaborationUIST 2014
AnnoScape: Remote Collaborative Review Using Live Video Overlay in Shared 3D Virtual WorkspaceSUI 2014
T(ether): Spatially-Aware Handhelds, Gestures and Proprioception for Multi-User 3D Modeling and AnimationSUI 2014
bioPrint: An automatic deposition system for Bacteria Spore ActuatorsUIST 2014
Andante: Walking Figures on the Piano Keyboard to Visualize Musical MotionNIME 2014
jamSheets: Thin Interfaces with Tunable Stiffness Enabled by Layer Jamming TEI 2014
Weight and Volume Changing Device with Liquid Metal TransferTEI 2014
Integrating Optical Waveguides for Display and Sensing on Pneumatic Soft Shape Changing InterfacesUIST 2014
inFORM: Dynamic Physical Affordances and Constraints through Shape and Object ActuationUIST 2013
FocalSpace: Multimodal Activity Tracking, Synthetic Blur and Adaptive Presentation for Video ConferencingSUI 2013
Sublimate: State-Changing Virtual and Physical Rendering to Augment Interaction with Shape DisplaysCHI 2013
synchroLight: Three-dimensional Pointing System for Remote Video CommunicationCHI 2013
exTouch: Spatially-Aware Embodied Manipulation of Actuated Objects Mediated by Augmented RealityTEI 2013
PneUI: Pneumatically Actuated Soft Composite Materials for Shape Changing InterfacesUIST 2013
MirrorFugue III: Conjuring the Recorded PianistNIME 2013
Towards Radical Atoms – Form-giving to Transformable MaterialsCofInfoCom '12 2012
Second surface: multi-user spatial collaboration system based on augmented realityACM Transactions on Information Systems (TOIS) archive 2012
Jamming User Interfaces: Programmable Particle Stiffness and Sensing for Malleable and Shape-Changing Devices.UIST 2012
Point and share: from paper to whiteboardUIST 2012
rainBottles: gathering raindrops of data from the cloudCHI 2012
KidCAD: digitally remixing toys through tangible toolsCHI 2012
People in books: using a FlashCam to become part of an interactive book for connected readingCSCW 2012
MirrorFugue2: Embodied Representation of Recorded Piano Performances
ZeroN: Mid-air Tangible Interaction Enabled by Computer-Controlled Magnetic LevitationUIST 2011
Rope Revolution: Tangible and Gestural Rope Interface for Collaborative PlayAdvances in Computer Entertainment 2011
Duet for Solo Piano: MirrorFugue for Single User Playing with Recorded PerformancesCHI 2011
Multi-Jump: Jump Roping Over DistancesCHI 2011
RopePlus: Bridging Distances with Social and Kinesthetic Rope GamesCHI 2011
Direct and Gestural Interaction with Relief: A 2.5D Shape DisplayUIST 2011
Kinected Conference: Augmenting Video Imaging with Calibrated Depth and AudioCSCW 2011
MirrorFugue: Communicating Hand Gesture in Remote Piano CollaborationTEI 2011
Recompose: Direct and Gestural Interaction with an Actuated SurfaceCHI 2011
deFORM: An Interactive Malleable Surface For Capturing 2.5D Arbitrary Objects, Tools and TouchUIST 2011
OnObject: gestural play with tagged everyday objectsUIST '10 2010
CopyCAD: remixing physical objects with copy and paste from the real worldUIST '10 2010
Construction by replacement: a new approach to simulation modelingSyst. Dyn. Rev. 2010
Beyond: collapsible tools and gestures for computational designCHI 2010
Relief: A Scalable Actuated Shape DisplayTEI 2010
g-stalt: a chirocentric, spatiotemporal, and telekinetic gestural interface.TEI 2010
Bosu: a physical programmable design tool for transformability with soft mechanicsDIS '10 2010
tangible interfaces for art restorationInternational Journal of Creative Interfaces and Computer Graphics 2010
Ubiquitous Computing in Chaos and Tangible Bits (in Japanese) 混迷するユビキタスの未来とタンジブル・ビットNext Generation Service Forum 2009
MIT: Creation, Collaboration and Competition (in Japanese) 米国MITの独創・協創・競創の風土IEICE 電子情報通信学会 2009
Fusing Computation into Mega-Affordance ObjectsCHI 2009 2009
Stop-Motion Prototyping for Tangible InterfacesTEI 2009
Spime Builder: A Tangible Interface for Designing Hyperlinked ObjectsTEI 2009
Piezing: a garment harvesting energy from the natural motion of the human bodyTEI '09 2009
Kinetic sketchup: motion prototyping in the tangible design processTEI '09 2009
Design of Haptic Interfaces for PsychotherapyCHI 2009
Play-it-by-eye! Collect Movies and Improvise Perspectives with Tangible Video Objects. Artificial Intelligence for Engineering Design, Analysis and Manufacturing (AIEDAM) 2009
Picture This! Film assembly using toy gesturesUBICOMP 2008
Handsaw: Tangible Exploration of Volumetric Data by Direct Cut-Plane Projection CHI 2008 Proceedings 2008
Renaissance Panel: The Roles of Creative Synthesis in InnovationCHI 2008 Panel 2008
Future Craft: How Digital Media is Transforming Product DesignCHI 2008 Extended Abstracts 2008
Slurp: Tangibility, Spatiality, and an Eyedropperalt.chi 2008 2008
SpeakCup: Simplicity, BABL, and Shape ChangeTEI 2008 2008
AR-Jig: A Handheld Tangible User Interface for 3D Digital Modeling (in Japanese)Journal of the Virtual Reality Society of Japan 2008
Tangible Bits: Beyond PixelsTEI 2008 2008
Electromagnetic Field Detector Bracelet Ubicomp 2008 2008
Simplicity in Interaction DesignTEI 2007
Zstretch: A Stretchy Fabric Music ControllerNIME 2007
AR-Jig: A Handheld Tangible User Interface for Modification of 3D Digital Form via 2D Physical CurveISMAR 2007
Interfacing Video Capture, Editing and Publication in a Tangible EnvironmentINTERACT 2007
Senspectra: A Computationally Augmented Physical Modeling Toolkit for Sensing and Visualization of Structural StrainCHI 2007
Jabberstamp: Embedding sound and voice in traditional drawingsIDC 2007
Remix and Robo: Improvisational performance and competition with modular robotic building toysSIGGRAPH 2007
Mechanical Constraints as Computational Constraints in Tabletop Tangible InterfacesCHI 2007 2007
Jabberstamp: embedding sound and voice in traditional drawings SIGGRAPH 2007
Remix and Robo: sampling, sequencing and real-time control of a tangible robotic construction systemIDC 2007
Interaction Techniques for Musical Performance with Tabletop Tangible InterfacesAdvances in Computer Entertainment 2006
Glume: Exploring Materiality in a Soft Augmented Modular ModelingExtended Abstracts of Conference on Human Factors in Computing Systems 2006
3D and Sequential Representations of Spatial Relationships among PhotosCHI 2006
Beyond Record and Play: Backpacks: Tangible Modulators for Kinetic BehaviorCHI 2006
Interaction Techniques for Musical Performance with Tabletop Tangible InterfacesACE 2006
Bottles: A Transparent Interface as a Tribute to Mark WeiserIEICE TRANSACTIONS on Information and Systems Vol.E87-D No.6 pp.1299-1311 2004
Topobo: A Constructive Assembly System with Kinetic MemoryCHI 2004
A Tangible Interface for Organizing Information Using a GridCHI 2002
Audiopad: A Tag Based Interface for Musical PerformanceNIME 2002
Dolltalk: a computational toy to enhance children's creativityCHI 2002
Pinwheels: Visualizing Information Flow in an Architectural SpaceCHI 2001
Bottles as a minimal interface to access digital informationCHI 2001
GeoSCAPE: designing a reconstructive tool for field archaeological excavation.CHI 2001
curlybot: Designing a New Class of Computational ToysCHI 2000
HandSCAPE: a vectorizing tape measure for on-site measuring applicationsCHI 2000
musicBottlesSIGGRAPH 1999
TouchCounters: designing interactive electronic labels for physical containersCHI '99 1999
CurlybotSIGGRAPH 1999
PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative playCHI '99 1999
Triangles: Tangible Interface for Manipulation and Exploration of Digital Information TopographyCHI 1998
Tangible Bits: Towards Seamless Interfaces between People, Bits, and AtomsCHI 1997 1997
The metaDESK: Models and Prototypes for Tangible User InterfacesUIST 1997
Bricks: Laying the Foundations for Graspable User InterfacesCHI 1995
Iterative Design of Seamless Collaboration MediaCACM 1994
Integration of interpersonal space and shared workspace: ClearBoard design and experimentsACM Transactions on Information Systems (TOIS) archive 1993
ClearBoard: a seamless medium for shared drawing and conversation with eye contactCHI 1992
Integration of inter-personal space and shared workspace: ClearBoard design and experimentsCSCW 1992
TeamWorkStation: towards a seamless shared workspaceCSCW 1990