We are creating a Tangible User Interface (TUI) designed to interactively query a database. While much work has been done on TUI, showing that they encourage collaboration and positively enhance user experience, few tangible systems have been designed specifically for data analysis tasks. Our system combines a tabletop (non-digital) graspable user interface with a two-dimensional screen display; the user interrogates the data by placing tokens on or off the tabletop and the screen displays the results of the user’s query. The objects are tagged using fiducial markers, which are identified with open-source ReacTIVision computer vision software, and the visualization code is written in Processing. We use radio station listenership demographic data for our current prototype, but the system can be used to query any type of database.
Below is a schematic of our tangible data query system. Users create queries by placing objects onto a table, which has a camera placed discretely below it; the results of the query are displayed onto an overhead screen placed at one end of the table. A video of the interaction can be viewed here: https://www.youtube.com/watch?v=XfTvTsqG5ZI
Jofre, A., Szigeti, S., Tiefenbach-Keller, S., Dong, L.-X., Diamond, S. “Manipulating Tabletop Objects to Interactively Query a Database” (2016) CHI’16 Extended Abstracts (Chi 2016 San Jose May 7-12)
Jofre, A., Szigeti, S., Diamond, S. "Citizen engagement through tangible data representation" Foro de Educación (January-June 2016) vol. 14, n. 20
Jofre, A. Szigeti, S., Tiefenbach-Keller, S., Dong, L.-X., Tomé, F., Czarnowski, D., Diamond, S. (2015) "A Tangible User Interface for Interactive Data Visualization" Proceedings of the 2015 Conference of the Center for Advanced Studies on Collaborative Research. IBM Corp., CASCON2015, November 2-4, 2015, Toronto, Ontario.
Szigeti, S., Stevens, A., Tu, R., Jofre, A., Gebhardt, A., Chevalier, F., Lee, J. & Diamond, S. (2014) Output to Input: Concepts for Physical Data Representations and Tactile User Interfaces. Proceedings of CHI14 Works‐in‐Progress (Toronto, ON).