The CBC Newsworld Holodeck utilizes the GestureTek software system and Microsoft Kinect to sense the user’s gestures, enabling interaction with multi-screen video display. Video data communicates with the gesture-based library through an open-source C++ toolkit, which allows flexibility of video control, animation, and speed optimization. The Kinect searches for the user’s hand; upon detecting the gesture the system calls an action that corresponds to that gesture. The called action selects a video, plays that video, which initiates keywords to populate the screen, or hides them during video playback, enabling focused viewing.

Keyword/phrase selection takes the viewer directly to the selected video clip (enabled by natural language processing technologies), a novel interaction in video browsing, search and display. The Holodeck interface enables gestural interaction, and rich, context-aware browsing and search of the CBC Newsworld ‘big data’ video corpus.

WEBSITES

Demo video https://www.youtube.com/watch?v=cgI9Mxwoc7A

Mobile Lab http://research.oacdu.ca/mobilelab/project/cbc-newsworld-holodeck

CIV-DDD http://www.civ-ddd.ca/project/cbc-newsworld-project/

Tuesday, May 7, 2013 - 3:00pm
Lab Member: 
Martha Ladly
Gerald Penn
Cathy Chen
Bryn A. Ludlow
Ana Jofre
Siavash Kazemian

Overview

Tuesday May 7th, 2013

The CBC Newsworld Holodeck utilizes the GestureTek software system and Microsoft Kinect to sense the user’s gestures, enabling interaction with multi-screen video display. Video data communicates with the gesture-based library through an open-source C++ toolkit, which allows flexibility of video control, animation, and speed optimization. The Kinect searches for the user’s hand; upon detecting the gesture the system calls an action that corresponds to that gesture. The called action selects a video, plays that video, which initiates keywords to populate the screen, or hides them during video playback, enabling focused viewing.

Keyword/phrase selection takes the viewer directly to the selected video clip (enabled by natural language processing technologies), a novel interaction in video browsing, search and display. The Holodeck interface enables gestural interaction, and rich, context-aware browsing and search of the CBC Newsworld ‘big data’ video corpus.

WEBSITES

Demo video https://www.youtube.com/watch?v=cgI9Mxwoc7A

Mobile Lab http://research.oacdu.ca/mobilelab/project/cbc-newsworld-holodeck

CIV-DDD http://www.civ-ddd.ca/project/cbc-newsworld-project/

Documents:

PDF icon CBCPosterFInal2014.pdf

Martha Ladly

Martha Ladly, PhD is a Professor and the Associate Dean of Graduate Studies at OCAD University, where she specializes in design research methods, collaborative design methods, and mobile experience design. She is a researcher in the Mobile Experience Lab, and a PI with the Centre for Innovation in Visualisation and Data Driven Design. Martha led the design and implementation of the new Graduate Program in Digital Futures. She held the Chair of OCAD University’s Research Ethics Board from 2008-2011. 

Martha is co-editor of the anthology "Mobile Nation: Creating Methodologies for Mobile Platforms", published by Riverside Press in 2008; she was a senior researcher with the Mobile Digital Commons Network (2005-7) and the Principal Investigator and conference leader of the Mobile Nation International Conference at OCADU, for which she won a Social Sciences and Humanities Research Council Award. Her practice and research interests include interdisciplinary art and design research creation, mobile learning, interface and experience design. She is currently finishing her PhD dissertation on the place of women, the female body, and Eros within the philosophy of technology.

Martha is a Registered Graphic Designer (RGD) and a faculty member with the Canadian Film Centre’s Media Lab.

Yes

Cathy Chen

cc11ke@student.ocadu.ca

Cathy Chen is passionate about using design thinking and practice to empower socially and cognitively disadvantaged groups. She is a co-founder of DruMeBa Inc, an interactive media and social purpose business developing systems and software to assist children with ASD (Autism Spectrum Disorder) with their communication and cognitive skills. During her Master’s degree program in Digital Futures at OCAD University, Cathy designed a system that utilizes a combination of internet, community radio and SMS technologies to encourage collaborative composition across distances among children in rural India.

Her role in the CBC Newsworld Holodeck and Postcard Memories OCADU research projects is to help research, envision and build prototypes. For Postcard Memories, Cathy and teammates performed horizon scans to look into various existing applications relating to the core idea of the project: to help senior's memory recall abilities through a touch-based collaborative application. After extensive user experience brainstorming, Cathy and her teammates designed and edited the visual look and feel of the project interface and reviewed the projects with members of the Toronto Rehabilitation Institute as well as with Canada Post.

Cathy's second project involves creating a new interface for information retrieval in an archive of CBC news video clips. As a research assistant, she and other teammates helped brainstorm ways of retrieving data through various interaction methods: gesture, text and voice. Cathy then designed user interface prototypes and performed some HTML/CSS/JavaScript coding for the project mockup.

Her current role for both projects include refining the user experience and interactivity for future user testing as well as integrating the initial CBC News prototype with Gesturetek’s technology.

No

Ana Jofre

Ana Jofre’s interdisciplinary practice is grounded in a diverse academic background, which includes a PhD in Physics from the University of Toronto. Ana started pursuing art as a professional practice and exhibiting her work while serving as a full-time faculty member in the Department of Physics at UNC Charlotte, where she conducted and published research in Experimental Biophysics. At this time, she also completed a BFA with a concentration in ceramics at the same University. A romantic at heart, she found herself more motivated to make a cultural contribution to society than to collect and publish additional data. She is currently enrolled in an MFA program at Ontario College of Art and Design (OCAD) University in Toronto, Canada, with a degree expected in April 2015. Her current practice integrates knowledge and methodologies from various disciplines to create aesthetic experiences of ‘presence’. 

Dr. Jofre has been working as a research assistant at OCAD University since August 2013.  She worked with Sara Diamond on the 'Tangible Interfaces and Data Sculpture' project, and is currently working wiht Martha Ladly on the CBC Newsworld Holodeck project, and on the Postcard Memories project.  

No