Puppet show for entertaining hearing-impaired, together with normal-hearing people - A novel application of human sensing technology to inclusive education

Masafumi Goseki, Takayuki Adachi, Hiroshi Mizoguchi, Fusako Kusunoki, Ryohei Egusa, Hiroshi Takemura, Miki Namatame, Shigenori Inagaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

The authors propose a novel application of human sensing technology to inclusive education. We focus on puppet show to aspire the inclusive education for both the normal hearing and the hearing impaired. Thus, we are developing Puppet Theater system to entertain both hearing impaired and normal hearing. This Puppet Theater system consists of two functions. First, the lines are displayed as letters with voice for complementing information of sound. The system enables the hearing impaired to understand the contents of the puppet show. Second function presents branches of the story to audience for encouraging the audience to understand the content of the story. In this paper, we describe that we develope branches of the story as function to select the branches by body movements for the purpose of additional effect of understanding contents of the story. The body movements are measured and detected by Kinect sensor for Xbox. We anticipate additional benefit of understanding contents of the story because this new function enables the audience to participate in the progression of the puppet show. The authors performed the system to elementary school pupils with hearing impairment and found that the pupils enjoyed it. Effects of the function were investigated with questionnaire.

Original languageEnglish
Title of host publicationProceedings of the 2012 1st International Conference on Innovative Engineering Systems, ICIES 2012
Pages121-124
Number of pages4
DOIs
Publication statusPublished - 1 Dec 2012
Event2012 1st International Conference on Innovative Engineering Systems, ICIES 2012 - Alexandria, Egypt
Duration: 7 Dec 20129 Dec 2012

Publication series

NameProceedings of the 2012 1st International Conference on Innovative Engineering Systems, ICIES 2012

Conference

Conference2012 1st International Conference on Innovative Engineering Systems, ICIES 2012
CountryEgypt
CityAlexandria
Period7/12/129/12/12

    Fingerprint

Keywords

  • body movements
  • Kinect sensor

Cite this

Goseki, M., Adachi, T., Mizoguchi, H., Kusunoki, F., Egusa, R., Takemura, H., ... Inagaki, S. (2012). Puppet show for entertaining hearing-impaired, together with normal-hearing people - A novel application of human sensing technology to inclusive education. In Proceedings of the 2012 1st International Conference on Innovative Engineering Systems, ICIES 2012 (pp. 121-124). [6530856] (Proceedings of the 2012 1st International Conference on Innovative Engineering Systems, ICIES 2012). https://doi.org/10.1109/ICIES.2012.6530856