Proposal of MMI-API and library for JavaScript

Kouichi Katsurada; Taiki Kikuchi; Yurie Iribe; Tsuneo Nitta

doi:10.1007/978-3-642-29934-6_49

Proposal of MMI-API and library for JavaScript

Kouichi Katsurada, Taiki Kikuchi, Yurie Iribe, Tsuneo Nitta

Department of Information Sciences

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

Abstract

This paper proposes a multimodal interaction API (MMI-API) and a library for the development of web-based multimodal applications. The API and library enable us to embed synchronized multiple inputs/outputs into an application, as well as to specify concrete speech inputs/outputs and actions of dialogue agents. Because the API and the library are provided for JavaScript, which is a commonly used web-development language, they can be executed on general web browsers without having to install special add-ons. The users can therefore experience multimodal interaction simply by accessing a web site from their web browsers. In addition to presenting an outline of the API and the library, we offer a practical example of the use of the multimodal interaction system, as applied to an English pronunciation training application for Japanese students.

Original language	English
Title of host publication	Intelligent Interactive Multimedia
Subtitle of host publication	Systems and Services : Proceedings of the 5th International Conference on Intelligent Interactive Multimedia Systems and Services (IIMSS 2012)
Editors	Jain Lakhmi, Howlett Robert, Watada Junzo, Watanabe Toyohide, Takahashi Naohisa
Pages	511-520
Number of pages	10
DOIs	https://doi.org/10.1007/978-3-642-29934-6_49
Publication status	Published - 2012

Publication series

Name	Smart Innovation, Systems and Technologies
Volume	14
ISSN (Print)	2190-3018
ISSN (Electronic)	2190-3026

Keywords

JavaScript
MMI-API
Web-based multimodal interaction

Access to Document

10.1007/978-3-642-29934-6_49

Cite this

Katsurada, K., Kikuchi, T., Iribe, Y., & Nitta, T. (2012). Proposal of MMI-API and library for JavaScript. In J. Lakhmi, H. Robert, W. Junzo, W. Toyohide, & T. Naohisa (Eds.), Intelligent Interactive Multimedia: Systems and Services : Proceedings of the 5th International Conference on Intelligent Interactive Multimedia Systems and Services (IIMSS 2012) (pp. 511-520). (Smart Innovation, Systems and Technologies; Vol. 14). https://doi.org/10.1007/978-3-642-29934-6_49

Katsurada, Kouichi ; Kikuchi, Taiki ; Iribe, Yurie et al. / Proposal of MMI-API and library for JavaScript. Intelligent Interactive Multimedia: Systems and Services : Proceedings of the 5th International Conference on Intelligent Interactive Multimedia Systems and Services (IIMSS 2012). editor / Jain Lakhmi ; Howlett Robert ; Watada Junzo ; Watanabe Toyohide ; Takahashi Naohisa. 2012. pp. 511-520 (Smart Innovation, Systems and Technologies).

@inbook{95e48212fa5b4d91a2d40eddd72c1fef,

title = "Proposal of MMI-API and library for JavaScript",

abstract = "This paper proposes a multimodal interaction API (MMI-API) and a library for the development of web-based multimodal applications. The API and library enable us to embed synchronized multiple inputs/outputs into an application, as well as to specify concrete speech inputs/outputs and actions of dialogue agents. Because the API and the library are provided for JavaScript, which is a commonly used web-development language, they can be executed on general web browsers without having to install special add-ons. The users can therefore experience multimodal interaction simply by accessing a web site from their web browsers. In addition to presenting an outline of the API and the library, we offer a practical example of the use of the multimodal interaction system, as applied to an English pronunciation training application for Japanese students.",

keywords = "JavaScript, MMI-API, Web-based multimodal interaction",

author = "Kouichi Katsurada and Taiki Kikuchi and Yurie Iribe and Tsuneo Nitta",

year = "2012",

doi = "10.1007/978-3-642-29934-6_49",

language = "English",

isbn = "9783642299339",

series = "Smart Innovation, Systems and Technologies",

pages = "511--520",

editor = "Jain Lakhmi and Howlett Robert and Watada Junzo and Watanabe Toyohide and Takahashi Naohisa",

booktitle = "Intelligent Interactive Multimedia",

}

Katsurada, K, Kikuchi, T, Iribe, Y & Nitta, T 2012, Proposal of MMI-API and library for JavaScript. in J Lakhmi, H Robert, W Junzo, W Toyohide & T Naohisa (eds), Intelligent Interactive Multimedia: Systems and Services : Proceedings of the 5th International Conference on Intelligent Interactive Multimedia Systems and Services (IIMSS 2012). Smart Innovation, Systems and Technologies, vol. 14, pp. 511-520. https://doi.org/10.1007/978-3-642-29934-6_49

Proposal of MMI-API and library for JavaScript. / Katsurada, Kouichi; Kikuchi, Taiki; Iribe, Yurie et al.
Intelligent Interactive Multimedia: Systems and Services : Proceedings of the 5th International Conference on Intelligent Interactive Multimedia Systems and Services (IIMSS 2012). ed. / Jain Lakhmi; Howlett Robert; Watada Junzo; Watanabe Toyohide; Takahashi Naohisa. 2012. p. 511-520 (Smart Innovation, Systems and Technologies; Vol. 14).

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

TY - CHAP

T1 - Proposal of MMI-API and library for JavaScript

AU - Katsurada, Kouichi

AU - Kikuchi, Taiki

AU - Iribe, Yurie

AU - Nitta, Tsuneo

PY - 2012

Y1 - 2012

N2 - This paper proposes a multimodal interaction API (MMI-API) and a library for the development of web-based multimodal applications. The API and library enable us to embed synchronized multiple inputs/outputs into an application, as well as to specify concrete speech inputs/outputs and actions of dialogue agents. Because the API and the library are provided for JavaScript, which is a commonly used web-development language, they can be executed on general web browsers without having to install special add-ons. The users can therefore experience multimodal interaction simply by accessing a web site from their web browsers. In addition to presenting an outline of the API and the library, we offer a practical example of the use of the multimodal interaction system, as applied to an English pronunciation training application for Japanese students.

AB - This paper proposes a multimodal interaction API (MMI-API) and a library for the development of web-based multimodal applications. The API and library enable us to embed synchronized multiple inputs/outputs into an application, as well as to specify concrete speech inputs/outputs and actions of dialogue agents. Because the API and the library are provided for JavaScript, which is a commonly used web-development language, they can be executed on general web browsers without having to install special add-ons. The users can therefore experience multimodal interaction simply by accessing a web site from their web browsers. In addition to presenting an outline of the API and the library, we offer a practical example of the use of the multimodal interaction system, as applied to an English pronunciation training application for Japanese students.

KW - JavaScript

KW - MMI-API

KW - Web-based multimodal interaction

UR - http://www.scopus.com/inward/record.url?scp=84879315264&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-29934-6_49

DO - 10.1007/978-3-642-29934-6_49

M3 - Chapter

AN - SCOPUS:84879315264

SN - 9783642299339

T3 - Smart Innovation, Systems and Technologies

SP - 511

EP - 520

BT - Intelligent Interactive Multimedia

A2 - Lakhmi, Jain

A2 - Robert, Howlett

A2 - Junzo, Watada

A2 - Toyohide, Watanabe

A2 - Naohisa, Takahashi

ER -

Katsurada K, Kikuchi T, Iribe Y, Nitta T. Proposal of MMI-API and library for JavaScript. In Lakhmi J, Robert H, Junzo W, Toyohide W, Naohisa T, editors, Intelligent Interactive Multimedia: Systems and Services : Proceedings of the 5th International Conference on Intelligent Interactive Multimedia Systems and Services (IIMSS 2012). 2012. p. 511-520. (Smart Innovation, Systems and Technologies). doi: 10.1007/978-3-642-29934-6_49

Proposal of MMI-API and library for JavaScript

Abstract

Publication series

Keywords

Access to Document

Other files and links

Fingerprint

Cite this