Temporal video alignment based on integrating multiple features by adaptive weighting

Taiki Sato, Yutaka Shimada, Yukinobu Taniguchi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper proposes a method for establishing temporal correspondence between two different videos of the same manufacturing processes to enable visual comparison of the work in progress to support the transfer of expertise and skills. We extract two features from work objects and the hand motions of workers from the videos and align the two videos by integrating these features. For integrating the features, we propose a method that adaptively weights the two features to obtain the distance between frames. Using pairs of videos of PC assembly and cooking tasks, we show that our method offers better frame-by-frame alignment accuracy than the methods that employ each feature separately.

Original languageEnglish
Title of host publication2018 International Workshop on Advanced Image Technology, IWAIT 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-5
Number of pages5
ISBN (Electronic)9781538626153
DOIs
Publication statusPublished - 30 May 2018
Event2018 International Workshop on Advanced Image Technology, IWAIT 2018 - Chiang Mai, Thailand
Duration: 7 Jan 20189 Jan 2018

Publication series

Name2018 International Workshop on Advanced Image Technology, IWAIT 2018

Conference

Conference2018 International Workshop on Advanced Image Technology, IWAIT 2018
CountryThailand
CityChiang Mai
Period7/01/189/01/18

    Fingerprint

Keywords

  • DP matching
  • Feature integration
  • SIFT
  • Video alignment

Cite this

Sato, T., Shimada, Y., & Taniguchi, Y. (2018). Temporal video alignment based on integrating multiple features by adaptive weighting. In 2018 International Workshop on Advanced Image Technology, IWAIT 2018 (pp. 1-5). (2018 International Workshop on Advanced Image Technology, IWAIT 2018). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IWAIT.2018.8369748