PlumX Metrics
Embed PlumX Metrics

Cluster-based approach to discriminate the user’s state whether a user is embarrassed or thinking to an answer to a prompt

Journal on Multimodal User Interfaces, ISSN: 1783-8738, Vol: 11, Issue: 2, Page: 185-196
2017
  • 1
    Citations
  • 0
    Usage
  • 13
    Captures
  • 0
    Mentions
  • 0
    Social Media
Metric Options:   Counts1 Year3 Year

Metrics Details

  • Citations
    1
    • Citation Indexes
      1
  • Captures
    13

Article Description

Spoken dialog systems are employed in various devices to help users operate them. An advantage of a spoken dialog system is that the user can make input utterances freely, but the system sometimes makes it difficult for the user to speak to it. The system should estimate the state of a user who encounters a problem when starting a dialog and then give appropriate help before the user abandons the dialog. Based on this assumption, our research aims to construct a system which responds to a user who does not reply to the system. In this paper, we propose a method of discriminating the user’s state based on vector quantization of non-verbal information such as prosodic features, facial feature points, and gaze. The experimental results showed that the proposed method outperforms the conventional approaches and achieves a discrimination ratio of 72.0%. Then, we examined sequential discrimination for responding to the user at an appropriate timing. The results indicate that the discrimination ratio reached equal to the end of the session at around 6.0 s.

Provide Feedback

Have ideas for a new metric? Would you like to see something else here?Let us know