HCI Devices

In view of Shneiderman, HCI devices could be divided into 3 kinds:keys, pointing and spech and audivitory ones.

Pointing devices and keys boards needs hand/eye coordination.

Voice demanding is more demanding of users' working memory than is hand/eye coordination.

Speech interaction succeed when they serve uers' needs to work rapidly with low cognitive load and low errors rates.

e.g. semi-coninuous speech and search engine. 

http://news.qq.com/a/20081125/002474.htm  google and iPhone search engine.

3 obstacles must be coped with: the slow pace of speech output,the ephemeral nature of speech,and the difficulty in scanning /searching.

The immediacy and emotional impact of telephone conversation is a compelling component of HH communication.

Boy's love comes from vision(eye), and the Girl's love from sound(ear).

We can use voice  to report, to alert or remind, to diagnoise, ...

Voice is hard to be stored,edited,searched,and annotation.

 

IVR: Interactive Voice Response. 24 hours secretary services.

• The voice around ourlives:Telephone system, music, ...
• Educational psychologists conjecture that if serveral senses(vision,voice and touch) are engaged,learning can be facilitated. 
• Discrete,semi-continuous,continuous speech recognization(SR) and speech generation.

Speech generation:

Also, we could pay more attention to the voice in toy.

The impact of voice:

• Sometime, voice was found to vilolate shoppers' sense of privacy and to be too noisy.
• Annoying warning like ... were replaced with gentler tones and red-light indicatiors.
• Sometime, voice was easy to annoy people.

 

TTS v.s. STT.

non-speech auditory:

auditory icons->earcons

Data sonification.