toggle

AAPL Stock: 115.11 ( -3.33 )

Printed from http://www.macnn.com

Apple filing mixes multi-touch with voice, gaze

updated 08:35 am EDT, Thu September 4, 2008

Apple Multi-Touch Fusion

Apple has been mulling a multi-touch system that would incorporate voice and visual data into the control system for its devices, according to a new US patent filing. Determining that some actions are best performed with additional senses besides just touch, the company suggests in one implementation that voice can be used to alter some properties of an object touched by the user. A visual editor could let a user speak out color changes for an object selected with a finger, while a word processor could enable users to drag and select text with fingers but speak out font changes.

The proposed technology would also allow cameras or other visual sensors to intelligently recognize the user's intentions, such as through the user's gaze at a particular object onscreen, the profile of their hands relative to the display or the mood expressed by the user's face. A user's frustration could tell a computer that it's misinterpreting a command, Apple says.

Additional information could also come from more advanced data generated by the user's grip, including modifying a touched object based on the angle and motion of the device itself, the size of fingers and hands, and biological data such as body temperature or heart rate.

Apple is broad in describing the possibilities for these systems and says they could apply to cellphones, computers and portable media players among other devices. However, it explains specifically that the camera needed for the visual aspects of this system could be the iSight camera in one of its MacBook computers and provides an illustration suggesting that an iMac or a stand-alone display with a camera could also be used.

The inventors are listed as Wayne Westerman and John Elias, the founders of pioneering multi-touch firm FingerWorks that was ultimately acquired by Apple and has been the source of several Apple multi-touch patents.










by MacNN Staff

toggle

Comments

  1. Haroscarfel

    Joined: Dec 1969

    +2

    better yet

    this feature is made for humans not aliens with weird fingers.

  1. Constable Odo

    Joined: Dec 1969

    0

    Oh, how nice...

    I ask for longer battery life and they give me the ability for my device to change text colors by voice command. That's really useful while working in a quiet environment....NOT! Maybe this means we can look forward to a screen-side camera on iPhones and iPod Touch(es).

Login Here

Not a member of the MacNN forums? Register now for free.

toggle

Network Headlines

Follow us on Facebook

toggle

Most Popular

Advertisement

Recent Reviews

HP 14-x030nr 14-inch Chromebook

If you're like us, chances are you've come to realize that you need the ability to access the Internet on the go. Also, you've prob ...

15-inch MacBook Pro with Force Touch

Apple's 15-inch Retina MacBook Pro continues to be a popular notebook with professional users and prosumers looking for the ultimate ...

Typo keyboard for iPad

Following numerous legal shenanigans between Typo -- a company founded in part by Ryan Seacrest -- and the clear object of his physica ...

toggle

Most Commented