Apple’s touch technology coming to smart camera lenses, Tablet PCs and video games
On July 10, 2008, the US Patent & Trademark Office published an Apple patent application that generally relates to rolling gestures on a touch sensitive surface of a device for controlling the device and for remotely controlling another device. This also relates to gestures enabled by the placement of one or more touch sensitive surfaces for configuring the operation of the device, for operating the device and for enabling additional gestures for operating the device. Apple’s illustrations point out an Advanced Camera system with smart lenses, a Tablet PC with virtual haptic knobs and a unique twist to video gaming applications and onscreen musical instruments.
Advanced Photography: A Touch Sensitive Camera Lens
Believe it or not, Apple’s interest in photography may eventually go far beyond Aperture 2 and right into delivering a high end camera. In fact, a touch sensitive based camera with smart lenses. Apple’s patent FIGS. 28A to 28D below, illustrate a sequence and device for implementing method 1200 that’s shown below in FIG. 27.
Patent FIG. 27 is a diagram of a touch-based method to be implemented with a camera. The method 1200 begins at block 1205 with a detection of a gesture on a touch sensitive surface on a camera lens. The detection of the gesture can be performed in the manner discussed above. Images of the gesture can be captured and analyzed to detect one or more touches performed on the lens of the camera. The camera at block 1210 can then generate a signal in accordance with the detected touch. The camera can be then operated at block 1215 based on the generated signal.
Apple’s patent FIGS. 28A-28D illustrate camera 1250 having lens 1255. A touch sensitive surface 1260 can be wrapped around the lens to detect gestures performed on the surface.
The placement of the touch sensitive surface (1260) around the lens can enable the detection of gestures for configuring the operation of the camera and for operating the camera. For example, FIG. 28B illustrates the user grasping the lens with his left index finger 1270 and his left thumb 1275. The two-fingered grasp can be used to configure the device, for example, to set the mode of operation relating to exposure. The grasp can then be used to operate the camera. For example, if the index finger is slid forward around the circumference of the lens, the aperture of the camera can open incrementally. If the index finger is slid backwards around the circumference of the lens, the grasp can be used to close the aperture incrementally.
Once the user has completed his exposure operation, he can simply change the mode of operation by changing the number of fingers touching surface as reflected through his grasp. For example, FIG. 28C illustrates the user additionally placing the middle finger 1280 on touch sensitive surface. This three-fingered grasp can be used, for example, to set the mode of operation relating to zooming or focusing. In the zooming mode, any of the gestures described above can be used to operate the camera. For example, FIG. 28D shows the middle finger rolling to the right as indicated by the illustrated arrow. This gesture can perform a telephoto operation with the extension of lens 1285. A roll of middle finger in the other direction can be used to perform a wide angle operation.
In this way, the placement of a touch sensitive surface around the lens of a camera can enable a set of gestures that can be used to configure the operation of the camera and to operate the camera. The surface can be used to detect a gesture, such as the number of fingers in a grasp, to set or change the mode of operation of the camera. That gesture can be combined with other gestures, such as a rolling gesture of one of the fingers performing the grasp, to operate the camera in that mode. For example, once the zoom mode is set with a three-finger grasp, a roll of one of the three fingers can operate the telephoto and wide angle operation.
Touch Tablet, Virtual Knob and Haptics
While that would make an interesting title for a Woody Allen movie, it’s really the way to sum up Apple’s emphasis on a virtual knob that is utilized on a tablet PC. It’s impossible to determine at this point in time whether or not Apple is planning on delivering a dedicated tablet PC into the marketplace or simply planning on adding advanced touch capabilities to a detachable notebook display and/or a future iBook (for virtual books, not the old notebook). While only time will tell, the fact is that Apple is giving us yet another clue concerning a Tablet PC application using a virtual knob. In patent figure 7G below, you’ll note that Tablet FIG. 7A will utilize the use of a virtual knob that controls a stereo speaker. The size of the display can’t be confused with an iPhone or iPod.
Apple states that FIG. 7G above illustrates a rotation vector whereby the speaker (192) of the tablet PC (175) could increase (or decrease) its output in accordance with the amount of rotation of the fingers (176, i.e., increase the volume by 5% based on rotation of 5 degrees. In essence, the virtual control knob follows the gesture occurring on the screen. Still further, an audio unit (194) of the tablet PC can provide a clicking sound for each unit of rotation, e.g., provide five clicks based on rotation of five degrees. Still yet further, a haptics unit (196) of the tablet PC could provide a certain amount of vibration or other tactile feedback for each click thereby simulating an actual knob.
It should be noted that additional gestures can be performed simultaneously with the virtual control knob gesture. For example, more than one virtual control knob can be controlled at the same time using both hands, i.e., one hand for each virtual control knob. This particular concept is illustrated in figure 21C of this Apple patent. The virtual control knob could also be used as a virtual scroll wheel, depending on the application.
Unique Remote Control Applications
While most of us could think of a handy remote control application extending to the iPod touch or iPhone to control iTunes on our HDTV, Apple’s patent focuses on one particular application relating to your vehicle, instead.
Apple’s patent FIG. 8 noted below is a diagram of a touch-based method (700) in which a gesture on a touch sensitive surface of a sensing device can be used to remotely control another device. At block 702, images of the gesture can be captured as the user inputs the gesture on the touch sensitive surface. The gesture can be, for example, placing one finger at a location on the touch sensitive surface and rolling the finger as a joystick. The images of the gesture can produce snapshots of finger contacts with the touch sensitive surface.
Apple’s patent FIG. 9 illustrates one system for implementing the touch-based method of FIG. 8. The system can comprise a device such as tablet PC (720) having a touch sensitive surface 722, such as a touch pad or a-touch sensitive display screen. A user can input a gesture on surface (722). FIG. 9 illustrates one example of a user performing a rolling gesture, as indicated by the arrow, with his index finger (726) on surface (722). The tablet PC (724) can have an antenna for transmitting signals to another device such as car (728). The car can have an antenna (730) for receiving signals transmitted from tablet PC. Although not shown, car 728 can have the processing capability well known in the art of analyzing the received signal and performing one or more actions based on the contents of the signal. It should be noted that the wireless connection between tablet PC (720) and car can correspond to any well-known wireless protocol such as Bluetooth, WiFi and the like. Alternatively, tablet PC and car 728 can be connected together through a wired connection.
Exemplary Embodiment: A Touch Sensitive Surface on a Gaming Object
It’s a little odd to have an exemplary embodiment show up so late in a patent, but indeed this one is strange if not a little exotic: a gaming object.
According to Apple’s patent, another example can be the placement of a touch sensitive surface on a gaming object. The surface enables gestures that can be used to configure the operation of the object and its use. FIG. 29 illustrates an exemplary embodiment with a baseball (1300) as part of a video gaming system. The baseball can have a touch sensitive surface (1310) placed on the entire surface of the ball, or part of the surface. The surface can enable gestures that can be used to configure the operation of the baseball and its use. For example, the detection of three fingers on the touch sensitive surface, including fingers 1325 and 1330 at 1315 and 1320, can be used to indicate to the video gaming system that the ball has been grasped and is ready for use. The detection of the two fingers could be further analyzed to detect the type of pitch. In this case, the detection of the placement of the knuckles of fingers 1325 and 1330 can be used to signal to the video gaming system that the user has selected a knuckleball.
Another example in which a touch sensitive surface can be placed on an object can be a musical instrument. The surfaces can be placed on keys or the like to enable gestures relating to the operation of the instrument.
Apple lists Greg Christie (Cupertino, CA) and Wayne Carl Westerman (San Francisco, CA) as the inventors of patent number 20080165255.
NOTICE: MacNN presents only a brief summary of patents with associated graphic(s) for journalistic news purposes as each such patent application and/or grant is revealed by the U.S. Patent & Trade Office. Readers are cautioned that the full text of any patent applications and/or grants should be read in its entirety for further details.
Written and researched by Neo.
Top