Amazon: Gaze to Authenticate

Amazon may be able to authenticate access to subscription services by using cameras on smartphones, tablets and IP-connected TVs to perform retina scans on viewers, according to a patent published on Tuesday.

Bozarth
Bozarth

Former Amazon Lab126 software engineering manager Bradley Bozarth is named as inventor on the patent, titled, “Secure device unlock with gaze calibration.” Bozarth is now principal engineer at Raytheon Teligy.

Absract: An unlock procedure for an electronic device can be based at least in part upon a determined gaze direction or viewing location of a user. During a device unlock process, the user can be directed to follow an element or path on a display element with the user’s eyes. Image information captured of the user during this process can be used to correlate the user’s eye position in the image with the corresponding gaze location on the device, in order to calibrate the gaze tracking in a way that is substantially transparent to the user. Further, certain devices can also utilize captured image information during the unlock process to authenticate the user using a process such as iris recognition or retinal scanning. Such an approach enables secure access to the device without requiring the user to manually enter identifying information, and re-authentication can be performed without distracting the user.

Patent

Related articles:
Amazon Developing ‘Smart Zoom’ For 4K, 8K Video
Tobii Invention Lets Viewers Mute Characters With Eye Gaze
Tobii Recruiting Eye Tracking Developers for IS4 Platform
Amazon Eyes English Brand for Telecom, Advertising, Education

Claims: 

1. A computing device, comprising: one or more processors; a display screen; one or more infrared (IR) radiation emitters; a camera; a memory device including instructions, which when executed by the one or more processors, cause the computing device to: generate a path along which a user is to follow via a gaze of the user; display a graphical element on the display screen at a starting point along the path; emit first IR radiation, using the one or more IR radiation emitters, having a first wavelength; emit second IR radiation, using the one or more IR radiation emitters, having a second wavelength; capture first image data using the camera; determine, from the first image data, first decomposed image data corresponding to the first wavelength; determine, from the first decomposed image data, a first boundary of an eye of the user; determine, from the first image data, second decomposed image data corresponding to the second wavelength; determine, from the second decomposed image data, a second boundary of the eye of the user; detect, using the first boundary determined from the first decomposed image data, the second boundary determined from the second decomposed image data, and the first image data, a vector corresponding to the gaze of the user intersecting the starting point; prompt the user to follow the graphical element via the gaze of the user; move the graphical element between the starting point and an endpoint along the path; capture second image data using the camera; determine, from the second image data, third decomposed image data corresponding to the first wavelength; determine, from the third decomposed image data, the first boundary of the eye of the user; determine, from the second image data, fourth decomposed image data corresponding to the second wavelength; determine, from the fourth decomposed image data, the second boundary of the eye of the user; track, using the first boundary determined from the third decomposed image data, the second boundary determined from the fourth decomposed image data, and the second image data, the gaze of the user with respect to the display screen during movement of the graphical element between the starting point and the endpoint; determine that the gaze of the user followed the path within a predetermined range of deviation; and provide the user with access to at least some functionality of the computing device.

2. The computing device of claim 1, wherein the instructions, which when executed by the one or more processors, further cause the computing device to: determine, using the first boundary determined from the third decomposed image data, the second boundary determined from the fourth decomposed image data, and the second image data, that the user is an authorized user of the computing device; and provide the user with access to content or additional functionality of the computing device that is personalized for the authorized user.

3. The computing device of claim 1, wherein the instructions, which when executed by the one or more processors, further cause the computing device to: determine, using the first boundary determined from the third decomposed image data, the second boundary determined from the fourth decomposed image data, and the second image data, calibration information for performing gaze tracking, wherein the calibration information is determined within an allowable time period from when it is determined that the gaze of the user followed the path within the predetermined range of deviation.

4. A computer-implemented method for providing access to a computing device, comprising: displaying a graphical element, on a display screen of the computing device, moving along a path; emitting first IR radiation having a first wavelength; emitting second IR radiation having a second wavelength; capturing image data; determining, from the image data, first decomposed image data corresponding to the first wavelength; determining, from the image data, second decomposed image data corresponding to the second wavelength; tracking, based at least in part on the first decomposed image data, the second decomposed image data, and the image data, a gaze of a user; determining that the gaze of the user followed the path within a predetermined range of deviation; and providing the user with access to at least some functionality of the computing device.

5. The computer-implemented method of claim 4, further comprising at least one of: dynamically generating the path; selecting the path from a rotation comprising a plurality of predetermined paths; or randomly selecting the path from among the plurality of predetermined paths.

6. The computer-implemented method of claim 4, wherein the path includes at least one first segment that is substantially a height of the display screen and at least one second segment that is substantially a width of the display screen.

7. The computer-implemented method of claim 4, further comprising: detecting, using the first decomposed image data, the second decomposed image data, and the image data, a vector corresponding to the gaze of the user intersecting a starting point along the path; prompting the user to follow the graphical element via the gaze of the user; and moving the graphical element between the starting point and an endpoint along the path.

8. The computer-implemented method of claim 4, further comprising: determining, using the first decomposed image data, the second decomposed image data, the image data, and data stored for one or more authorized users of the computing device, that the user is a specific authorized user of the computing device.

9. The computer-implemented method of claim 8, further comprising: providing the user with access to content or additional functionality of the computing device that is personalized for the specific authorized user.

10. The computer-implemented method of claim 4 further comprising: determining, using the first decomposed image data, the second decomposed image data, the image data, and data stored for one or more authorized users of the computing device, that the user is not a specific authorized user of the computing device; and disabling access to content or additional functionality of the computing device that is personalized for the specific authorized user.

11. The computer-implemented method of claim 8, wherein determining that the user is the specific authorized user includes: matching one or more features within the image data to one or more respective features within the data stored for the one or more authorized users.

12. The computer-implemented method of claim 8, wherein determining that the user is the specific authorized user includes: performing at least one of iris recognition or retina recognition using the first decomposed image data, the second decomposed image data, the image data, and the data stored for the one or more authorized users.

13. The computer-implemented method of claim 8, wherein determining that the user is the specific authorized user includes: determining, using the first decomposed image data, the second decomposed image data, the image data, and absorption response information, that the image data includes a representation of at least one human eye.

14. The computer-implemented method of claim 4, determining, using the first decomposed image data, the second decomposed image data, and the image data, calibration information for performing gaze tracking, wherein the calibration information is determined within an allowable time period from when it is determined that the gaze of the user followed the path within the predetermined range of deviation.

15. The computer-implemented method of claim 4, wherein movement of the graphical element includes a first velocity along a first segment of the path that varies from a second velocity along a second segment of the path.

16. The computer-implemented method of claim 4, wherein movement of the graphical element includes a first pause for a first period of time at a first point of the path that varies from a second pause for a second period of time at a second point of the path.

17. A non-transitory computer-readable storage medium storing instructions for providing access to a computing device, the instructions, which when executed by one or more processors of the computing device, cause the computing device to: determine a path along which a user is to follow via a gaze of the user; display a graphical element, on a display screen of the computing device, moving along the path; emit first IR radiation having a first wavelength; emit second IR radiation having a second wavelength; capture image data; determine, from the image data, first decomposed image data corresponding to the first wavelength; determine, from the image data, second decomposed image data corresponding to the second wavelength; track, based at least in part on the first decomposed image data, the second decomposed image data, and the image data, the gaze of the user; determine that the gaze of the user followed the path within a predetermined range of deviation; and provide the user with access to at least some functionality of the computing device.

18. The non-transitory computer-readable storage medium of claim 17, wherein the instructions, which when executed by the one or more processors of the computing device, further cause the computing device to: determine using the first decomposed image data, the second decomposed image data, the image data, and data stored for one or more authorized users of the computing device, that the user is a specific authorized user of the computing device; and provide the user with access to content or additional functionality of the computing device that is personalized for the specific authorized user.

19. The non-transitory computer-readable storage medium of claim 18, wherein the instructions, which when executed by the one or more processors of the computing device, further cause the computing device to perform at least one of: match one or more features within the image data to one or more respective features within the data stored for the one or more authorized users; perform at least one of iris recognition or retina recognition using the first decomposed image data, the second decomposed image data, the image data, and the data stored for the one or more authorized users; or determine, using the first decomposed image data, the second decomposed image data, the image data, and absorption response information, that the image data includes a representation of at least one human eye.

20. The non-transitory computer-readable storage medium of claim 17, wherein the instructions, which when executed by the one or more processors of the computing device, further cause the computing device to: determine, using the first decomposed image data, the second decomposed image data, the image data, and data stored for one or more authorized users of the computing device, that the user is not a specific authorized user of the computing device; and disable access to content or additional functionality of the computing device that is personalized for the specific authorized user.