Amazon Scores Patent for Augmented Reality Recommendations

Amazon subsidiary A9 Inc. won a U.S. patent for an augmented reality application that could help the retail giant steer consumers shopping in brick and mortar stores to purchase items online.

After a user captures an image of an item in a retail store with a mobile device, “the electronic marketplace could provide the user with a discount or other incentive to purchase the product from the electronic marketplace instead of the store,” A9 states in the patent published on Tuesday.

A9 senior software development engineer Xiaofan Lin is named as lead inventor on the patent, titled, “Augmented reality recommendations.”

Abstract: Various embodiments enable a computing device to perform tasks such as processing an image to recognize text or an object in an image to identify a particular product or related products associated with the text or object. In response to recognizing the text or the object as being associated with a product available for purchase from an electronic marketplace, one or more advertisements or product listings associated with the product can be displayed to the user. Accordingly, additional information for the associated product can be displayed, enabling the user to learn more about and purchase the product from the electronic marketplace through the portable computing device.

Patent

Claims

1. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause a computing device to: capture image information corresponding to a field of view of a camera of a computing device, at least a portion of the image information being displayed on a display element of the computing device; analyze the image information to recognize at least one of text or an object represented in the image information and in the field of view of the camera; determine at least one of the text or the object as being associated with a product listing; display, in a graphical overlay over a portion of the image information corresponding to the field of view of the camera and concurrently being displayed on the display element, the product listing identifying an item available for purchase from an electronic marketplace; receive a selection of the item; display additional information for the item; and enable purchasing of the item listed in the product listing from the electronic marketplace.

2. The non-transitory computer-readable storage medium of claim 1, wherein analyzing the image information to recognize at least one of the text or the object includes determining a confidence score indicating a level of confidence that the at least one of the text or the object is associated with the product available for purchase from the electronic marketplace.

3. The non-transitory computer-readable storage medium of claim 2, wherein the product listing includes only one product when the confidence score is above a threshold score.

4. The non-transitory computer-readable storage medium of claim 2, wherein recognizing at least one of the text or the object includes comparing the at least one of the text or the object to products from at least one of previously recognized products for a user, user browser history, user purchase history, or stated user preferences.

5. The non-transitory computer-readable storage medium of claim 2, wherein the product listing includes multiple products and the product when the confidence score for the product is below a threshold score.

6. The non-transitory computer-readable storage medium of claim 5, wherein the multiple products include at least one of an advertisement or a related product available for purchase from the electronic marketplace.

7. The non-transitory computer-readable storage medium of claim 5, wherein the multiple products are displayed based at least in part on one of the multiple products having at least one keyword in common with the product, stated user preferences, user browser history, or user purchase history.

8. A computer-implemented method, comprising: under the control of one or more computer systems configured with executable instructions, acquiring image information corresponding to a field of view of a camera of a computing device, the image information being displayed on a display element of the computing device, the image information including a representation of an object; determining the representation of the object as being associated with a product available for purchase from an electronic marketplace; determining at least one related product associated with the product available for purchase; displaying, in a graphical overlay over a portion of the image corresponding to the field of view of the camera and concurrently being displayed on the display element, the at least one related product; receiving a selection of the at least one related product; displaying additional information associated with the at least one related product; and enabling purchasing of the at least one related-product from the electronic marketplace.

9. The computer-implemented method of claim 8, wherein the product is identified by at least one of recognizing text associated with the product or comparing the image information to images stored for products available for purchase from the electronic marketplace using an image matching algorithm.

10. The computer-implemented method of claim 8, wherein the at least one related product is displayed on at least one of an overlay, an advertisement, or a fixed-position listing.

11. The computer-implemented method of claim 8, further comprising: providing a user with the at least one related product in at least one of an email or a product listing displayed in a personalized webpage of the electronic marketplace associated with an account of the user.

12. The computer-implemented method of claim 8, wherein identifying a product in the acquired image information includes determining a confidence score indicating a level of confidence that the identified product is the product available for purchase from the electronic marketplace.

13. The computer-implemented method of claim 12, wherein the at least one related product is the product when the confidence score is above a threshold score.

14. The computer-implemented method of claim 12, wherein the at least one related product includes multiple products and the product when the confidence score is below a threshold score.

15. The computer-implemented method of claim 14, wherein the multiple products include at least one of an advertisement or a related product available for purchase from the electronic marketplace.

16. The computer-implemented method of claim 15, wherein the multiple products are displayed based at least in part on one of the multiple products having at least one keyword in common with the product, stated user preferences, user browser history, or user purchase history.

17. A computing device, comprising: a processor; a display element; and memory including instructions that, when executed by the processor, cause the computing device to: acquire an image corresponding to a field of view of a camera of a computing device, the image including a representation of text; analyze the image to recognize the representation of the text; analyze at least one data source to determine a business associated with the representation of text; display, in a graphical overlay over a portion of the image corresponding to the field of view of the camera and concurrently being displayed on the display element, at least one of results for one or more businesses or results for one or more products related to the business associated with the representation of text; and enable a user to select at least one of the results to obtain additional information for the business.

18. The computing device of claim 17, wherein the representation of the text is at least one of a phone number, a uniform resource locator (URL), an address, a name of the business.

19. The computing device of claim 17, wherein the results of the one or more businesses are displayed in a map view on the display element.

20. The computing device of claim 17, wherein the results for one or more businesses includes at least one of an advertisement or a related product or service available for purchase from the one or more businesses.

2 Comments on Amazon Scores Patent for Augmented Reality Recommendations

Comments are closed.