Reports said the “AI” was largely 1000+ people in India watching the cameras.
If Amazon actually managed to build AI that worked well at a decent cost point it would have been great since nobody likes those silly self checkout machines.
What’s amusing about all of this is that before it got leaked that it was basically a bunch of people in India watching cameras Amazon folks spoke about the tech like there was some super secret AI they developed. Since that story broke nobody there seems to want to talk about “just walk out” anymore.
I have little trust that a corporate behemoth will do right by me and refund the discrepancy at an unspecified later time as it says it will on checkout.
This was totally fake news though. Those people were labeling training data and reviewing low confidence labels, after the fact. There wasn't ever live monitoring of shoppers.
¹ Individuals manning a labyrinthine system of cameras and sensor fusion, like hawks, logging the precise moment you plop a Twix into your basket! Praise Bezos!
"Do things that don't scale."
It was as if they expected everyone to know what to do, but when I’d watch 99% of people just sort of looked at the store, saw the odd gate things, and then just shrugged and walked off. The stores were almost always completely empty amidst a busy concourse.
Even if the tech worked (reports say it didn’t work well) they completely missed the boat on creating a clear customer experience that navigated the new tech.
As for the big Amazon Fresh grocery stores, I only have one out of my way so I only visited once or twice, but the big things I noticed were that it had a small selection and very average prices. Not that surprising because even after buying Whole Foods, Amazon itself has terrible prices on dry goods (meaning supermarket items besides fresh food), and relies heavily on random third-party sellers with big markups for a ton of it.
If they really wanted to get people to buy into Amazon Fresh it would have taken a lot more money (and thus pretty unprofitable for a long while): Probably one way to do that would have been making it as attractive as Costco for Prime members.
Optimus and Robotaxi are just as fake and Elon Musk never shuts up about them.
I guess Amazon never learned the important lesson that the OP meta for modern technology companies is just to consistently and blatantly lie.
I've gotten into the habit of stopping in to wander the aisles and check prices because of it (e.g. I stocked up on a bunch of canned soup when most (but not all) Progresso soups were $0.44 a month or two back, and I picked up some microwavable rice+quinoa pouches for my wife at $0.35 each a couple weeks ago, but the inconsistency and overall not great prices mean it can't be my go-to grocery destination.
I'm sure the one by me will be closing since there's a significantly larger Whole Foods just a few miles away.
I remember WAY back in the day when Arby's implemented touch screen ordering (on CRTs!) and it was a very quirky process. An Arby's employee would sit behind the counter and stare at you while you spent 5 minutes poking a CRT display. Very slow and very impersonal. They discontinued them in a short period of time.
The Go stores were a great experience but they would certainly be uncomfortable for anyone other than early-adopter or tech-forward types of people. I would just walk in with my own bag, and put items directly from the shelf into the bag, and walk out the door. It was extremely convenient and fast once you got over how weird it felt.
I think they could have done a lot more in giving social clues on both the way in and way out.
I've watched so many people struggle to use these machines for so many different reasons. Pretty much anyone with a physical or cognitive disability will be better off with the cashier. Sucks they have to wait much longer for one now.
I am quite privileged and I know numerous people who might have trouble telling you the name of the meal they want even if presented with a hard copy of a menu.
It's convenient; I only ever remember one problem where it thought I had purchased an item that I picked up and decided on something else. I disputed it online and it was resolved in a day.
Oh man this is what consumers would love to do, have to constantly adjudicate false positives online which they'd have to track to make sure didn't happen. What nonsense.
The main thing I use it for is convenient returns, which is why I’m disappointed in this news. I hardly ever buy things there other than things like gum or chips.
one minor downside (especially since I don't live on campus anymore) is that in order to walk around and peruse the shelves, I have to give them my payment info just to enter
So no I didn't feel like I was a thief. But I felt like they assumed I was a thief. My guess is most stores are heavily surveilled nowadays, so it might be unreasonable for me to feel this way with Amazon but not Walmart or Target or Kroger, but that's how it felt.
The Home Depot cameras and screens that "BING BONG" loudly as you pass by to get you to notice them showing that they are recording you are also highly annoying.
I wish there was a greater variety of hardware stores near me...
That's one way to spin things I guess.
The interesting question isn't whether the tech was ready. It wasn't. The question is whether Amazon learned anything useful from the attempt.
Computer vision for retail checkout is a legitimate hard problem. Occlusion, similar-looking products, people changing their minds. I've worked on CV pipelines and the gap between "works in the demo" and "works at scale" is brutal.
My guess: they collected a ton of training data from those human reviewers. Whether they'll use it for a v2 or just write it off, who knows.
Knowing this, it was over before it ever started. Beyond the masses of people already having aversion to the oddness of how it worked and likely never wanting to try it, these and others would swear off the store forever the first time they ever got charged for something they didn't take. No one wants to monitor and fix erroneous purchase errors.
I know at some point they got caught basically paying people to watch cameras to figure out what products people we're grabbing. I'm sure were either at the point or very close to the point where AI can successfully do this basically 100% of the time.
So I doubt it's the tech aspect of this, more just the grossness a person feels walking into a store with Amazon's name on it. Compare this to whole foods.
I suspect that they wanted to take a hail marry to see if somehow it was possible to get much greater efficiency compared to standard grocers, and it looks like that failed.
[1] it may come back. The technology is rapidly improving but they have bigger fish to fry ATM.