Anki’s next smart toy is an A.I. robot named Cozmo

Anki has a big hit with its iPhone-controlled Anki Overdrive race cars that use sophisticated artificial intelligence. And now it has its second act in the form of a cute, smart A.I. toy robot named Cozmo.

Cozmo is a playful, intelligent, and seemingly sentient being that is aware of people and its surroundings. It is a labor of love for San Francisco-based Anki, which has worked on 45 different versions of the toy over the past four-and-a-half years. You could think of Cozmo as something like Eve the robot in Pixar’s Wall-E animated film. I saw a demo of the toy, and it has a mind and personality of its own.

Using the computing power of a connected iPhone, Cozmo can recognize a face or detect when it’s about to roll off a table edge. It can also play simple games and stack blocks.

“Cozmo is a real-life robotic character,” said Hanns Tappeiner, cofounder and president of Anki, in an interview with GamesBeat. “We asked ourselves a question. ‘If you take a robot you see in movies and make him real and physical, what would he do?'”

Above: Cozmo co-creator Hanns Tappeiner, cofounder of Anki.

Image Credit: Dean Takahashi

Tappeiner said that Cozmo is based on cutting-edge A.I. technology that the company also used to create its smart toy cars. But while the cars were successful and fun to play with, they had limitations. You couldn’t really turn them into characters, unless you painted cars on them the way that Disney did in the film Cars.

By contrast, Cozmo is born to be playful. It is charming, mischievous, and unpredictable. It recognizes and remembers you. It interacts with you, plays games, and gets to know you over time. Until now, animated characters that we fall in love with have been stuck on the big screen, Tappeiner said. Cozmo combines the best of animation — humor, personality, and emotional connection — with robotics and gameplay.

Under the hood, Cozmo is very sophisticated for a robot. It was developed by a multidisciplinary team of PhD roboticists, veteran animators, renowned game developers, and a lead designer of the Batmobile. It is a product at the intersection of film, toys, video games, and robotics.

Above: Cozmo can recognize your face.

Image Credit: Anki

Powered by advanced robotics, A.I., and computer vision, Cozmo has a brain that processes more data per second than all the Mars rovers combined. Robots with comparable capabilities are found in labs for thousands of dollars and stand several feet tall. More than 300 parts make up this robot that fits in the palm of your hand. I got a look inside Cozmo and saw lots of tiny gears.

Cozmo uses tech, such as computer vision, animatronics, motors, and A.I. software. It has three ARM-based microprocessors running on Android and iOS.

“We showed Cozmo to some of our friends at Carnegie Mellon and Stanford, and they are freaking out,” Tappeiner said. “So we decided to make a software development kit available, so they can make software to run on it.”

Cozmo has a color display that represents its face, and you can see its expressive eyes, which light up if it sees a familiar person. Its built-in emotion engine produces a variety of expressions on its face. Cozmo also has its own voice and language, as well as a dynamic soundtrack that matches his mood and corresponds with games and activities.

In setting up a demo, Tappeiner said, “I don’t know exactly what will happen in the demo. That is because his model is set up after the behavior of live beings like pets.”

Cozmo started on its charger. Then Tappeiner woke it up. It rolled over and detected the end of the table. Cozmo scans its environment constantly. If it picks up a block correctly, its confidence will go up. Tappeiner put a small crate on the table and Cozmo got excited. It picked it up and stacked it on another box. We also played a game where you have to tap the box if the colored lights on both boxes match. The one who taps the boxes first gets a point. Cozmo beat me the first time, and then I beat it the second time.

Cozmo’s eyes change color from blue to green when its mood changes. It can yawn, sneeze violently, or shiver.

“We can train him the way you train a puppy,” Tappeiner said. “We can’t tell him to do everything with a command. We can … suggest something that he can do, but he may decide to do something else.”

That means that Cozmo has emergent behavior that isn’t repetitive. And that makes it fun to play with Cozmo over and over.

“There are hundreds and hundreds of behaviors possible,” Tappeiner said.

It took a long time to get it right. The team looked at big robots, but it wanted the toy to move fast. Big robots that move fast can be dangerous, so the team downsized the design. The final design is made from 340 parts, and it has four motors, a camera, and an OLED display. That’s a lot of stuff for something that behaves a little like a cat. When you put Cozmo on a charger, it goes to sleep and snores.

“Our animation studio director came from Pixar, but our inspiration came from a lot of different robots like R2-D2, Short Circuit, and Wall-E,” Tappeiner said.

Cozmo works with an iOS or Android device. It will debut in the U.S. in October for $180. That’s a pretty low price for a toy robot that is packed with a lot of smarts and sensors.

With Cozmo, Anki is seeing another payoff on its long research cycle. Anki was founded in 2010 by three Carnegie Mellon Robotics Institute graduates — Boris Sofman, CEO; Mark Palatucci, chief product officer; and Tappeiner — who had already been working on A.I. tech for years. They launched the Anki Drive racing toy in 2013 as one of the first iPhone-based smart toys. They launched Anki Overdrive in 2015, and they’re debuting Anki Supertrucks later this year.

Anki recently raised $52.5 million from J.P. Morgan, and it has raised $185.2 million to date from investors that include Andreessen Horowitz, Index Ventures, and Two Sigma. Players have logged in 3.2 million hours of gameplay, driven more than 2 million miles, and built nearly 55,000 different track configurations on Overdrive to date.

More robots could come in the future, as “Cozmo is just the first in an ecosystem of characters,” Tappeiner said.