"Creating movement from scratch is what I was always interested in," he says.Now, all this expertise is coming together in an unexpected way.
Basically, the bots navigate their world through extreme trial and error, carefully keeping track of what works and what doesn't as they reach for a reward, like arriving at a landmark.
If a particular action helps them achieve that reward, they know to keep doing it.
They would, for instance, pretend to be very interested in one specific item – so that they could later pretend they were making a big sacrifice in giving it up, according to a paper published by FAIR.
(Researchers did not shut down the programs because they were afraid of the results or had panicked, as has been suggested elsewhere, but because they were looking for them to behave differently.) The chatbots also learned to negotiate in ways that seem very human.
He's building virtual worlds where software bots learn to create their own language out of necessity.
As detailed in a research paper published by Open AI this week, Mordatch and his collaborators created a world where bots are charged with completing certain tasks, like moving themselves to a particular landmark.
The actual negotiations appear very odd, and don't look especially useful: Bob: i can i i everything else .
Alice: balls have zero to me to me to me to me to me to me to me to me to Bob: you i everything else .
Earlier this year, Google revealed that the AI it uses for its Translate tool had created its own language, which it would translate things into and then out of.
(That paper was published more than a month ago but began to pick up interest this week.) Facebook's experiment isn't the only time that artificial intelligence has invented new forms of language.
Born in Ukraine and raised in Toronto, the 31-year-old is now a visiting researcher at Open AI, the artificial intelligence lab started by Tesla founder Elon Musk and Y combinator president Sam Altman.