Cooperating with Machines.
Since Alan Turing envisioned Artificial Intelligence (AI) , a majordriving force behind technical progress has been competition with humancognition. Historical milestones have been frequently associated with computersmatching or outperforming humans in difficult cognitive tasks (e.g. facerecognition , personality classification , driving cars , or playingvideo games ), or defeating humans in strategic zero-sum encounters (e.g.Chess , Checkers , Jeopardy! , Poker , or Go ). In contrast,less attention has been given to developing autonomous machines that establishmutually cooperative relationships with people who may not share the machine'spreferences. A main challenge has been that human cooperation does not requiresheer computational power, but rather relies on intuition , cultural norms, emotions and signals [13, 14, 15, 16], and pre-evolved dispositionstoward cooperation , common-sense mechanisms that are difficult to encodein machines for arbitrary contexts. Here, we combine a state-of-the-artmachine-learning algorithm with novel mechanisms for generating and acting onsignals to produce a new learning algorithm that cooperates with people andother machines at levels that rival human cooperation in a variety oftwo-player repeated stochastic games. This is the first general-purposealgorithm that is capable, given a description of a previously unseen gameenvironment, of learning to cooperate with people within short timescales inscenarios previously unanticipated by algorithm designers. This is achievedwithout complex opponent modeling or higher-order theories of mind, thusshowing that flexible, fast, and general human-machine cooperation iscomputationally achievable using a non-trivial, but ultimately simple, set ofalgorithmic mechanisms.
Continue reading and listening
Stay in the loop.
Subscribe to our newsletter for a weekly update on the latest podcast, news, events, and jobs postings.