Gods and Robots In this episode of the podcast we shake things up! Neil is on the guest side of the table with his partner Rabbi Laura Janner-Klausner to discuss their upcoming project Gods and Robots. Katherine is joined on the host side by friend of the show professor Michael Littman. See... See More Episodes arXiv Whitepapers When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards Large Language Model (LLM) leaderboards based on benchmark rankings are regularly used to guide practitioners in model selection. Often, the published leaderboard rankings are taken at face value - we show this is a (potentially costly) mistake. Under existing leaderboards, the relative performance... Dialect prejudice predicts AI decisions about people's character, employability, and criminality Hundreds of millions of people now interact with language models, with uses ranging from serving as a writing aid to informing hiring decisions. Yet these language models are known to perpetuate systematic racial prejudices, making their judgments biased in problematic ways about groups like African... Foundation Model Transparency Reports Foundation models are critical digital technologies with sweeping societal impact that necessitates transparency. To codify how foundation model developers should provide transparency about the development and deployment of their models, we propose Foundation Model Transparency Reports, drawing upon... More featured content News Articles AI agents help explain other AI systems We used AI and satellite imagery to map ocean activities that take place out of sight, including fishing, shipping and energy development Stay in the loop. Subscribe to our newsletter for a weekly update on the latest podcast, news, events, and jobs postings. E-mail Leave this field blank Multiple AI models help robots execute complex plans more transparently AI can now attend a meeting and write code for you – here’s why you should be cautious MIT engineers are on a failure-finding mission Data poisoning: how artists are sabotaging AI to take revenge on image generators Image recognition accuracy: An unseen challenge confounding today’s AI Automated system teaches users when to collaborate with an AI assistant Forget dystopian scenarios – AI is pervasive today, and the risks are often hidden AI accelerates problem-solving in complex scenarios More news