Measuring The Speed of AI Through Benchmarks

David Kanter, Executive Director at MLCommons, discusses the work they’re doing with MLPerf Benchmarks, creating the world’s first industry standard approach to measuring AI speed and safety. He also shares ways they’re testing AI and LLMs for harm, to measure—and, over time, reduce—the potential harms of AI. Key Takeaways:  How they’re using research to help build public confidence in AI and emerging technologies The types of questions enterprise customers should ask their system providers AI safety, and the ways MLCommons is using benchmarks to offer standardized measurements about the potential harm of using AI Unique applications of AI, human creativity as the only limit on where AI can go, and how we can make analog experiences more intelligent in the future Guest Bio:  David Kanter is a founder, board member, and the Executive Director of MLCommons where he helps lead the MLPerf benchmarks and other initiatives. He has 16+ years of experience in semiconductors, computing, and machine learning. David founded a microprocessor and compiler startup, was an early employee at Aster Data Systems, and has consulted for industry leaders such as Intel, Nvidia, KLA, Applied Materials, Qualcomm, Microsoft, and many others. He holds a Bachelor of Science degree with honors in Mathematics and a specialization in Computer Science, and a Bachelor of Arts with honors in Economics, both from the University of Chicago. ---------------------------------------------------------------------------------------- About this Show: The Brave Technologist is here to shed light on the opportunities and challenges of emerging tech. To make it digestible, less scary, and more approachable for all! Join us as we embark on a mission to demystify artificial intelligence, challenge the status quo, and empower everyday people to embrace the digital revolution. Whether you're a tech enthusiast, a curious mind, or an industry professional, this podcast invites you to join the conversation and explore the future of AI together. The Brave Technologist Podcast is hosted by Luke Mulks, VP Business Operations at Brave Software—makers of the privacy-respecting Brave browser and Search engine, and now powering AI everywhere with the Brave Search API. Music by: Ari Dvorin Produced by: Sam Laliberte