Date & Time:
November 11, 2024 10:00 am – 11:00 am
Location:
Crerar 346, 5730 S. Ellis Ave., Chicago, IL,
11/11/2024 10:00 AM 11/11/2024 11:00 AM America/Chicago Megha Srivastava (Stanford)- New Challenges of Trust with Large-Scale AI Systems Crerar 346, 5730 S. Ellis Ave., Chicago, IL,

Abstract: Today’s large-scale AI systems, trained with > 200 billion parameters over massive datasets, create new challenges of trust as users have increasingly less control over all aspects of model development.
I will first do a deep dive on the challenge of auditing model training service providers, who currently fine-tune models on behalf of resource-poor clients for a fee without any guarantee of correctness. I will show how prior solutions to this “verifiable training” problem are non-robust due to hardware non-determinism, which we address via a threshold-based rounding scheme over intermediate computations during model training. I will then show how users of modern code-generation models may introduce accidental security vulnerabilities due to misplaced confidence. Finally, I will conclude by discussing ongoing work on the current limitations of methods that seek to establish trust via content provenance (e.g. watermarking, C2PA).

Speakers

Megha Srivastava

PhD Student, Stanford University

Megha Srivastava is a Ph.D. student at Stanford University, co-advised by Dorsa Sadigh and Dan Boneh. She is interested in addressing issues of reliability in machine learning models within the broader context of human-AI interaction. In addition to being supported by the NSF GRFP and IBM Ph.D. Fellowships, her research has been recognized with an ICML Best Paper Runner-Up Award and she was selected as a Rising Star in Machine Learning in 2023.

Related News & Events

simulated Roblox chat
UChicago CS News

Helping Elementary School Children Learn About Digital Privacy and Security With Micro-Lessons

Mar 25, 2025
grant ho writing on white board
UChicago CS News

New Study Reveals Gaps in Common Types of Cybersecurity Training

Mar 24, 2025
headshot
UChicago CS News

Jasmine Lu on Sustainable Computing: Rethinking E-Waste and Innovation

Mar 18, 2025
Pedro giving speech
UChicago CS News

Pedro Lopes Honored with 2025 IEEE VGTC Virtual Reality Significant New Researcher Award

Mar 13, 2025
ai generated network traffic
UChicago CS News

University of Chicago Researchers Revolutionize Network Traffic Generation with AI Breakthrough

Mar 12, 2025
UChicago CS News

Federal budget cuts threaten to decimate America’s AI superiority—and other countries are watching

Feb 25, 2025
Netflix logo on phone screen
UChicago CS News

The Hidden Cost of Netflix’s Autoplay: A Study on Viewing Patterns and User Control

Feb 25, 2025
Raul Castro Fernandez
UChicago CS News

Raul Castro Fernandez among six UChicago scientists awarded prestigious Sloan Fellowships in 2025

Feb 18, 2025
UChicago CS News

Quantum Leap: New Research Reveals Secrets of Random Quantum Circuits

Feb 04, 2025
UChicago CS News

Fred Chong from the Department of Computer Science Named ACM Fellow for Contributions to Quantum Computing

Jan 22, 2025
UChicago CS News

Rethinking AI as a Thought Partner: Perspectives on Writing, Programming, and More

Jan 16, 2025
UChicago CS News

UChicago Partners On New National Science Foundation Large-Scale Research Infrastructure For Education

Dec 10, 2024
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube