Date & Time:
November 11, 2024 10:00 am – 11:00 am
Location:
Crerar 346, 5730 S. Ellis Ave., Chicago, IL,
11/11/2024 10:00 AM 11/11/2024 11:00 AM America/Chicago Megha Srivastava (Stanford)- New Challenges of Trust with Large-Scale AI Systems Crerar 346, 5730 S. Ellis Ave., Chicago, IL,

Abstract: Today’s large-scale AI systems, trained with > 200 billion parameters over massive datasets, create new challenges of trust as users have increasingly less control over all aspects of model development.
I will first do a deep dive on the challenge of auditing model training service providers, who currently fine-tune models on behalf of resource-poor clients for a fee without any guarantee of correctness. I will show how prior solutions to this “verifiable training” problem are non-robust due to hardware non-determinism, which we address via a threshold-based rounding scheme over intermediate computations during model training. I will then show how users of modern code-generation models may introduce accidental security vulnerabilities due to misplaced confidence. Finally, I will conclude by discussing ongoing work on the current limitations of methods that seek to establish trust via content provenance (e.g. watermarking, C2PA).

Speakers

Megha Srivastava

PhD Student, Stanford University

Megha Srivastava is a Ph.D. student at Stanford University, co-advised by Dorsa Sadigh and Dan Boneh. She is interested in addressing issues of reliability in machine learning models within the broader context of human-AI interaction. In addition to being supported by the NSF GRFP and IBM Ph.D. Fellowships, her research has been recognized with an ICML Best Paper Runner-Up Award and she was selected as a Rising Star in Machine Learning in 2023.

Related News & Events

collage of photos from conference
UChicago CS News

Innovation at the Forefront: UChicago CS Researchers Make Significant Contributions to CHI 2025

Apr 23, 2025
sign
UChicago CS News

The University of Chicago Hosts the First Great Lakes Graphics Workshop

Apr 23, 2025
headshots
In the News

Quantum Materials, Built By AI Robot

Apr 22, 2025
UChicago CS News

New Research Explores Augmented Breathing Through Thermal Feedback

Apr 21, 2025
headshot
UChicago CS News

University of Chicago’s Fred Chong Awarded $2 Million for Innovative Quantum Computing Cancer Research Project

Apr 04, 2025
simulated Roblox chat
UChicago CS News

Helping Elementary School Children Learn About Digital Privacy and Security With Micro-Lessons

Mar 25, 2025
grant ho writing on white board
UChicago CS News

New Study Reveals Gaps in Common Types of Cybersecurity Training

Mar 24, 2025
headshot
UChicago CS News

Jasmine Lu on Sustainable Computing: Rethinking E-Waste and Innovation

Mar 18, 2025
Pedro giving speech
UChicago CS News

Pedro Lopes Honored with 2025 IEEE VGTC Virtual Reality Significant New Researcher Award

Mar 13, 2025
ai generated network traffic
UChicago CS News

University of Chicago Researchers Revolutionize Network Traffic Generation with AI Breakthrough

Mar 12, 2025
UChicago CS News

Federal budget cuts threaten to decimate America’s AI superiority—and other countries are watching

Feb 25, 2025
Netflix logo on phone screen
UChicago CS News

The Hidden Cost of Netflix’s Autoplay: A Study on Viewing Patterns and User Control

Feb 25, 2025
arrow-down-largearrow-left-largearrow-right-large-greyarrow-right-large-yellowarrow-right-largearrow-right-smallbutton-arrowclosedocumentfacebookfacet-arrow-down-whitefacet-arrow-downPage 1CheckedCheckedicon-apple-t5backgroundLayer 1icon-google-t5icon-office365-t5icon-outlook-t5backgroundLayer 1icon-outlookcom-t5backgroundLayer 1icon-yahoo-t5backgroundLayer 1internal-yellowinternalintranetlinkedinlinkoutpauseplaypresentationsearch-bluesearchshareslider-arrow-nextslider-arrow-prevtwittervideoyoutube