AI Seminar: Towards Provable Unaligned Multimodal Learning: A Model Identification Perspective

Image
Xiao Fu
Event Speaker
Xiao Fu
Event Speaker Description
Associate Professor
School of Electrical Engineering and Computer Science
Oregon State University
Event Type
Artificial Intelligence
Date
Event Location
KEC 1001 and Zoom
Event Description

Zoom: https://oregonstate.zoom.us/s/98357211915

2023 was “the year of AI”, highlighted by the release of numerous AI models with remarkable capabilities. Multimodal learning is at the forefront of AI advancements, with state-of-the-art models like GPT-4 and Gemini emphasizing multimodal functionalities as their defining features. Despite its importance, many aspects of multimodal learning, and AI developments in general, still lack a concrete and comprehensive understanding---which is essential for building resilient and trustworthy systems. Our research focuses on the understanding of AI/ML systems to drive theory-backed advancements. From this perspective, this presentation revisits a core component of multimodal learning—Unsupervised Domain Translation (UDT). Many UDT systems, such as CycleGAN, use Distribution Matching (DM) modules, which often fail in content-aligned translations due to measure-preserving automorphism (MPA). Existing remedies fall short of guaranteed performance. In my talk, I will introduce a model identification perspective for UDT, overcoming the MPA issues and ensuring identifiability of the desired translation functions. This is the first proven identification result in UDT under CycleGAN’s settings, to our knowledge. We have also broadened these concepts, providing solutions for various translation challenges, enabling provable content-style disentanglement, and offering more versatile cross-domain data generation. These advancements promise significant theoretically supported enhancements for UDT applications, particularly in annotation-limited fields such as medicine and biology.

Speaker Biography

Xiao Fu has been with the School of Electrical Engineering and Computer Science, Oregon State University since 2017, where he is currently an Associate Professor. He received the Ph.D. degree in Electronic Engineering from The Chinese University of Hong Kong, in 2014. He was a Postdoctoral Associate with the Department of Electrical and Computer Engineering, University of Minnesota - Twin Cities, from 2014 to 2017. His research interests include the broad area of machine learning and signal processing, especially theory and algorithms. Dr. Fu received the Best Student Paper Award at ICASSP 2014, the 2022 IEEE Signal Processing Society (SPS) Best Paper Award, and the 2022 IEEE SPS Donald G. Fink Overview Paper Award. He also received the Outstanding Postdoctoral Scholar Award at University of Minnesota in 2016, the Engelbrecht Early Career Faculty Award from the College of Engineering at Oregon State University in 2023, and the National Science Foundation (NSF) CAREER Award in 2022.