All Dates/Times are Australian Eastern Standard Time (AEST)

Technical Program

Paper Detail

Paper IDD6-S7-T3.3
Paper Title Learning under Distribution Mismatch and Model Misspecification
Authors Mohammad Saeed Masiha, Sharif University of Technology, Iran; Amin Gohari, Tehran Institute of Advanced Studies, Iran; Mohammad Hossein Yassaee, Mohammad Reza Aref, Sharif University of Technology, Iran
Session D6-S7-T3: Inference
Chaired Session: Tuesday, 20 July, 00:00 - 00:20
Engagement Session: Tuesday, 20 July, 00:20 - 00:40
Abstract We study learning algorithms when there is a mismatch between the distributions of the training and test datasets of a learning algorithm. The effect of this mismatch on the generalization error and model misspecification are quantified. Moreover, we provide a connection between the generalization error and the rate-distortion theory, which allows one to utilize bounds from the rate-distortion theory to derive new bounds on the generalization error and vice versa. In particular, the rate-distortion based bound strictly improves over the earlier bound by Xu and Raginsky even when there is no mismatch. We also discuss how “auxiliary loss functions" can be utilized to obtain upper bounds on the generalization error.