报告题目： Towards Robust ResNet: A Small Step but A Giant Leap
报告人： 张景锋 新加坡国立大学博士
泰山学堂2012级计算机取向毕业生
报告时间及地点：
5月23日19点山东大学中心校区知新楼B119
5月27日16点山东大学青岛校区振声苑S209
报告人简介：
Jingfeng Zhang is pursuing his Ph.D. degree under the supervision of Asst. Prof. Kian Hsiang Low & Prof. Mohan Kankanhalli at AI Singapore & N-CRiPT Center, at National University of Singapore. He currently works on robust machine learning collaborating with RIKEN-AIP and IBM Singapore. He is also a part-time consultant at ADDO AI. His current research interest lies in robustness in machine learning and privacy-preserving for machine learning.
报告内容：
For students in Jinan campus, I give an introduction to the general ideas in the field of Artificial Intelligence (AI). For students in Qingdao campus, I will introduce my work, which brings in a simple yet principled approach to boosting the robustness of the residual network (ResNet) that is motivated by the dynamical system perspective. Namely, a deep neural network can be interpreted using a partial differential equation, which naturally inspires us to characterize ResNet by an explicit Euler method. Our analytical studies reveal that the step factor h in the Euler method is able to control the robustness of ResNet in both its training and generalization. Specifically, we prove that a small step factor h can benefit the training robustness for back-propagation; from the view of forward-propagation, a small h can aid in the robustness of the model generalization. A comprehensive empirical evaluation on both vision CIFAR-10 and text AG-NEWS datasets confirms that a small h aids both the training and generalization robustness.
.
