【講座題目】PDO-eConvs: Partial Differential Operator Based Equivariant Convolutions

【講座時(shí)間】2020年7月28日（星期二）上午8:35

【講座地點(diǎn)】網(wǎng)絡(luò)直播：https://live.bilibili.com/22339632

【主 講 人】林宙辰，北京大學(xué)教授

【主講人簡(jiǎn)介】

北京大學(xué)教授，IAPR/IEEE Fellow，國(guó)家杰青，中國(guó)圖象圖形學(xué)學(xué)會(huì)機(jī)器視覺專委會(huì)主任，中國(guó)自動(dòng)化學(xué)會(huì)模式識(shí)別與機(jī)器智能專委會(huì)副主任。研究領(lǐng)域?yàn)橛?jì)算機(jī)視覺、機(jī)器學(xué)習(xí)、圖像處理、模式識(shí)別和數(shù)值優(yōu)化。發(fā)表論文200余篇，英文專著2本。任 CVPR 2014/2016/2019/2020/2021 、 ICCV 2015 、 NIPS 2015/2018/2019/2020、ICML 2020、IJCAI 2020/2021、AAAI 2019/2020 和 ICLR 2021 領(lǐng)域主席，IEEE T. PAMI、IJCV 編委。

【內(nèi)容簡(jiǎn)介】

Recent research has shown that incorporating equivariance into neural network architectures is very helpful, and there have been some works investigating the equivariance of networks under group actions. However, as digital images and feature maps are on the discrete meshgrid, corresponding equivariance-preserving transformation groups are very limited. We deal with this issue from the connection between convolutions and partial differential operators (PDOs). In theory, assuming inputs to be smooth, we transform PDOs and propose a system which is equivariant to a much more general continuous group, the n-dimension Euclidean group. In implementation, we discretize the system using the numerical schemes of PDOs, deriving approximately equivariant convolutions (PDO-eConvs). Theoretically, the approximation error of PDO-eConvs is of the quadratic order. It is the first time that the error analysis is provided when the equivariance is approximate. Extensive experiments on rotated MNIST and natural image classification show that PDO-eConvs perform competitively yet use parameters much more efficiently. Particularly, compared with Wide ResNets, our methods result in better results using only 12.6% parameters.