Tutorial on high-degree polynomial networks

News

August 2022: We have released the slides used in the tutorial. Link: https://www.slideshare.net/GrigorisChrysos/tutorial-on-polynomial-networks-at-cvpr22.

July 2022: As part of the tutorial, we have released the source code for demo examples on how to use polynomial nets. Link: https://github.com/polynomial-nets/tutorial-2022-intro-polynomial-nets.

Overview

Polynomial networks enable a new network design that treats a network as a high-degree polynomial expansion of the input. Recently, polynomial networks have demonstrated state-of-the-art performance in a range of tasks. Despite the fact that polynomial networks have appeared for several decades in machine learning and complex systems, they are not widely acknowledged for their role in modern deep learning.

In this tutorial we intend to bridge the gap and draw parallelisms between modern deep learning approaches and polynomial networks. To this end, we will share recent developments on the topic, as well as explain the required tools.