Please read these instructions before posting any event on Fermilab Indico

Indico will be unavailable for scheduled server patching on Wednesday, April 17; 7 a.m. to 7:30 a.m. Central Time .
Jun 26 – 27, 2023
Fermilab
America/Chicago timezone

WavPool: A New Block for Deep Neural Networks

Jun 27, 2023, 4:45 PM
15m
One West (Fermilab)

One West

Fermilab

Speaker

Margaret Voetberg (Fermi National Accelerator Laboratory)

Description

Modern deep neural networks comprise many operational layers, such as dense or convolutional layers, which are often collected into blocks.In this work, we introduce a new, wavelet-transform-based network architecture that we call the multi-resolution perceptron: by adding a pooling layer, we create a new network block, the WavPool.

The first step of the multi-resolution perceptron is transforming the data into its multi-resolution decomposition form by convolving the input data with filters of fixed coefficients but increasing size. Following image processing techniques, we are able to make scale and spatial information simultaneously accessible to the network without increasing the size of the data vector. This makes it promising for problems such as particle classification, where both size and spatial relationship of input images is important, and increasing the size of the networks through adding stacked convolutional layers is computationally prohibitive.

WavPool outperforms a similar multilayer perceptron while using fewer parameters, and outperforms a comparable convolutional neural network by 10% on relative accuracy on CIFAR-10.

Primary authors

Margaret Voetberg (Fermi National Accelerator Laboratory) Dr Samuel McDermott (UChicago Dept of Astronomy & Astrophysics)

Co-author

Brian Nord (Fermilab)

Presentation materials