10 October 2022 to 31 December 2028
Zoom Webinar
Europe/London timezone

Reverse-engineering deep neural networks

Date: Tuesday 7 November 2023 – 15:00 (Europe/London)
Speaker: Prof Ilya Kuprov, Professor of physics at the University of Southampton

Abstract

The lack of interpretability is a much-criticised feature of deep neural networks. Often, a neural network is effectively a black box. However, we have recently found a group-theoretical procedure that brings inner layer signalling into a human-readable form. We applied it to a signal processing network used in magnetic resonance spectroscopy, and found that the network spontaneously invents a bandpass filter, a notch filter, a frequency axis rescaling transformation, frequency division multiplexing, group embedding, spectral filtering regularisation, and a map from harmonic functions into Chebyshev polynomials – in ten minutes of unattended training.

This seminar is now also available on youtube: https://youtu.be/m5-U5k-Z9BU

Biography

Prof llya Kuprov FRSC is a British physicist whose research focuses on quantum theory of magnetic processes and nuclear magnetic resonance. He has received the 2022 Atreya Award for his work on magnetic resonance theory. Kuprov is a Professor of Physics at the School of Chemistry of the University of Southampton in the UK, a Deputy Editor at the Science Advances magazine, a Fellow of the Royal Society of Chemistry, and a Fellow of the International Society of Magnetic Resonance. In 2023, he has published a monograph on theoretical and computational spin dynamics. 

Kuprov completed his undergraduate studies in environmental chemistry at Novosibirsk State University in 2002, and moved to the UK in the same year. In 2005, he received his DPhil degree in physical chemistry from the Corpus Christi College of the University of Oxford under the direction of Peter Hore.

In 2005 Kuprov was elected a Fellow by Examination at Magdalen College, Oxford. In 2009, he received an EPSRC Early Career Fellowship, which he held at the Oxford Supercomputing Centre. In 2014 he was appointed Associate Professor at the University of Southampton and later promoted to Professor. In 2018, Kuprov has joined the editorial board of Science Advances as an Associate Editor; he became Deputy Editor in 2021. From 2010 to 2021 he had been a committee member and then the Secretary of the Electron Spin Resonance Group of the Royal Society of Chemistry.