PIN: Prolate Spheroidal Wave Function-based Implicit Neural Representations

Dhananjaya Jayasundara, Heng Zhao, Demetrio Labate, Vishal M. Patel

Johns Hopkins University, University of Houston

Abstract

Implicit Neural Representations (INRs) provide a continuous mapping between signal coordinates and their values. The performance of INRs heavily depends on the choice of nonlinear activation functions, which has led to increased interest in encoding signals using diverse activations. Despite recent progress, existing INRs struggle with fine-scale representation, often introducing noise-like artifacts over smooth regions and showing poor generalization to unseen coordinates.

To address these limitations, we propose PINProlate Spheroidal Wave Function-based Implicit Neural Representations — which leverages the optimal space-frequency concentration of Prolate Spheroidal Wave Functions (PSWFs) as a nonlinear mechanism in INRs. Experimental results demonstrate that PIN not only excels at representing images and 3D shapes but also significantly outperforms state-of-the-art methods in generalization tasks such as image inpainting, novel view synthesis, edge detection, and denoising.

How PIN Works

Comparison of Activation Functions
Space-Frequency Tradeoff of Activations: The top row shows how activation values change with spatial distance, while the bottom row shows the corresponding frequency domain magnitudes. A compression in the spatial domain leads to a broader spectrum in the frequency domain, and vice versa — a phenomenon known as the space-frequency tradeoff. PSWFs offer optimal energy preservation across both domains.

BibTeX

Coming soon...