Representation formulas and pointwise properties for Barron functions

06/10/2020
by   Weinan E, et al.
0

We study the natural function space for infinitely wide two-layer neural networks and establish different representation formulae. In two cases, we describe the space explicitly up to isomorphism. Using a convenient representation, we study the pointwise properties of two-layer networks and show that functions whose singular set is fractal or curved (for example distance functions from smooth submanifolds) cannot be represented by infinitely wide two-layer networks with finite path-norm.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset