SFU MOCAD Seminar: Laura Weidensager
Topic
Fast high-dimensional approximation: ANOVA methods for wavelets and random Fourier features
Speakers
Details
In this talk, we focus on the problem of reconstructing a multivariate function from discrete d-dimensional samples. Beyond achieving accurate function recovery, we aim to enhance interpretability by identifying how individual variables and their interactions influence the target function. To this end, we develop several efficient hybrid methods that combine the ANOVA decomposition, wavelet techniques, and random Fourier features. The multi-resolution capabilities of wavelets and the scalability of random Fourier features, paired with the interpretability provided by the ANOVA decomposition, enable a robust framework for high-dimensional function approximation. The approaches in this talk address both, computational efficiency and transparency.
The total approximation error is influenced by three main components. First, the ANOVA truncation to a function of low effective dimension is the basis for the construction of ANOVA-boosting algorithms, which exploit the structure of the function. Second, the projection onto a finite-dimensional subspace is determined by the choice of basis functions. To analyze the projection error, we explore and discuss wavelet characterizations of functions in certain function spaces, like Sobolev and Besov spasces. Finally, for the regression from samples, we give error bounds for the least squares approximation, which asymptotically coincides with the behavior of the projection error.