arXiv / 2025

Fourier Learning Machines: Nonharmonic Fourier-Based Neural Networks for Scientific Machine Learning

Mominul Rubel, Adam Meyers, Gabriel Nicolosi

Foundation ModelsInterpretabilityLarge Language ModelsOptimizationPopular and Landmark PapersProbabilistic ML

We introduce the Fourier Learning Machine (FLM), a neural network (NN) architecture designed to represent a multidimensional nonharmonic Fourier series. The FLM uses a simple feedforward structure with cosine activation functions to learn the frequencies, amplitudes, and phase shifts of the series as trainable parameters. This design allows the model to create a problem-specific spectral basis adaptable to both periodic and nonperiodic functions. Unlike previous Fourier-inspired NN models, the FLM is the first architecture able to represent a multidimensional Fourier series with a complete set of basis functions in separable form, doing so by using a standard Multilayer Perceptron-like architecture. A one-to-one correspondence between the Fourier coefficients and amplitudes and phase-shifts is demonstrated, allowing for the translation between a full, separable basis form and the cosine phase-shifted one. Additionally, we evaluate the performance of FLMs on several scientific computing problems, including benchmark Partial Differential Equations (PDEs) and a family of Optimal Control Problems (OCPs). Computational experiments show that the performance of FLMs is comparable, and often superior, to that of established architectures like SIREN and vanilla feedforward NNs.

0 citations0 influential

Full paper

Read the original paper

Open PDF Source page

Learning resources

arXiv PDFPDF arXiv abstract pagearXiv Google Scholar referencesGoogle Scholar Papers with Code searchPapers with Code YouTube explanationsYouTube

Reading state

Discuss in ChatGPT

Uses your own ChatGPT account. The paper context is copied into a tutor prompt before ChatGPT opens.

Preview prompt

You are my AI/ML research paper instructor. I want to deeply understand the paper below.

First, teach it in layers:
1. One-paragraph intuition.
2. Problem statement and why it mattered.
3. Key method, architecture, or algorithm.
4. Important equations or mechanisms, explained intuitively.
5. Experiments and evidence.
6. Limitations, assumptions, and failure modes.
7. How this paper influenced later AI/ML/Deep Learning/GenAI work.
8. A 30-minute study plan with checkpoints.
9. Quiz me with 5 questions and wait for my answers.

When something is not available in the attached context, say what is missing and infer carefully.

### Paper attached as context
Title: Fourier Learning Machines: Nonharmonic Fourier-Based Neural Networks for Scientific Machine Learning
Authors: Mominul Rubel, Adam Meyers, Gabriel Nicolosi
Year: 2025
Venue: arXiv
Categories: Foundation Models, Interpretability, Large Language Models, Optimization, Popular and Landmark Papers, Probabilistic ML
Citations: 0
Paper URL: https://arxiv.org/abs/2509.08759v3
Open PDF: https://arxiv.org/pdf/2509.08759v3

Abstract:
We introduce the Fourier Learning Machine (FLM), a neural network (NN) architecture designed to represent a multidimensional nonharmonic Fourier series. The FLM uses a simple feedforward structure with cosine activation functions to learn the frequencies, amplitudes, and phase shifts of the series as trainable parameters. This design allows the model to create a problem-specific spectral basis adaptable to both periodic and nonperiodic functions. Unlike previous Fourier-inspired NN models, the FLM is the first architecture able to represent a multidimensional Fourier series with a complete set of basis functions in separable form, doing so by using a standard Multilayer Perceptron-like architecture. A one-to-one correspondence between the Fourier coefficients and amplitudes and phase-shifts is demonstrated, allowing for the translation between a full, separable basis form and the cosine phase-shifted one. Additionally, we evaluate the performance of FLMs on several scientific computing problems, including benchmark Partial Differential Equations (PDEs) and a family of Optimal Control Problems (OCPs). Computational experiments show that the performance of FLMs is comparable, and often superior, to that of established architectures like SIREN and vanilla feedforward NNs.

Learning resources:
- PDF: arXiv PDF (https://arxiv.org/pdf/2509.08759v3)
- arXiv: arXiv abstract page (https://arxiv.org/abs/2509.08759v3)
- Google Scholar: Google Scholar references (https://scholar.google.com/scholar?q=Fourier%20Learning%20Machines%3A%20Nonharmonic%20Fourier-Based%20Neural%20Networks%20for%20Scientific%20Machine%20Learning)
- Papers with Code: Papers with Code search (https://paperswithcode.com/search?q=Fourier%20Learning%20Machines%3A%20Nonharmonic%20Fourier-Based%20Neural%20Networks%20for%20Scientific%20Machine%20Learning)
- YouTube: YouTube explanations (https://www.youtube.com/results?search_query=Fourier%20Learning%20Machines%3A%20Nonharmonic%20Fourier-Based%20Neural%20Networks%20for%20Scientific%20Machine%20Learning+paper+explained)