Issue 6, 2024

CoDBench: a critical evaluation of data-driven models for continuous dynamical systems

Abstract

Continuous dynamical systems, characterized by differential equations, are ubiquitously used to model several important problems: plasma dynamics, flow through porous media, weather forecasting, and epidemic dynamics. Recently, a wide range of data-driven models has been used successfully to model these systems. However, in contrast to established fields like computer vision, limited studies are available analyzing the strengths and potential applications of different classes of these models that could steer decision-making in scientific machine learning. Here, we introduce CoDBench, an exhaustive benchmarking suite comprising 12 state-of-the-art data-driven models for solving differential equations. Specifically, we comprehensively evaluate 4 distinct categories of models, viz., feed forward neural networks, deep operator regression models, frequency-based neural operators, and transformer architectures against 10 widely applicable benchmark datasets encompassing challenges from fluid and solid mechanics. We conduct extensive experiments, assessing the operators' capabilities in learning, zero-shot super-resolution, data efficiency, robustness to noise, and computational efficiency. Interestingly, our findings highlight that current operators struggle with the newer mechanics datasets, motivating the need for more robust neural operators. All the datasets and codes are shared in an easy-to-use fashion for the scientific community. We hope this resource will be an impetus for accelerated progress and exploration in modeling dynamical systems. For codes and datasets, see: https://github.com/M3RG-IITD/cod-bench.

Graphical abstract: CoDBench: a critical evaluation of data-driven models for continuous dynamical systems

Supplementary files

Article information

Article type
Paper
Submitted
15 Jan 2024
Accepted
10 Apr 2024
First published
18 Apr 2024
This article is Open Access
Creative Commons BY license

Digital Discovery, 2024,3, 1172-1181

CoDBench: a critical evaluation of data-driven models for continuous dynamical systems

P. Burark, K. Tiwari, M. M. Rashid, P. A. P. and N. M. A. Krishnan, Digital Discovery, 2024, 3, 1172 DOI: 10.1039/D4DD00028E

This article is licensed under a Creative Commons Attribution 3.0 Unported Licence. You can use material from this article in other publications without requesting further permissions from the RSC, provided that the correct acknowledgement is given.

Read more about how to correctly acknowledge RSC content.

Social activity

Spotlight

Advertisements