Gave a 3-hours short course on SciML @SHTC, 2024

I am very happy to share that I delivered a 3-hour short course on Scientific Machine Learning (SciML) for computational physics at the ASME Summer Heat Transfer Conference (SHTC 2024) this week. https://event.asme.org/SHTC/Program/Short-Courses

During the course, we explored:

  • Using physics to regularize ML training and inform neural architecture design
  • Integrating ML with traditional numerical solvers using differentiable programming
  • Leveraging generative AI for modeling stochastic spatiotemporal processes

It was wonderful to see so many participants and to connect with researchers and students.

As requested, the slides from the tutorial are now available here https://www.dropbox.com/scl/fi/bp6inwy5kfp6rsg0oksrt/SciML-tutorial-Wang-public.pdf?rlkey=6bxmnigpnvc6w8pqfcaxcuns5&dl=0.

Thank you to everyone who attended and contributed to the discussions!

Invited seminar talk at Cornell on Neural Differentiable Physics

https://www.engineering.cornell.edu/events/mae-colloquium-professor-jian-xun-wang

Description

Title: Neural Differentiable Physics: Unifying Numerical PDEs and Deep Learning for Data-Augmented Computational Physics

Abstract:

Predictive modeling and simulation are essential for understanding, predicting, and controlling complex physical processes across many engineering disciplines. However, traditional numerical models, which are based on first principles, face significant challenges, especially for complex systems involving multiple interacting physics across a wide range of spatial and temporal scales. (1) A primary obstacle stems from our often-incomplete understanding of the underlying physics, which results in inadequate mathematical models that fail to accurately capture system behavior. (2) Additionally, the high computational demands of traditional solvers represent another substantial barrier, especially when real-time control or many repeated model queries are required, as in design optimization, inference, and uncertainty quantification. Fortunately, the continual evolution of sensing technology and the exponential increase in data availability have opened new avenues for the development of data-driven computational modeling frameworks. Bolstered by advanced machine learning and GPU computing techniques, these models hold the promise of greatly enhancing our predictive capabilities, effectively tackling the challenges posed by traditional numerical models. While data science and machine learning offer novel methods for computational mechanics models, challenges persist, such as the need for extensive data, limited generalizability, and lack of interpretability. Addressing existing challenges for predictive modeling issues requires innovative computational methods that integrate advanced machine learning techniques with physics principles. This talk will introduce some of our efforts along this direction, spotlighting the Neural Differentiable Physics, a novel SciML framework unifying classic numerical PDEs and advanced deep learning models for computational modeling of complex physical systems. Our approach centers on the integration of numerical PDE operators into neural architectures, enabling the fusion of prior knowledge of known physics, multi-resolution data, numerical techniques, and deep neural networks through differentiable programming. The way for integrating physics into the deep learning model represents a novel departure from existing SciML frameworks, such as Physics-Informed Neural Networks (PINNs). By combining the strengths of known physical principles and established numerical techniques with cutting-edge deep learning and AI technology, this innovative framework promises to inaugurate a new era in the understanding and modeling of complex physical systems, with far-reaching implications for science and engineering applications.

Invited talk at Workshop of Machine Learning for Computational Fluid and Solid Dynamics

Tuesday, February 19, 2019 – Thursday, February 21, 2019  [www] Santa Fe

Recent breakthroughs in machine learning (ML), including the stunning successes of AlphaZero and AlphaGo, have demonstrated tremendous potential for transforming scientific computing.  The application of these exciting advances in algorithms and computer architectures to the computational modeling and simulation community introduces several additional requirements and challenges beyond traditional applications such as data analytics and computer vision. These include physical constraints (the subject of CNLS Physics-Informed Machine Learning workshops in 2016 and 2018), the need for uncertainty quantification (UQ), and computational requirements for embedded ML models, e.g. for parameter tuning, sub-scale physics models, optimization, UQ, or data assimilation. This workshop will bring together international leaders in the development and application of ML methods for fluid and solid dynamics.