-
Reinforcement learning for anisotropic p-adaptation and error estimation in high-order solvers
Authors:
David Huergo,
Martín de Frutos,
Eduardo Jané,
Oscar A. Marino,
Gonzalo Rubio,
Esteban Ferrer
Abstract:
We present a novel approach to automate and optimize anisotropic p-adaptation in high-order h/p solvers using Reinforcement Learning (RL). The dynamic RL adaptation uses the evolving solution to adjust the high-order polynomials. We develop an offline training approach, decoupled from the main solver, which shows minimal overcost when performing simulations. In addition, we derive an inexpensive R…
▽ More
We present a novel approach to automate and optimize anisotropic p-adaptation in high-order h/p solvers using Reinforcement Learning (RL). The dynamic RL adaptation uses the evolving solution to adjust the high-order polynomials. We develop an offline training approach, decoupled from the main solver, which shows minimal overcost when performing simulations. In addition, we derive an inexpensive RL-based error estimation approach that enables the quantification of local discretization errors. The proposed methodology is agnostic to both the computational mesh and the partial differential equation to be solved.
The application of RL to mesh adaptation offers several benefits. It enables automated and adaptive mesh refinement, reducing the need for manual intervention. It optimizes computational resources by dynamically allocating high-order polynomials where necessary and minimizing refinement in stable regions. This leads to computational cost savings while maintaining the accuracy of the solution. Furthermore, RL allows for the exploration of unconventional mesh adaptations, potentially enhancing the accuracy and robustness of simulations. This work extends our original research, offering a more robust, reproducible, and generalizable approach applicable to complex three-dimensional problems. We provide validation for laminar and turbulent cases: circular cylinders, Taylor Green Vortex and a 10MW wind turbine to illustrate the flexibility of the proposed approach.
△ Less
Submitted 4 October, 2024; v1 submitted 26 July, 2024;
originally announced July 2024.
-
Deep Reinforcement Learning for Multi-Objective Optimization: Enhancing Wind Turbine Energy Generation while Mitigating Noise Emissions
Authors:
Martín de Frutos,
Oscar A. Marino,
David Huergo,
Esteban Ferrer
Abstract:
We develop a torque-pitch control framework using deep reinforcement learning for wind turbines to optimize the generation of wind turbine energy while minimizing operational noise. We employ a double deep Q-learning, coupled to a blade element momentum solver, to enable precise control over wind turbine parameters. In addition to the blade element momentum, we use the wind turbine acoustic model…
▽ More
We develop a torque-pitch control framework using deep reinforcement learning for wind turbines to optimize the generation of wind turbine energy while minimizing operational noise. We employ a double deep Q-learning, coupled to a blade element momentum solver, to enable precise control over wind turbine parameters. In addition to the blade element momentum, we use the wind turbine acoustic model of Brooks Pope and Marcolini. Through training with simple winds, the agent learns optimal control policies that allow efficient control for complex turbulent winds. Our experiments demonstrate that the reinforcement learning is able to find optima at the Pareto front, when maximizing energy while minimizing noise. In addition, the adaptability of the reinforcement learning agent to changing turbulent wind conditions, underscores its efficacy for real-world applications. We validate the methodology using a SWT2.3-93 wind turbine with a rated power of 2.3 MW. We compare the reinforcement learning control to classic controls to show that they are comparable when not taking into account noise emissions. When including a maximum limit of 45 dB to the noise produced (100 meters downwind of the turbine), the extracted yearly energy decreases by 22%. The methodology is flexible and allows for easy tuning of the objectives and constraints through the reward definitions, resulting in a flexible multi-objective optimization framework for wind turbine control. Overall, our findings highlight the potential of RL-based control strategies to improve wind turbine efficiency while mitigating noise pollution, thus advancing sustainable energy generation technologies
△ Less
Submitted 18 July, 2024;
originally announced July 2024.
-
Modelling Wind Turbines via Actuator Lines in High-Order h/p Solvers
Authors:
Oscar A. Marino,
Raúl Sanz,
Stefano Colombo,
Ananth Sivaramakrishnan,
Esteban Ferrer
Abstract:
This paper compares two actuator line methodologies for modelling wind turbines employing high-order h/p solvers and large-eddy simulations. The methods combine the accuracy of high-order solvers (in this work the maximum order is 6) with the computational efficiency of actuator lines to capture the aerodynamic effects of wind turbine blades.
Comparisons with experiments validate the actuator li…
▽ More
This paper compares two actuator line methodologies for modelling wind turbines employing high-order h/p solvers and large-eddy simulations. The methods combine the accuracy of high-order solvers (in this work the maximum order is 6) with the computational efficiency of actuator lines to capture the aerodynamic effects of wind turbine blades.
Comparisons with experiments validate the actuator line methodologies. We explore the effects of the polynomial order and the smoothing parameter associated with the Gaussian regularization function, and use them to blend the actuator line forcing in the high-order computational mesh, to show that both parameters influence the distribution of forces along the blades and the turbine wake. The greatest impact is obtained when the polynomial order is increased, allowing one to better capture the physics without requiring new meshes.
When comparing the actuator line methodologies, we show the advantages of performing weighted sums, over element averages, to compute the blade velocities and forces in high-order solvers. For low-order simulations (low polynomial orders), both methods provide similar results, but as the polynomial order is increased, the weighted sum method shows smoother thrust/torque distributions and better wake resolution. Furthermore, cell averaging introduces nonphysical oscillations when increasing the polynomial order beyond 3 (4th order accuracy).
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Low-cost wind turbine aeroacoustic predictions using actuator lines
Authors:
Laura Botero-Bolivar,
Oscar A Marino,
Cornelis H. Venner,
Leandro D. de Santana,
Esteban Ferrer
Abstract:
Aerodynamic noise is a limitation for further exploitation of wind energy resources. As this type of noise is caused by the interaction of turbulent flow with the airframe, a detailed resolution of the flow is necessary to obtain an accurate prediction of the far-field noise. Computational fluid dynamic (CFD) solvers simulate the flow field but only at a high computational cost, which is much incr…
▽ More
Aerodynamic noise is a limitation for further exploitation of wind energy resources. As this type of noise is caused by the interaction of turbulent flow with the airframe, a detailed resolution of the flow is necessary to obtain an accurate prediction of the far-field noise. Computational fluid dynamic (CFD) solvers simulate the flow field but only at a high computational cost, which is much increased when the acoustic field is resolved. Therefore, wind turbine noise predictions using numerical approaches remain a challenge. This paper presents a methodology that couples (relatively fast) wind turbine CFD simulations using actuator lines with a fast turn-around noise prediction method. The flow field is simulated using actuator lines and large eddy simulations. The noise prediction method is based on the Amiet-Schlinker's theory for rotatory noise sources, considering leading- and trailing-edge noise as unique noise sources. A 2D panel code (XFOIL) calculates the sectional forces and boundary layer quantities. The resulting methodology for the noise prediction method is of high fidelity since the wind turbine geometry is accounted for in both flow and acoustics predictions. Results are compared with field measurements of a full-scale wind turbine for two operational conditions, validating the results of this research.
△ Less
Submitted 8 June, 2024;
originally announced June 2024.
-
Jump penalty stabilisation techniques for under-resolved turbulence in discontinuous Galerkin schemes
Authors:
Jiaqing Kou,
Oscar A. Marino,
Esteban Ferrer
Abstract:
Jump penalty stabilisation techniques have been recently proposed for continuous and discontinuous high order Galerkin schemes [1,2,3]. The stabilisation relies on the gradient or solution discontinuity at element interfaces to incorporate localised numerical diffusion in the numerical scheme. This diffusion acts as an implicit subgrid model and stablises under-resolved turbulent simulations.
Th…
▽ More
Jump penalty stabilisation techniques have been recently proposed for continuous and discontinuous high order Galerkin schemes [1,2,3]. The stabilisation relies on the gradient or solution discontinuity at element interfaces to incorporate localised numerical diffusion in the numerical scheme. This diffusion acts as an implicit subgrid model and stablises under-resolved turbulent simulations.
This paper investigates the effect of jump penalty stabilisation methods (penalising gradient or solution) for stabilisation and improvement of high-order discontinuous Galerkin schemes in turbulent regime. We analyse these schemes using an eigensolution analysis, a 1D non-linear Burgers equation (mimicking a turbulent cascade) and 3D turbulent Navier-Stokes simulations (Taylor-Green Vortex problem).
We show that the two jump penalty stabilisation techniques can stabilise under-resolved simulations thanks to the improved dispersion-dissipation characteristics (when compared to non-penalised schemes) and provide accurate results for turbulent flows. The numerical results indicate that the proposed jump penalty stabilise under-resolved simulations and improve the simulations, when compared to the original unpenalised scheme and to classic explicit subgrid models (Smagorisnky and Vreman).
△ Less
Submitted 24 August, 2022;
originally announced August 2022.
-
HORSES3D: a high-order discontinuous Galerkin solver for flow simulations and multi-physics applications
Authors:
E. Ferrer,
G. Rubio,
G. Ntoukas,
W. Laskowski,
O. A. Mariño,
S. Colombo,
A. Mateo-Gabín,
F. Manrique de Lara,
D. Huergo,
J. Manzanero,
A. M. Rueda-Ramírez,
D. A. Kopriva,
E. Valero
Abstract:
We present the latest developments of our High-Order Spectral Element Solver (HORSES3D), an open source high-order discontinuous Galerkin framework, capable of solving a variety of flow applications, including compressible flows (with or without shocks), incompressible flows, various RANS and LES turbulence models, particle dynamics, multiphase flows, and aeroacoustics. We provide an overview of t…
▽ More
We present the latest developments of our High-Order Spectral Element Solver (HORSES3D), an open source high-order discontinuous Galerkin framework, capable of solving a variety of flow applications, including compressible flows (with or without shocks), incompressible flows, various RANS and LES turbulence models, particle dynamics, multiphase flows, and aeroacoustics. We provide an overview of the high-order spatial discretisation (including energy/entropy stable schemes) and anisotropic p-adaptation capabilities. The solver is parallelised using MPI and OpenMP showing good scalability for up to 1000 processors. Temporal discretisations include explicit, implicit, multigrid, and dual time-stepping schemes with efficient preconditioners. Additionally, we facilitate meshing and simulating complex geometries through a mesh-free immersed boundary technique. We detail the available documentation and the test cases included in the GitHub repository.
△ Less
Submitted 20 June, 2022;
originally announced June 2022.
