Enabling Multiscale Simulations of Atmospheric Flow over Complex Terrain in Earth System Models

Katherine Lundquist (14-ERD-024)

Abstract

Work performed during this project improved the multiscale and high-resolution modeling capabilities of the widely used Weather Research and Forecasting model. Model improvements extended the capabilities of the model, allowing for high-resolution simulations of atmospheric flow over complex terrain, which were previously impossible. Our research generated comparisons of simulation results to observations from the Bolund, MATERHORN, and Terrain-Induced Rotor experiments, all field campaigns focused on understanding complex atmospheric flows. Additionally, improvements were made to the multiscale modeling capabilities of the Weather Research and Forecasting model through the development of a more flexible approach to computational gridding. These model developments collectively improve the accuracy of the atmospheric simulations and allow the model to be applied at high-resolutions previously prohibited by model limitations. This work has been applied to several important problems, such as those in wind energy and atmospheric transport and dispersion.

Background and Research Objectives

High-resolution simulations of atmospheric flow are important for the Laboratory's mission in areas including energy security (wind, hydropower, grid capacity, etc.) and atmospheric transport and dispersion. Achieving accurate high-resolution simulations of atmospheric flow requires a multiscale approach in which a large range of scales is simulated and information from regional weather patterns is downscaled to high-resolution simulations of local atmospheric flow. Current atmospheric models suffer from limitations that prevent accurate multiscale simulation of the atmosphere. This project focused on model development, and improving multiscale atmospheric simulations.

Scientific Approach and Accomplishments

Work for this project focused on improving multiscale atmospheric simulations through two scientific developments. The first is developing atmospheric models originally designed for weather forecasting to more accurately simulate smaller local scales. The second is developing a framework that effectively passes information between scales (i.e., from larger weather scales to smaller local scales). Model developments to address these two issues were completed during this project, through improvements to the Weather Research and Forecasting model. This model is a widely used weather forecasting model made publically available by the National Center for Atmospheric Research. Where appropriate, model developments from this LDRD were contributed back to the public Weather Research and Forecasting repository at the center.

This work resulted in one published peer-reviewed manuscript, another manuscript in review, and two manuscripts in the final stages of preparation. Two additional conference papers will be submitted after additional work and preparation. This project additionally resulted in 3 conference papers, 6 conference posters, and 17 conference presentations, including an invited talk.

The scientific approach to improving atmospheric simulations at high-resolutions (i.e., local scales) is the implementation and use of an immersed boundary method. Current weather forecasting models commonly use terrain-following coordinates, which become skewed at high-resolutions over complex terrain, resulting in large numerical errors. The immersed boundary method is a nonconforming gridding method, which eliminates the need for terrain-following coordinates, and thus eliminates the numerical errors associated with conforming grids. Use of the immersed boundary method results in more accurate high-resolution simulations, as well as the ability to produce high-resolution simulations previously impossible using terrain-following coordinates because of the complexity of the terrain. The immersed boundary method had been implemented in the model previous to this project, but the implementation was not general and its use was limited to idealized cases. As part of this work, we eliminated several model limitations, greatly generalizing the model.

A major change included modifying the boundary condition used at the immersed boundary. Previously, a no-slip boundary condition was implemented, which is generally appropriate for engineering-type flows with very high resolution (i.e., wall-resolved). The no-slip boundary condition, however, is not the appropriate boundary condition for atmospheric simulations, which are by necessity less resolved. A new boundary condition using a wall model to parameterize the effects of unresolved near-wall surface stresses was implemented, and is referred to here as the “velocity reconstruction” method or boundary condition. The effects of this new boundary condition were assessed through comparisons of simulation results to field observations, and the new boundary condition was shown to improve simulation results.

Figure 1 shows a simulation of the Bolund Experiment, the field campaign chosen for evaluation of the new immersed boundary condition. This field campaign consisted of measurements over a small isolated landform, which includes a steep cliff-like western edge, and is surrounded by water. Flow in this simulation is from the southwest direction.

Figure 5. contours of the vertical velocity w (ms<sup>-1</sup>) for the simulation of flow over owens valley, ca in an x–z slice at the center of domain 2 (shown above). panel (a) uses a horizontal nesting only with a coarse vertical grid. panel (b) uses horizontal and vertical nesting. panel (c) uses horizontal nesting only with a fine vertical grid. panel (d) uses an interpolation post-processing program called ndown to increase vertical resolution.   (figure from daniels et al., 2016).

Figure 1. Shown is a high-resolution simulation over the topography of Bolund Hill from the Bolund Experiment. Color contours are shown for instantaneous values of U velocity and topography contours are shown in black.

Simulation results are compared to observations in Figure 2, which shows the speed-up ratio, velocity normalized by the upstream velocity, at 2 and 5 m above the ground level as the flow passes over the topography. Although it is not obvious from Figure 2 because the depiction of normalized velocities, the new boundary condition improved comparisons against observations significantly, reducing model error by as much as 50%, including errors in the upstream flow condition. The new boundary condition also improved the representation of separated flow on the lee side of the hill, which is notoriously difficult to simulate correctly.

Figure 4. computational grids illustrating vertical grid nesting, a feature that enables improved multiscale modeling. nesting in the horizontal only is used with a coarse vertical grid (top). horizontal and vertical nesting are used (middle). horizontal nesting only is used with a fine vertical grid (bottom). this set of grids allowed validation and evaluation of our new vertical nesting feature. (figure from daniels et al., 2016).


Figure 2. Speed-up ratio at heights of 5 m (top) and 2 m (middle) above ground level are shown for the no-slip boundary condition (black line) and the new “velocity reconstruction” method (blue line). Observations for the two heights are shown as red circles. A profile of the Bolund topography is shown in blue (bottom).

Additionally, weather forecasting models include parameterized models for physical processes such as radiation, microphysics, and surface energy budgets. Several of these physics parameterizations were modified to work with the immersed boundary method. Inclusion of these physical processes allows for realistic atmospheric simulations beyond what typical computational fluid mechanics codes can achieve. Simulations shown in Figure 3, which are very high-resolution simulations over complex terrain including atmospheric physics, are the first of their kind.

The inclusion of atmospheric processes was validated through simulation of an intense observation period from the MATERHORN field campaign and comparison to the observations. This field campaign took place at Dugway Proving Grounds in Utah at Granite Mountain. Figure 3 shows a west-looking view of the MATERHORN topography along with blue isocontours of downslope flow. Topographic shading was one physical process coupled to the immersed boundary, and shaded ground surfaces are shown as such in Figure 3. This is a simulation of the evening transition, when the sun sets to the west, and east-facing slopes of the mountain become shaded. Topographic shading cools the terrain surface and the near-surface atmosphere, leading the air to become denser, and to the down-slope flows simulated here.


Figure 3. view of downslope flow on the east side of granite mountain during the evening transition. blue isosurfaces are shown for downslope velocity. the locations of observational towers are shown as green dots. (figure from arthur et al., 2016).
Figure 3. View of downslope flow on the east side of Granite Mountain during the evening transition. Blue isosurfaces are shown for downslope velocity. The locations of observational towers are shown as green dots. (Figure from Arthur et al., 2016).

Use of the immersed boundary method and atmospheric physics models greatly enhanced our ability to simulate atmospheric flows at local scales. These flows, however, interact with larger atmospheric scales, and therefore it is necessary to improve the framework in the model for multiscale modeling. The model uses grid nesting, shown in Figure 4, which allows for grid refinement in geographic regions of interest. Figure 4 shows a typical two-domain set-up, where the finer inner domain is shown interior to the coarser outer domain appearing on either side.

Historically, grid refinement was limited to the horizontal dimensions in the Weather Research and Forecasting model, and a common vertical grid was used on all of the domains. As multiscale modeling has emerged, so has the need for vertical refinement between domains or grids. As part of this project, a vertical grid nesting capability was implemented and validated for the Weather Research and Forecasting model. This feature has been added to the public release of the code, and has found users both within and outside of the DOE. Figure 4 depicts three computational grid set-ups used to test our vertical nesting capability. The top and bottom grids are control cases, which do not use vertical nesting (i.e., the vertical grid is common between the outer and inner domains), but have coarse and fine vertical grid spacing, respectively. The middle computational grid has refinement in both the horizontal and vertical dimensions.

Figure 2. speed-up ratio at heights of 5 m (top) and 2 m (middle) above ground level are shown for the no-slip boundary condition (black line) and the new “velocity reconstruction” method (blue line). observations for the two heights are shown as red circles. a profile of the bolund topography is shown in blue (bottom).
Figure 4. Computational grids illustrating vertical grid nesting, a feature that enables improved multiscale modeling. Nesting in the horizontal only is used with a coarse vertical grid (top). Horizontal and vertical nesting are used (middle). Horizontal nesting only is used with a fine vertical grid (bottom). This set of grids allowed validation and evaluation of our new vertical nesting feature. (Figure from Daniels et al., 2016).

The vertical grid nesting feature was tested by using the grid set-ups shown in Figure 4 and comparing model results with vertical nesting against control simulations. Validation cases were published for both high-resolution large-eddy simulations and coarser mesoscale simulations.

In our mesoscale test cases, shown in Figure 5, comparisons against observations were made for the Terrain-Induced Rotor Experiment, a field experiment that took place in the Owens Valley of California, located between the Sierra Nevada and Inyo mountain ranges. Vertical grid nesting validated well, as shown in Figure 5 for flow over the Owens Valley, and was shown to improve the multiscale modeling capabilities of the Weather Research and Forecasting model by reducing model error through domain-specific grid optimization.

Figure 1. shown is a high-resolution simulation over the topography of bolund hill from the bolund experiment. color contours are shown for instantaneous values of u velocity and topography contours are shown in black.

Figure 5. Contours of the vertical velocity W (ms-1) for the simulation of flow over Owens Valley, CA in an x–z slice at the center of domain 2 (shown above). Panel (a) uses a horizontal nesting only with a coarse vertical grid. Panel (b) uses horizontal and vertical nesting. Panel (c) uses horizontal nesting only with a fine vertical grid. Panel (d) uses an interpolation post-processing program called ndown to increase vertical resolution. (Figure from Daniels et al., 2016).

Impact on Mission

High-resolution simulations of atmospheric flow are critical for multiple program areas including wind energy, assessments of hazardous releases by the National Atmospheric Release Advisory Center, and intelligence assessments. This project improved the Laboratory’s capabilities for simulating atmospheric flow, especially over complex terrain, using the Weather Research and Forecasting model. Several projects will follow directly or benefit significantly from the outcomes of this LDRD. First, the Laboratory wind program has received funding from the U.S. DOE Office of Energy Efficiency and Renewable Energy to continue development of the Weather Research and Forecasting model for improved multiscale atmospheric simulation. This funding is a direct outcome of scientific progress enabled by this LDRD, and includes follow-on work to that accomplished with our project. Second, the National Atmospheric Release Advisory Center received funding for atmospheric modeling on the Low Yield Nuclear Explosion Monitoring project, partially based on our capabilities and expertise in modeling flow over complex terrain. Third, as the center continues to integrate the model more fully into research and operations, the center’s customers benefit from improved atmospheric modeling capabilities. The center’s products range from forecasting for hazardous atmospheric releases to inverse modeling for source attribution. Three hires resulted from this LDRD, including two post-doctoral researchers and a Lawrence Scholar (formerly a graduate student subcontractor on this project).

Conclusion

Improvements for multiscale and high-resolution modeling were made to the Weather Research and Forecasting model during this LDRD. These improvements focused on enabling and improving large-eddy simulations, where resolution is adequate for partially resolving turbulence. The FY17 funding from the Office of Energy Efficiency and Renewable Energy Wind Office focuses on extending these model improvements to coarser simulations where turbulence is fully modeled, rather than resolved. Coarser simulations demand fewer computational resources, and are used operationally by weather forecasters and wind energy companies.

Our Research was highly collaborative with the University of California, Berkeley. This collaboration will continue through several avenues. One route for collaboration will be through the Laboratory hiring a University of California, Berkeley graduate student (a subcontractor on this project) as a Lawrence Scholar. He will continue to focus his research on developing methods for passing information between scales, and thus improving multiscale modeling, in the Weather Research and Forecasting model. A second University of California, Berkeley student will work at Livermore as a subcontractor for our wind program in FY17.

Publications and Presentations

  • Arthur, R., et al., High-resolution simulations of downslope flows over complex terrain using WRF-IBM. 17th Conf. Mountain Meteorology, American Meteorological Society, Burlington, VT, June 27–July 1, 2016. LLNL-CONF-704141.
  • Bao, J., K. A. Lundquist, and F. K. Chow, Comparison of different implementations of the immersed boundary method in WRF (WRF-IBM). 22nd Symp. Boundary Layers and Turbulence, American Meteorological Society, Salt Lake City, UT, June 20–24, 2016. LLNL-CONF-704142.
  • Daniels, M. H., et al., “A new vertical grid nesting capability in the Weather Research and Forecasting (WRF) Model.” Mon. Weather Rev. 144 (2016). LLNL-JRNL-681237. http://dx.doi.org/10.1175/MWR-D-16-0049.1
  • Wiersema, D. J. , K. A. Lundquist, and F. K. Chow, A framework for WRF to WRF-IBM grid nesting to enable multiscale simulations. (2016). LLNL-TR-704084.