Ensemble hydrometeorological forecasting has great potential for improving flood predictions and use in water management systems, however, the amount of data used and created with an ensemble forecast requires a careful and intentional approach to understand how useful and skillful the forecast is. The NOAA National Water Model (NWM) was run using downscaled NOAA Global Ensemble Forecast System (GEFS) meteorological forcings for the 2016-2017 wet season (October-March) in California to create an 11-member hydrologic forecast ensemble. To evaluate the performance of these ensemble forecasts, we chose to study streamflow sites within Sonoma County, California, a rain-dominated region which includes the Russian, Navarro, and Napa Valley River basins. The uncertainty in the downscaled GEFS precipitation and the NWM forced with the downscaled GEFS meteorological inputs was compared to deterministic North American Land Assimilation System (NLDAS) precipitation and a NLDAS-forced NWM run. For the purpose of our analysis, we verified the 5-day forecast lead time. The NLDAS and NLDAS forced-NWM was compared to precipitation and streamflow observations and found to be adequate for comparison purposes. The analysis included seasonal statistics and event-based performance characterization as a way to assess the skill in a statistically rigorous way, as well as provide insight into individual events that caused hydrologic impacts. Ensemble performance was evaluated using a “percent coverage” framework, defined as the percentage of time the observation falls within the middle 80% of the ensemble forecast. The percent coverage for the precipitation was consistently better than that of the streamflow. Rank histograms were created to characterize the ensemble distribution and its relationship to both NLDAS and the NLDAS-driven NWM. The rank histograms showed that the ensemble spread of the precipitation was fairly consistent and reliable, but showed a clear trend of overestimation (positive bias) in the streamflow forecasts. Correlations were made for several metrics to relate precipitation to streamflow, which showed that the changes in spread were well correlated, but the biases of the ensemble were not. The results indicate overall that the NWM may benefit from further evaluation and correction of biases, as well as a better understanding of how errors and uncertainties from meteorological forcings affect hydrologic model skill and ensemble spread.
","abstract_html":"<p>Ensemble hydrometeorological forecasting has great potential for improving flood predictions and use in water management systems, however, the amount of data used and created with an ensemble forecast requires a careful and intentional approach to understand how useful and skillful the forecast is. The NOAA National Water Model (NWM) was run using downscaled NOAA Global Ensemble Forecast System (GEFS) meteorological forcings for the 2016-2017 wet season (October-March) in California to create an 11-member hydrologic forecast ensemble. To evaluate the performance of these ensemble forecasts, we chose to study streamflow sites within Sonoma County, California, a rain-dominated region which includes the Russian, Navarro, and Napa Valley River basins. The uncertainty in the downscaled GEFS precipitation and the NWM forced with the downscaled GEFS meteorological inputs was compared to deterministic North American Land Assimilation System (NLDAS) precipitation and a NLDAS-forced NWM run. For the purpose of our analysis, we verified the 5-day forecast lead time. The NLDAS and NLDAS forced-NWM was compared to precipitation and streamflow observations and found to be adequate for comparison purposes. The analysis included seasonal statistics and event-based performance characterization as a way to assess the skill in a statistically rigorous way, as well as provide insight into individual events that caused hydrologic impacts. Ensemble performance was evaluated using a “percent coverage” framework, defined as the percentage of time the observation falls within the middle 80% of the ensemble forecast. The percent coverage for the precipitation was consistently better than that of the streamflow. Rank histograms were created to characterize the ensemble distribution and its relationship to both NLDAS and the NLDAS-driven NWM. The rank histograms showed that the ensemble spread of the precipitation was fairly consistent and reliable, but showed a clear trend of overestimation (positive bias) in the streamflow forecasts. Correlations were made for several metrics to relate precipitation to streamflow, which showed that the changes in spread were well correlated, but the biases of the ensemble were not. The results indicate overall that the NWM may benefit from further evaluation and correction of biases, as well as a better understanding of how errors and uncertainties from meteorological forcings affect hydrologic model skill and ensemble spread.</p>","abstract_has_math":false,"creators":["Mossel, Carolien N"],"institution":null,"degree_name":"Master of Science (M.S.)","degree_level":"Thesis","degree_discipline":"Earth and Atmospheric Sciences","degree_department":null,"school":null,"contributors":["James Booth","Naresh Devineni"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2021,"date_issued":"2021-01-01T08:00:00Z","date_published":"2021-01-01T08:00:00Z","updated_at":"2026-07-24T01:57:53Z","subjects":["ensemble","hydrometeorological","forecast","rank histograms","hydrology","precipitation","national water model","california","Atmospheric Sciences","Water Resource Management"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[]},"links":{"outbound_url":"https://academicworks.cuny.edu/cc_etds_theses/979","outbound_label":"Repository record","outbound_source":"dc:identifier"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["James Booth","Naresh Devineni"]},{"key":"dc:creator","label":"Author","values":["Mossel, Carolien N"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2021-12-17T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Earth and Atmospheric Sciences"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Thesis"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science (M.S.)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["ensemble","hydrometeorological","forecast","rank histograms","hydrology","precipitation","national water model","california","Atmospheric Sciences","Water Resource Management"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://academicworks.cuny.edu/cc_etds_theses/979"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["Ensemble hydrometeorological forecasting has great potential for improving flood predictions and use in water management systems, however, the amount of data used and created with an ensemble forecast requires a careful and intentional approach to understand how useful and skillful the forecast is. The NOAA National Water Model (NWM) was run using downscaled NOAA Global Ensemble Forecast System (GEFS) meteorological forcings for the 2016-2017 wet season (October-March) in California to create an 11-member hydrologic forecast ensemble. To evaluate the performance of these ensemble forecasts, we chose to study streamflow sites within Sonoma County, California, a rain-dominated region which includes the Russian, Navarro, and Napa Valley River basins. The uncertainty in the downscaled GEFS precipitation and the NWM forced with the downscaled GEFS meteorological inputs was compared to deterministic North American Land Assimilation System (NLDAS) precipitation and a NLDAS-forced NWM run. For the purpose of our analysis, we verified the 5-day forecast lead time. The NLDAS and NLDAS forced-NWM was compared to precipitation and streamflow observations and found to be adequate for comparison purposes. The analysis included seasonal statistics and event-based performance characterization as a way to assess the skill in a statistically rigorous way, as well as provide insight into individual events that caused hydrologic impacts. Ensemble performance was evaluated using a “percent coverage” framework, defined as the percentage of time the observation falls within the middle 80% of the ensemble forecast. The percent coverage for the precipitation was consistently better than that of the streamflow. Rank histograms were created to characterize the ensemble distribution and its relationship to both NLDAS and the NLDAS-driven NWM. The rank histograms showed that the ensemble spread of the precipitation was fairly consistent and reliable, but showed a clear trend of overestimation (positive bias) in the streamflow forecasts. Correlations were made for several metrics to relate precipitation to streamflow, which showed that the changes in spread were well correlated, but the biases of the ensemble were not. The results indicate overall that the NWM may benefit from further evaluation and correction of biases, as well as a better understanding of how errors and uncertainties from meteorological forcings affect hydrologic model skill and ensemble spread.
"]},{"key":"dc:title","label":"Title","values":["Analysis of uncertainty in hydrometeorological ensemble forecasts"]}]}],"canonical_facts":{"dc:contributor":["James Booth","Naresh Devineni"],"dc:creator":["Mossel, Carolien N"],"dc:date.available":["2021-12-17T08:00:00Z"],"dc:description.abstract":["Ensemble hydrometeorological forecasting has great potential for improving flood predictions and use in water management systems, however, the amount of data used and created with an ensemble forecast requires a careful and intentional approach to understand how useful and skillful the forecast is. The NOAA National Water Model (NWM) was run using downscaled NOAA Global Ensemble Forecast System (GEFS) meteorological forcings for the 2016-2017 wet season (October-March) in California to create an 11-member hydrologic forecast ensemble. To evaluate the performance of these ensemble forecasts, we chose to study streamflow sites within Sonoma County, California, a rain-dominated region which includes the Russian, Navarro, and Napa Valley River basins. The uncertainty in the downscaled GEFS precipitation and the NWM forced with the downscaled GEFS meteorological inputs was compared to deterministic North American Land Assimilation System (NLDAS) precipitation and a NLDAS-forced NWM run. For the purpose of our analysis, we verified the 5-day forecast lead time. The NLDAS and NLDAS forced-NWM was compared to precipitation and streamflow observations and found to be adequate for comparison purposes. The analysis included seasonal statistics and event-based performance characterization as a way to assess the skill in a statistically rigorous way, as well as provide insight into individual events that caused hydrologic impacts. Ensemble performance was evaluated using a “percent coverage” framework, defined as the percentage of time the observation falls within the middle 80% of the ensemble forecast. The percent coverage for the precipitation was consistently better than that of the streamflow. Rank histograms were created to characterize the ensemble distribution and its relationship to both NLDAS and the NLDAS-driven NWM. The rank histograms showed that the ensemble spread of the precipitation was fairly consistent and reliable, but showed a clear trend of overestimation (positive bias) in the streamflow forecasts. Correlations were made for several metrics to relate precipitation to streamflow, which showed that the changes in spread were well correlated, but the biases of the ensemble were not. The results indicate overall that the NWM may benefit from further evaluation and correction of biases, as well as a better understanding of how errors and uncertainties from meteorological forcings affect hydrologic model skill and ensemble spread.
"],"dc:identifier":["https://academicworks.cuny.edu/cc_etds_theses/979"],"dc:subject":["ensemble","hydrometeorological","forecast","rank histograms","hydrology","precipitation","national water model","california","Atmospheric Sciences","Water Resource Management"],"dc:title":["Analysis of uncertainty in hydrometeorological ensemble forecasts"],"thesis:degree_discipline":["Earth and Atmospheric Sciences"],"thesis:degree_level":["Thesis"],"thesis:degree_name":["Master of Science (M.S.)"]},"updated_at":"2026-07-24T01:57:53Z"}