Ensembles in CHPS (XEFS)

XEFS Planning Meeting Minutes

10 September 2009

03 September 2009

20 August 2009

13 August 2009

23 July 2009

16 July 2009

18 June 2009

11 June 2009

04 June 2009

21 May 2009

14 May 2009

07 May 2009

30 April 2009

23 April 2009

16 April 2009

19 March 2009

12 March 2009

05 March 2009

19 February 2009

12 February 2009

05 February 2009

NEWS AND ACTIVITIES (in reverse chronological order)

April 2009

In January 2009, Mark Fresch took over as XEFS Project Area Leader (PAL) within HSEB. Soon after, XEFS Planning Meetings started being held nearly weekly among key partners, including Rob Hartman (CNRFC), Mary Mullusky (OCWWS/HSD), representatives from Deltares, and members of OHD's HSMB and HSEB. In addition, in late January and mid-March, we had a series of planning meetings with Deltares.

We have set a goal that by November 2009 to have the main XEFS components implemented so they are compatible with CHPS. The XEFS components will be prototypes (or non-baseline software). These components are a new Ensemble Preprocessor 3 (EPP3), Ensemble Postprocessor (EnsPost), Ensemble Verification System (EVS), and Hydrologic Model Output Statistics (HMOS). Each of these components will be available for field testing to RFCs that already have CHPS. After field testing, each of these components will undergo a second phase where the prototype is re-factored and will become part of the CHPS baseline. The baseline implementation of XEFS functionality and related software will be known as the Hydrologic Ensemble Forecast Service (HEFS).

The EPP3 prototype has been delivered in part (by HSMB), and two model adapters have been written as an interface with CHPS-FEWS. Testing of the EPP3 prototype and the two model adapters within FEWS is underway.

Also, by early Fall 2009, the first HEFS component, a Graphics Generator (formerly called the Ensemble Product Generator (or EPG)), will become part of the CHPS baseline. In the initial phase, the Graphics Generator will provide at least the same functionality as the existing Ensemble Stream-flow Prediction Analysis and Display Program (ESPADP). However, the Graphics Generator will be built on a FEWS framework. Graphics Generator requirements and design for this first phase are under review. A second phase of Graphics Generator development is planned to provide expanded ensemble and deterministic product generation and display control functionality. The second phase of Graphics Generator development will begin as soon as the first phase is completed.

October 2008

In August, OHD kicked off requirements gathering work for the Ensembles Product Generator (EPG), as defined in the XEFS Design & Gap Analysis report. The project leader is Hank Herr; his team includes representatives from OCWWS, OHD HSMB, CNRFC, CBRFC, and Deltares. Technical consultants will be added as needed. The team is in the process of defining product requirements for XEFS, and has begun by considering a range of products currently available in various RFC/regional web pages, reports, and presentations.

OHD hosted a visit in early September by Albrecht Weerts of Deltares; Albrecht is the Deltares focal point for ensembles in CHPS.

July 2008

HSMB now has access to a FEWS-based version of the XEFS prototype software.

The annual Hydrologic Ensemble Prediction Experiment (HEPEX) conference was held in Delft, Netherlands in June. Deltares continues to collaborate with the NWS on hydrologic ensembles.

Activities related to ensembles capabilities in CHPS are not scheduled to begin until CY 2009.

April 2008

Following Gary Carter’s approval of the CAT’s recommendation to proceed with FEWS as the software infrastructure for CHPS, planning activities to include an ensemble forecasting capability began in earnest. FEWS already contains the basic computational elements to generate a climatology-based ensemble; this feature was added to the CHPS pilot system in December 2007 and demonstrated at NCRFC. However, until the basic CHPS components are in place, work on the XEFS sub-system of CHPS must take a back seat for a while.

Meanwhile HSEB made good progress on porting HSMB HEP’s existing prototype software to the FEWS environment. Output from the classical climatology-based Ensemble Pre-Processor (EPP) and the Ensemble Post-Processor can now be successfully displayed via the FEWS time series viewer. HSEB hopes to provide HEP with a more complete version by early May as a first step towards transitioning the HSMB from its previous development environment to a more CHPS-compatible framework.

January 2008

On October 19 HSEB submitted a "High Level Analysis and Design" document to the XEFS Implementation Team for review. This document contained a proposed software design to meet the requirements specified in the XEFS Design and Gap Analysis Report (available at http://www.weather.gov/oh/rfcdev/docs/XEFS_design_gap_analysis_report_final.pdf).

In December HSEB held a meeting to address feedback received on the document. However the discussion prompted a re-think of the implementation strategy, which – until that point - had been to develop a solution based on CHPS concepts but independently of FEWS.

Since it was becoming clear that FEWS would be the solution of choice for CHPS the XEFS Execution Manager, in consultation with the XEFS Oversight Group and numerous other subject matter experts, determined that the XEFS software design should be based entirely on FEWS. This is the most cost effective and least risky path to take.

[Back To Top]

October 2007

HSEB spent most of this quarter conducting an in-depth analysis of existing prototype software that is related to experimental hydrologic ensembles. That analysis, along with an examination of requirements captured in the XEFS Design and Gap Analysis Report (available at http://www.weather.gov/oh/rfcdev/docs/XEFS_design_gap_analysis_report_final.pdf), forms the basis of a high level software design for the XEFS. With the design in place, the XEFS Execution Manager is in the process of putting together a preliminary implementation plan, and specifying cross-functional team composition. An XEFS implementation kick-off meeting is expected in October.

The XEFS Execution Manager announced a one-month slip in the schedule, due to some AWIPS OB9 work which has impacted key XEFS resources.

July 2007

In May the XEFS Design and Gap Analysis Team, led by DJ Seo (HSMB) and Rob Hartman (CNRFC) presented to the Director of OHD, Gary Carter, a report entitled "The Experimental Ensemble Forecast System (XEFS) Design and Gap Analysis: Report of the XEFS Design and Gap Analysis Team", dated May 11, 2007. The report is available on the web at: http://www.weather.gov/oh/rfcdev/docs/XEFS_design_gap_analysis_report_final.pdf. This report provides a summary of current prototype Ensembles functionality developed by HSMB, and an identification of functionality that will be required to introduce an initial (experimental) short-to-long term Ensembles capability into RFC operations. Incremental enhancements to the XEFS will ultimately result in a fully operational Hydrologic Ensemble Forecast System (HEFS).

Gary Carter accepted the findings in the report and subsequently tasked HSEB with formulating an execution plan. Chris Dietz (HSEB) has been assigned as the XEFS Execution Manager, supported by an Oversight Committee whose members include DJ Seo, Chris Dietz, Rob Hartman, and Mary Mullusky (OCWWS).

HSEB has now formed a 4-person software engineering team (the final member will arrive on July 9) and has begun an in-depth analysis of the prototype software. The software architect, Sudha Rangan, has begun the process of formulating a design consistent with CHPS. A draft implementation plan is expected by the end of August 2007.

[Back To Top]

[Back to main CHPS web page]