22nd International Conference on Interactive Information Processing Systems for Meteorology, Oceanography, and Hydrology


Ensemble Broker Service Oriented Architecture for LEAD

Jay Alameda, National Center for Supercomputing Applications, Champaign, IL; and S. Hampton, B. F. Jewett, A. Rossi, and R. B. Wilhelmson

We will be demonstrating a set of services designed to broker large number of computational jobs, as described in requirements for the Linked Environments for Atmospheric Discovery (LEAD) ITR project. This broker system, in particular, will have the ability to broker on-demand jobs of various urgency levels, through an on-demand service being developed in collaboration with Cluster Resources, Inc. The broker is designed to support the launching of a multiplicity of ensembles of workflows. An ensemble, for our purpose, is a collection of workflows; each workflow is comprised of nodes of a variety of flavors. These flavors could include remote invocations of our compute-node-local workflow engine, the Open Grid computing environments Runtime Engine (OGRE), a service invocation, or even a plain script. Within a workflow description, we can describe properties and constraints for example, we may want to place groups of nodes on the same computational resource, or a group of nodes (or workflows, or an ensemble) may need to be run in some on-demand fashion. We will be demonstrating early capabilities of the broker system by executing a subset of the full LEAD capabilities, as motivated by ensemble requirements from the atmospheric science community, on production NCSA and TeraGrid resources.

extended abstract  Extended Abstract (748K)

wrf recording  Recorded presentation

Session 10, Cyberinfrastructure, Internet and Grid Applications
Wednesday, 1 February 2006, 8:30 AM-12:30 PM, A412

Previous paper  Next paper

Browse or search entire meeting

AMS Home Page