STORM
STORM is services-based middleware produced by The Department of Biomedical Informatics, Multiscale Computing Laboratory at The Ohio State University. STORM is designed to support data select and transfer operations on large scientific datasets in a Grid or clustered computing environment.
The objective of STORM is to enable execution of SQL-like SELECT queries on datasets stored in files distributed across a network. STORM provides support for:
- Selection of the data of interest. The data of interest is selected based on either the values of particular attributes or ranges of attribute values (i.e., range queries). The selection operation can also involve user-defined filtering operations.
- Transfer of data from storage nodes to compute nodes for processing. If the client program runs on a parallel machine, STORM supports application-specific partitioning and parallel transfer of data elements to the destination processors.
STORM is implemented using DataCutter.
STORM is based upon work supported by the National Science Foundation under Grant No. 0330612. The development of STORM is also funded in part by the NSF NMI program, the NIH BISTI program, NPACI, and the State of Ohio BRTT program. STORM has been used in several applications, including analysis of datasets from oil reservoir simulations and datasets generated by Seismic simulations.
Project Researchers
Umit Catalyurek, Ph.D.
Tahsin Kurc, Ph.D.
Sivaramakrishnan Narayanan
Joel Saltz, M.D., Ph.D.
Project Funding Participation
Grid DB-Lite: Database Support for Data-Driven Scientific Applications in the Grid
Project Publications
Publications |
Benjamin Rutt, Umit V. Catalyurek, Aram Hakobyan, Kyle Metzroth, Tunc Aldemir, Richard Denning, Sean Dunagan, David Kunsman, "Distributed Dynamic Event Tree Generation for Reliability and Risk Assessment", Proceedings of the International Workshop on Challenges of Large Applications in Distributed Environments (CLADE'06), 2006: pp. 61-70. |
Xi Zhang, Tahsin M. Kurc, Joel H. Saltz, "Design and Analysis of a Multi-dimensional Data Sampling Service for Large Scale Data Analysis Applications", 20th IEEE International Parallel & Distributed Processing Symposium (IPDPS), 2006: pp. 58. |
Sivaramakrishnan Narayanan, Tahsin M. Kurc, Umit V. Catalyurek, Joel H. Saltz, "Servicing Seismic and Oil Reservoir Simulation Data", 2005. |
Manish Parashar, Vincent Matossian, Wolfgang Bangerth, Hector Klie, Benjamin Rutt, Tahsin M. Kurc, Umit V. Catalyurek, Joel H. Saltz, Mary F. Wheeler, "Towards Dynamic Data-Driven Optimization of Oil Well Placement", Lecture Notes in Computer Science, 2005: pp. 656-663. |
Sivaramakrishnan Narayanan, Umit V. Catalyurek, Tahsin M. Kurc, Xi Zhang, Joel H. Saltz, "Applying Database Support for Large Scale Data Driven Science in Distributed Environments", Proceedings of the Fourth International Workshop on Grid Computing (Grid 2003), 2003: pp. 141-148. |
Sivaramakrishnan Narayanan, Tahsin M. Kurc, Umit V. Catalyurek, Joel H. Saltz, "Database Support for Data-Driven Scientific Applications in the Grid", Parallel Processing Letters, 2003: pp. 245-271. |
Presentations |
Benjamin Rutt, "Work in Progress - HPC - Benjamin Rutt", Presented: 2006-07-06 |
Benjamin Rutt, Tahsin M. Kurc, Umit V. Catalyurek, Joel H. Saltz, "Use of the Teragrid for Sub-surface Modeling and Oil Reservoir Management Studies", Teragrid 2006, Indianapolis, IN, Presented: 2006-06-13 |
Sivaramakrishnan Narayanan, Tahsin M. Kurc, Umit V. Catalyurek, Joel H. Saltz, "Servicing Seismic and Oil Reservoir Simulation Data through Grid Data Services", Very Large Databases (VLDB) Workshop on Data Management in Grids, Trondheim, Norway, Presented: 2005-09-02 |
Umit V. Catalyurek, "STORM (Overview)", First DIALOGUE Workshop: Applications-Driven Issues in Data Grids, Columbus, OH, Presented: 2005-08-02 |
Umit V. Catalyurek, "Supporting Large Scale Data Driven Science in Distributed Environments", Minisymposium on Distributed Data Management Infrastructures for Scalable Computational Science and Engineering Applications, SIAM Conference on Computational Science and Engineering (SIAM CSE '05), Orlando, FL, Presented: 2005-02-13 |
Tech Reports |
Sivaramakrishnan Narayanan, Tahsin M. Kurc, Joel H. Saltz, "DBOWL: Towards Extensional Queries on a Billion Statements using Relational Databases", Issued: 2006-11-21 |
Tahsin M. Kurc, "GridDB-Lite: Database Support for Data-Driven Scientific Applications in the Grid", Issued: 2005-01-01 |
Sivaramakrishnan Narayanan, Tahsin M. Kurc, Umit V. Catalyurek, Joel H. Saltz, "Database Support for Data-driven Scientific Applications in the Grid", Issued: 2002-12-01 |
Abstracts |
Tahsin M. Kurc, Wolfgang Bangerth, Hector Klie, Mrinal Sen, Paul L. Stoffa, Mary F. Wheeler, Umit V. Catalyurek, Benjamin Rutt, Joel H. Saltz, Manish Parashar, "‘Where is my oil, dude?’ Supporting Dynamic, Data-Driven Oil Reservoir Simulation Studies on the Grid", (2004-11-06 to 2004-11-12), Pittsburgh |