In-Situ Visualization for Ultrascale Simulations

Speaker: Kwan-Liu Ma, UC at Davis
Authors: Kwan-Liu Ma, , Nathan Fout, Anna Tikhonova, Chaoli Wang , and Hongfeng Yu
University of California at Davis

The growing power of parallel supercomputers gives scientists the ability to simulate more complex problems at higher fidelity, leading to many high-impact scientific advances. To maximize the utilization of the vast amount of data generated by these simulations, scientists also need a scalable solution for studying their data to different extents and at different abstraction levels. As we move into petascale computing, simply dumping as much raw simulation data as the storage capacity allows for postprocessing analysis and visualization is no longer a viable approach. A common practice is to use a separate parallel computer to prepare data for subsequent analysis and visualization. A naive realization of this strategy not only limits the amount of data that can be saved, but also turns I/O into a performance bottleneck when using a large parallel system. We conjecture that the most plausible solution for the petascale data problem is to reduce or transform the data in-situ as it is being generated, so the amount of data that must be transferred over networks is kept to a minimum. In this paper, we discuss different approaches to in-situ data reduction and visualization, and present the results of our preliminary study using large-scale simulation codes on massively parallel supercomputers.