Using SciDB to Support Photon Science Data Analysis

[摘要] Array data analytic systems like SciDB hold great potential to accelerate processing data from SLAC's Linac Coherent Light Source and other experiments. SciDB is unique in its ability to integrate storage and processing of array data efficiently, providing both space-efficient storage and out-of-memory efficient parallel array processing. We describe a recent effort to leverage SciDB to store and process LCLS data. The work includes development of software to import data into SciDB, subsequent benchmarks, and interactive manipulation of data in SciDB.

[发布日期] 2012-02-15

[学科分类] 核物理和高能物理

[关键词] BENCHMARKS;COMPUTER CODES;DATA ANALYSIS;DATA BASE MANAGEMENT;DATA PROCESSING;LIGHT SOURCES;STANFORD LINEAR ACCELERATOR CENTER;PHOTONS;STORAGE Computing;COMP