Accelerating Scientific Analysis with SciDB

[摘要] SciDB is an open-source analytical database for scalable complex analytics on very large array or multi-structured data from a variety of sources, programmable from Python and R. It runs on HPC, commodity hardware grids, or in a cloud and can manage and analyze terabytes of array-structured data and do complex analytics in-database. We present an overall description of the SciDB framework and describe its implementation at NERSC at Lawrence Berkeley National Laboratory. A case study using SciDB to analyze data from the LUX dark matter detector is described and future plans for a large SciDB array at NERSC are described.

[发布机构] Lawrence Berkeley National Laboratory, 1 Cyclotron Road Mailstop, Berkeley; CA; 94720, United States^1

[效力级别] 计算机科学 [学科分类] 计算机科学（综合）

[关键词] Analytical database;Commodity hardware;Dark matter detectors;Lawrence Berkeley National Laboratory;Open sources;Scientific analysis;Structured data;Very large arrays