论文标题

根I/O的HEP分析改进

ROOT I/O compression improvements for HEP analysis

论文作者

Shadura, Oksana, Bockelman, Brian Paul, Canal, Philippe, Piparo, Danilo, Zhang, Zhe

论文摘要

我们概述了根I/O系统的最新变化,提高了性能并提高其与其他数据分析生态系统的相互作用。新引入的压缩算法,更快的批量I/O数据路径以及一些其他技术都有可能显着提高实验软件性能。随着LHC时代收集,传输和存储的HEP数据量的大幅度增加,对无效数据压缩的需求已显着增长。虽然压缩可以减少存储空间,并可能降低I/O带宽使用情况,但不应盲目应用:在读取和编写文件的CPU成本增加与减少存储空间之间存在重大的权衡。

We overview recent changes in the ROOT I/O system, increasing performance and enhancing it and improving its interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly to improve experiment's software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased during the LHC era. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly: there are significant trade-offs between the increased CPU cost for reading and writing files and the reduce storage space.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源