PlumX Metrics
Embed PlumX Metrics

HBase/Phoenix-based Data Collection and Storage for the ATLAS EventIndex

EPJ Web of Conferences, ISSN: 2100-014X, Vol: 295
2024
  • 0
    Citations
  • 0
    Usage
  • 0
    Captures
  • 1
    Mentions
  • 0
    Social Media
Metric Options:   Counts1 Year3 Year

Metrics Details

  • Mentions
    1
    • News Mentions
      1
      • 1

Most Recent News

University of Valencia Researchers Provide New Data on Data Acquisition (HBase/Phoenix-based Data Collection and Storage for the ATLAS EventIndex)

2024 MAY 30 (NewsRx) -- By a News Reporter-Staff News Editor at Information Technology Daily -- Data detailed on data acquisition have been presented. According

Conference Paper Description

The ATLAS EventIndex is the global catalogue of all ATLAS real and simulated events. During the LHC long shutdown between Run 2 (2015-2018) and Run 3 (2022-2025) its components were substantially revised, and a new system was deployed for the start of Run 3 in Spring 2022. The new core storage system is based on HBase tables with a Phoenix interface. It allows faster data ingestion rates and scales better than the old system. This paper describes the data collection, the technical design of the core storage, and the properties that make it fast and efficient, namely the compact and optimized design of the events table, which already holds more than 400 billion entries, and all the auxiliary tables, and the EventIndex Supervisor, in charge of orchestrating the whole data collection, now simplified thanks to the Loaders, the Spark jobs that load the data into the new core system. The extractors, in charge of preparing the pieces of data that the loaders will put into the final back-end, have been updated too. The data migration from HDFS to HBase and Phoenix is also described.

Bibliographic Details

Carlos García Montoro; Javier Sánchez; Dario Barberis; Santiago González de la Hoz; Jose Salt; R. De Vita; X. Espinal; P. Laycock; O. Shadura

EDP Sciences

Physics and Astronomy

Provide Feedback

Have ideas for a new metric? Would you like to see something else here?Let us know