GRAM: A GPU-Based Property Graph Traversal and Query for HPC Rich Metadata Management - Network and Parallel Computing
Conference Papers Year : 2018

GRAM: A GPU-Based Property Graph Traversal and Query for HPC Rich Metadata Management

Abstract

In HPC systems, rich metadata are defined to describe rich information about data files, like the executions that lead to the data files, the environment variables, and the parameters of all executions, etc. Recent studies have shown the feasibility of using property graph to model rich metadata and utilizing graph traversal to query rich metadata stored in the property graph. We propose to utilize GPU to process the rich metadata graphs. There are generally two challenges to utilize GPU for metadata graph query. First, there is no proper data representation for the metadata graph on GPU yet. Second, there is no optimization techniques specifically for metadata graph traversal on GPU neither. In order to tackle these challenges, we propose GRAM, a GPU-based property graph traversal and query framework. GRAM uses GPU to express metadata graph in Compressed Sparse Row (CSR) format, and uses Structure of Arrays (SoA) layout to store properties. In addition, we propose two new optimizations, parallel filtering and basic operations merging, to accelerate the metadata graph traversal. Our evaluation results show that GRAM can be effectively applied to user scenarios in HPC systems, and the performance of metadata management is greatly improved.
Fichier principal
Vignette du fichier
477597_1_En_7_Chapter.pdf (1.1 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02279550 , version 1 (05-09-2019)

Licence

Identifiers

Cite

Wenke Li, Xuanhua Shi, Hong Huang, Peng Zhao, Hai Jin, et al.. GRAM: A GPU-Based Property Graph Traversal and Query for HPC Rich Metadata Management. 15th IFIP International Conference on Network and Parallel Computing (NPC), Nov 2018, Muroran, Japan. pp.77-89, ⟨10.1007/978-3-030-05677-3_7⟩. ⟨hal-02279550⟩
84 View
111 Download

Altmetric

Share

More