DCODE: A Distributed Column-Oriented Database Engine for Big Data Analytics - Information and Communication Technology
Conference Papers Year : 2015

DCODE: A Distributed Column-Oriented Database Engine for Big Data Analytics

Yanchen Liu
  • Function : Author
  • PersonId : 1001300
Fang Cao
  • Function : Author
  • PersonId : 1001301
Masood Mortazavi
  • Function : Author
  • PersonId : 1001302
Mengmeng Chen
  • Function : Author
  • PersonId : 1001303
Ning Yan
  • Function : Author
  • PersonId : 1001304
Chi Ku
  • Function : Author
  • PersonId : 1001305
Aniket Adnaik
  • Function : Author
  • PersonId : 1001306
Stephen Morgan
  • Function : Author
  • PersonId : 1001307
Guangyu Shi
  • Function : Author
  • PersonId : 1001308
Yuhu Wang
  • Function : Author
  • PersonId : 1001309
Fan Fang
  • Function : Author
  • PersonId : 1001310

Abstract

We propose a novel Distributed Column-Oriented Database Engine (DCODE) for efficient analytic query processing that combines advantages of both column storage and parallel processing. In DCODE, we enhance an existing open-source columnar database engine by adding the capability for handling queries over a cluster. Specifically, we studied parallel query execution and optimization techniques such as horizontal partitioning, exchange operator allocation, query operator scheduling, operator push-down, and materialization strategies, etc. The experiments over the TPC-H dataset verified the effectiveness of our system.
Fichier principal
Vignette du fichier
978-3-319-24315-3_30_Chapter.pdf (337.44 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01466231 , version 1 (13-02-2017)

Licence

Identifiers

Cite

Yanchen Liu, Fang Cao, Masood Mortazavi, Mengmeng Chen, Ning Yan, et al.. DCODE: A Distributed Column-Oriented Database Engine for Big Data Analytics. 3rd International Conference on Information and Communication Technology-EurAsia (ICT-EURASIA) and 9th International Conference on Research and Practical Issues of Enterprise Information Systems (CONFENIS), Oct 2015, Daejon, South Korea. pp.289-299, ⟨10.1007/978-3-319-24315-3_30⟩. ⟨hal-01466231⟩
282 View
257 Download

Altmetric

Share

More