Portable Intermediate Representation for Efficient Big Data Analytics - Distributed Applications and Interoperable Systems
Conference Papers Year : 2021

Portable Intermediate Representation for Efficient Big Data Analytics

Giannis Tzouros
  • Function : Author
  • PersonId : 1098447
Michail Tsenos
  • Function : Author
  • PersonId : 1113976
Vana Kalogeraki
  • Function : Author
  • PersonId : 998192

Abstract

To process big data, applications have been utilizing data processing libraries over the last years, which are however not optimized to work together for efficient processing. Intermediate Representations (IR) have been introduced for unifying essential functions into an abstract interface that supports cross-optimization between applications. Still, the efficiency of an IR depends on the architecture and the tools required for compilation and execution. In this paper, we present a first glance at a framework that provides an IR by creating containers with executable code from structures of data analytics functions, described in an input grammar. These containers process data in query lists and they can be executed either standalone or integrated with other big data analytics applications without the need to compile the entire framework.
Fichier principal
Vignette du fichier
509420_1_En_5_Chapter.pdf (201.6 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03384860 , version 1 (19-10-2021)

Licence

Identifiers

Cite

Giannis Tzouros, Michail Tsenos, Vana Kalogeraki. Portable Intermediate Representation for Efficient Big Data Analytics. 21th IFIP International Conference on Distributed Applications and Interoperable Systems (DAIS), Jun 2021, Valletta, Malta. pp.74-80, ⟨10.1007/978-3-030-78198-9_5⟩. ⟨hal-03384860⟩
45 View
49 Download

Altmetric

Share

More