Ensemble Learning for Large Scale Virtual Screening on Apache Spark - Computational Intelligence and Its Applications Access content directly
Conference Papers Year : 2018

Ensemble Learning for Large Scale Virtual Screening on Apache Spark

Karima Sid
  • Function : Author
  • PersonId : 1038471
Mohamed Batouche
  • Function : Author
  • PersonId : 1031882


Virtual screening (VS) is an in-silico tool for drug discovery that aims to identify the candidate drugs through computational techniques by screening large libraries of small molecules. Various ligand and structure-based virtual screening approaches have been proposed in the last decades. Machine learning (ML) techniques have been widely applied in drug discovery and development process, predominantly in ligand based virtual screening approaches. Ensemble learning is a very common paradigm in ML field, where many models are trained on the same problem’s data, to combine in the end the results in one improved prediction. Applying VS to massive molecular libraries (Big Data) is computationally intensive; so the split of these data to chunks to parallelize and distribute the task became necessary. For many years, MapReduce has been successfully applied on clusters to solve the problems with very large datasets, but with some limitations. Apache Spark is an open source framework for Big Data processing, which overcomes the shortcomings of MapReduce. In this paper, we propose a new approach based on ensemble learning paradigm in Apache Spark to improve in terms of execution time and precision the large-scale virtual screening. We generate a new training dataset to evaluate our approach. The experimental results show a good predictive performance up to 92% precision with an acceptable execution time.
Fichier principal
Vignette du fichier
467079_1_En_22_Chapter.pdf (657.15 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01913905 , version 1 (07-11-2018)





Karima Sid, Mohamed Batouche. Ensemble Learning for Large Scale Virtual Screening on Apache Spark. 6th IFIP International Conference on Computational Intelligence and Its Applications (CIIA), May 2018, Oran, Algeria. pp.244-256, ⟨10.1007/978-3-319-89743-1_22⟩. ⟨hal-01913905⟩
95 View
75 Download



Gmail Facebook X LinkedIn More