ICTACT Journal on Soft Computing

Deepak Gupta ¹, Deshdeepak Shrivastava ², Anand Kumar Pandey ³, Rashmi Pandey ⁴, Gaurav Dubey ¹

Affiliations
1 Department of Computer Science and Engineering, Institute of Technology and Management Gwalior, IN
2 Department of Information Technology, Institute of Technology and Management Gwalior, IN
3 Department of Computer Science and Application, ITM University, IN
4 Department of Master of Computer Applications, Institute of Technology and Management Gwalior, IN

Abstract

Big data analytics often involves complex decision-making processes that require finding efficient cost-performance tradeoffs. Evolutionary algorithms (EAs) have proven to be effective in solving multi-objective optimization problems by exploring the Pareto front, which represents the optimal tradeoffs between conflicting objectives. In this paper, we propose an evolutionary algorithm-based approach for Pareto front exploration in big data analytics. Our approach employs a novel fitness function that incorporates both cost and performance metrics, allowing the algorithm to simultaneously optimize for both objectives. We introduce several mutation and crossover operators tailored for big data analytics, ensuring effective exploration of the solution space. To validate the effectiveness of our approach, we conduct experiments using real-world big data analytics scenarios. The results demonstrate that our evolutionary algorithm-based approach successfully explores the Pareto front, enabling decision-makers to identify optimal cost-performance tradeoffs in big data analytics.

Keywords

Big Data Analytics, Evolutionary Algorithms, Multi-Objective Optimization, Pareto Front, Cost-Performance Tradeoffs.

Full Text