Implementing Continuous Integration CI/CD Pra...

Implementing Continuous Integration CI/CD Practices for Big Data Projects using Jenkins, Git, and Maven

Author Name : Bharath Thandalam Rajasekaran, Er. Shubham Jain

ABSTRACT In today’s fast-paced digital landscape, big data projects demand rapid, reliable, and scalable solutions to manage complex data pipelines and analytics workflows. Implementing continuous integration (CI) and continuous delivery (CD) practices has become essential to meet these needs. This paper explores the integration of CI/CD methodologies in big data environments, focusing on a toolchain that leverages Jenkins for automation, Git for version control, and Maven for build management. The proposed approach aims to streamline the development cycle, reduce errors through automated testing, and enable seamless deployment of big data applications. By integrating these technologies, development teams can ensure that every code change is automatically built, tested, and deployed, thereby accelerating the feedback loop and enhancing overall productivity.