Lead Developer( Pyspark/Big data)Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.Responsibilities
Lead the architecture design and implementation of large-scale distributed data systems using PySpark.
Collaborate with business stakeholders technology teams and data engineers to gather requirements define objectives and build scalable data pipelines.
Drive end-to-end solution design including data acquisition storage processing and analysis.
Optimize performance of big data processing systems ensuring low-latency and high-throughput data flows.
Ensure alignment with industry best practices and compliance standards in data security and privacy.
Mentor and guide a team of developers and engineers promoting best practices in coding architecture and design patterns.
Evaluate new tools and technologies identifying opportunities for innovation and driving their implementation.
Collaborate closely with cross-functional teams including finance and enterprise functions to ensure solutions meet business objectives.
Required Skills
10+ years of experience in software architecture with a strong focus on PySpark and big data processing systems.
Proficient in Apache Spark Hadoop and other distributed computing frameworks.
Deep understanding of data architecture ETL/ELT processes and cloud-based data platforms.
Proven experience in Finance Technology or Enterprise Functions is highly desirable.
Strong knowledge of relational databases NoSQL databases and data warehousing solutions.
Solid experience in working with cloud platforms such as AWS Azure or Google Cloud.
Hands-on experience with streaming technologies like Kafka and real-time data processing.
Excellent problem-solving skills strategic thinking and a results-oriented approach.
Proven leadership abilities with experience managing technical teams in a fast-paced environment.
Strong communication skills capable of presenting ideas clearly to both technical and non-technical stakeholders.
Familiarity with machine learning frameworks and AI-driven data insights.
Experience with DevOps practices and CI/CD pipelines in data engineering.
Life at CapgeminiCapgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:
Flexible work
Healthcare including dental, vision, mental health, and well-being programs
Financial well-being programs such as 401(k) and Employee Share Ownership Plan
Paid time off and paid holidays
Paid parental leave
Family building benefits like adoption assistance, surrogacy, and cryopreservation
Social well-being benefits like subsidized back-up child/elder care and tutoring
Mentoring, coaching and learning programs
Employee Resource Groups
Disaster Relief
DisclaimerCapgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-lawCapgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.Ref. code: 80439Posted on: Sep 27, 2024Experience Level: Experienced ProfessionalsContract Type: PermanentLocation:Atlanta, USBrand: CapgeminiProfessional Community: Software EngineeringCapgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
