Senior Data Engineer

Senior Data Engineer

15 Mar 2024
Massachusetts, Boston, 02108 Boston USA

Senior Data Engineer

DescriptionAccertify is the trusted partner to the world’s leading eCommerce brands. We help our clients grow revenue and protect against loss with industry-leading fraud prevention and digital identity offerings. When you join Accertify, you become part of the digital solution to enable legitimate eCommerce, delivering peace of mind to merchants and their customers across the globe. #TeamAccertify provides a solution merchants trust and a career you can trust.Accertify is a wholly owned subsidiary of American Expresswhich means our team has access to the amazing perks and benefits offered by our parent company. We are proud to be #TeamAmex and #TeamAccertify.Accertify is growing, and we are looking to add a Senior Data Engineer to our global fraud-fighting team.How will you make an impact in this role?The Senior Data Engineer will work with large volumes of data supporting our products, fighting Payment Fraud and Account Protection by crafting innovative solutions supporting the Product and Decision Science’s needs. The Senior Data Engineer will work with the latest technology solutions in the industry and actively participate in brainstorming and solution design sessions along with other Data Engineers.Essential Duties and Responsibilities:

Design, build, and maintain complex data processing systems, both structured and unstructured.

Build efficient data workflows and data ingestion mechanisms to hydrate the data lake environment.

Build data pipelines leveraging Hadoop and Spark to aggregate data and create features from a streaming data source.

Performing QA testing on the data pipelines to validate the accuracy, scalability, and maintainability requirements.

Package the data pipeline jobs and run them on Kubernetes clusters.

Develop simplified yet scalable data processing patterns to streamline the existing pipelines for maintainability.

Experiment with various tools and packages to be added to the current stack.

Preferred Qualifications

Bachelor’s degree- Preferred

6 years of experience with Hadoop FS and building data pipelines and workflows preferred

4 years of experience in building streaming solutions leveraging Kafka queues, preferred

5 years of experience in building Spark applications leveraging either Python and/or Scala and a deeper understanding of Spark architecture preferred

3 years of working with Docker and Kubernetes in building and deploying containers preferred

7 years of experience working with Jupyter Notebooks preferred

At least 5 years of strong programming experience in Python/Java is highly preferred

Experience with MapR (HPE- hpe-ezmeral-data-fabric)-Preferred

Experience with Scala, Functional languages & AWS Kinesis-Preferred

QualificationsSalary Range: $110,000.00 to $190,000.00 annually bonus benefitsEmployment eligibility to work with American Express in the U.S. is required as the company will not pursue visa sponsorship for these positions.The above represents the expected salary range for this job requisition. Ultimately, in determining your pay, we'll consider your location, experience, and other job-related factors.We back our colleagues and their loved ones with benefits and programs that support their holistic well-being. That means we prioritize their physical, financial, and mental health through each stage of life. Benefits include:

Competitive base salaries

Bonus incentives

6% Company Match on retirement savings plan

Free financial coaching and financial well-being support

Comprehensive medical, dental, vision, life insurance, and disability benefits

Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need

20 weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy

Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)

Free and confidential counseling support through our Healthy Minds program

Career development and training opportunities

For a full list of Team Amex benefits, visit our Colleague Benefits Site .American Express is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law.We back our colleagues with the support they need to thrive, professionally and personally. That's why we have Amex Flex, our enterprise working model that provides greater flexibility to colleagues while ensuring we preserve the important aspects of our unique in-person culture. Depending on role and business needs, colleagues will either work onsite, in a hybrid model (combination of in-office and virtual days) or fully virtually.US Job Seekers/Employees - Click here to view the “Know Your Rights” poster and the Pay Transparency Policy Statement.If the links do not work, please copy and paste the following URLs in a new browser window: https://www.dol.gov/agencies/ofccp/posters to access the three posters.Job: TechnologyPrimary Location: United StatesSchedule Full-timeReq ID: 24003817

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.