Senior Data Engineer

Senior Data Engineer

20 May 2024
Wisconsin, Milwaukee, 53201 Milwaukee USA

Senior Data Engineer

Vacancy expired!

Our great client in Milwaukee, WI has an immediate opening for a Senior Data Engineer. If you are interested please apply with resume to .

This is a Contract-to-hire position. Open to remote work 100%.

We are currently looking for a Senior Data Engineer who is passionate about building systems that collect, manage, and convert raw data into usable information for data scientists and data science analysts to interpret and help business leaders make data-driven decisions. In this role, the data engineer will be part of IT Data Delivery team and responsible for developing scalable solutions and building scalable systems by leveraging various AWS Cloud tools and technologies, as well as integrating with legacy systems.

Responsibilities:

  • Define data integration frameworks, methods, guidelines, and principles. Apply subject matter expertise to data integration processes to make improvements and recommendations.
  • Work with enterprise architects, data architects, data engineers, analysts, and other stakeholders to design/build pipelines and cloud-based technical processes consistent and in support of the enterprise architecture direction to satisfy functional/non-functional requirements.
  • Design and develop scalable data pipelines and builds out new API integrations to support continuing increase in different data needs, volume, and complexity.
  • Performs data and system analysis required to troubleshoot data related issues and assist in the resolution of data issues.
  • Works closely with all business units and other partner teams to develop strategy for long term data platform architecture.
  • Implements processes and systems to monitor data quality and availability. Ensures production data is always accurate and available for key stakeholders and business processes that depend on it.
  • Administers and maintains existing data pipelines to their full extent of data needs.
  • Execute day-to-day development of data pipelines using continuous integration, continuous testing, and continuous deployment practices.
  • Perform code reviews and provide feedback to the team.
  • Ensure compliance with data governance and security policies.
  • Willingness and ability to explore new technologies, develop new skills, share knowledge, and mentor team members on new technologies and platforms.

Required skills:
  • Experience with data warehouse technical architectures, ETL/ ELT, reporting/analytic tools, and scripting.
  • Experience with AWS services including S3, Lambda, EMR, RDS, Glue, Athena, Redshift, Kinesis, Data Pipeline, and other big data technologies.
  • Extensive data analysis and data engineering experience.
  • Experience with scripting (Python, PySpark experience is a strong plus).
  • Experience with Agile engineering practices.
  • Experience with end-to-end automation of data pipelines using tools like Git, GitLabCICD, AWS CodePipeline, AWS CloudFormation, Jenkins, Terraform.
  • Ability to train/mentor other team members.
  • Ability to plan, coordinate, deliver and validate data engineering pipelines.
  • Ability to translate business and technical requirements into data engineering designs and solutions.


EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.