Senior Data Engineer

Senior Data Engineer

09 Aug 2024
Michigan, Ann arbor, 48103 Ann arbor USA

Senior Data Engineer

Senior Data EngineerApply NowHow to ApplyPlease attach a cover letter as the first page of your resume. It should address your specific interest in the position and outline your skills and related experience.Responsibilities

Develop production-quality ETL workflows & data pipelines running in a distributed, containerized, cloud-native environment to support ingestion, transformation, & dissemination of complex social science research data & metadata from a variety of data sources.

Develop tools & software to process archival & statistical file formats including SPSS, SAS, Stata, & R.

Use AWS Cloud products to design & manage relational & non-relational data storage services.

Write SQL queries for creating & developing data reports that cater to the needs of the consumers of ICPSR datasets.

Apply best practices in software development & data management to improve curation workflows in a secure data environment by building a library of reusable scripts & tools orchestrated by an automated jobs framework.

Develop secure, scalable, & resilient REST APIs in Python to expose data as a service to upstream producers & downstream consumers.

Implement monitoring solutions for data engineering products & provide operational support to pipelines & APIs in production.

Research & identify open source & COTS (commercial off the shelf) tools to solve challenging problems while minimizing the need for custom code.

Required Qualifications

Position requires a Bachelor's degree in Computer Science or Software Engineering or Computer Engineering or Information Systems

60 months experience as a Data Engineer &/or Extract, Transform, & Load (ETL) Developer &/or Data Warehouse Engineer &/or Big Data Developer.

Position also requires: Exp. must include:

60 mos. exp. programming in Python for data engineering projects;

60 mos. exp. using SQL to query & modify relational database management systems;

60 mos. exp. building production-quality data pipelines using ETL &/or data integration &/or data orchestration tools & frameworks;

60 mos. exp. building interfaces with heterogeneous data sources & sinks including REST (representational state transfer) APIs (application programming interfaces); &

60 mos. exp. using AWS Cloud storage & computing.

Exp. reqs. may be met concurrently during the same time period.Modes of WorkPositions that are eligible for hybrid or mobile/remote work mode are at the discretion of the hiring department. Work agreements are reviewed annually at a minimum and are subject to change at any time, and for any reason, throughout the course of employment. Learn more about the work modeshere (https://dev.hr.umich.edu/working-u-m/my-employment/ways-we-work-resource-center/ways-we-work-implementation-group/modes-work) .Additional InformationThe Institute for Social Research (ISR) at the University of Michigan seeks to recruit and retain a diverse workforce as a reflection of our commitment to serve the diverse people of Michigan, to maintain the excellence of the university, and to ground our research in varied disciplines, perspectives, and ways of knowing and learning.U-M EEO/AA StatementThe University of Michigan is an equal opportunity/affirmative action employer.Job DetailJob Opening ID252916Working TitleSenior Data EngineerJob TitleApp Programmer/Analyst SrWork LocationAnn Arbor CampusAnn Arbor, MIModes of WorkOnsiteFull/Part TimeFull-TimeRegular/TemporaryRegularFLSA StatusExemptOrganizational GroupInst Soc ResearchDepartmentICPSRPosting Begin/End Date8/09/2024 - 8/16/2024Career InterestInformation TechnologyApply Now

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.