Data Integration Systems Engineer

Data Integration Systems Engineer

11 Apr 2025
Pennsylvania, Philadelphia, 19113 Philadelphia USA

Data Integration Systems Engineer

Dev-ops / data integration systems administration at the City offers a unique opportunity for impactful, dynamic work and professional growth, leveraging cutting-edge technologies. This is a position on a diverse team of engineers, analysts, and GIS specialists, contributing to developing, maintaining, and optimizing our data pipelines and integration strategies, assisting departments and agencies to innovate and enhance the City’s service to its residents.                                                                                                             

This role will work closely with a senior Systems Engineer to support and enhance existing infrastructure. The dev-ops / data integration systems engineer will help deploy and streamline the team’s various server stacks and automations that host the City’s data engineering infrastructure, pipelines, models, and integrations. The team (CityGeo) uses a blend of open source, custom developed and off-the-shelf tools, including Python, Bash, DBT, GIS, Docker, Terraform, Apache Airflow, Jenkins, Postgres, PostGIS, AWS, GitHub, MuleSoft as an iPaaS and SAS API provides like ArcGIS Online and CARTO.

Some prominent services the team is responsible for include DataBridge, OIT’s enterprise data warehouse, AIS, the City’s custom address information systems which supports public address search and internal geocoding, and Databridge-Airflow, a custom workflow generator and orchestrator for departmental integrations (https://metadata.phila.gov/) and open data publishing (https://opendataphilly.org/). Some examples of OIT’s commitment to serving the public through the effective and innovative integration of City open data include:

https://Atlas.phila.gov

https://property.phila.gov

https://Openmaps.phila.gov

https://streetsmartphl.phila.gov/

www.phila.gov/solarmap

www.phila.gov/stressmapWe are looking for a candidate who is not only technically skilled but also passionate about leveraging data to improve City operations and community life. This team is fundamental to the innovation of City services that directly affect residents. If you are eager to contribute to a team that values innovation, efficiency, service-oriented work and data-driven decision-making, we encourage you to apply.Essential Functions

    Design and implement new deployment and automation strategies for maintaining and updating various server stacks in the cloud (AWS(primary)/Azure) on Linux and Windows servers.

    Configuring various system health monitors using AWS CloudWatch, SNS, Grafana, AlertManager, and Prometheus

    Work closely with data engineers to support integration and open data initiatives, developing and maintaining critical systems like the City’s DataBridge, DataBridge-Airflow, MuleSoft and AIS.

    Design, develop, expand and refine existing data pipelines using Apache Airflow, custom Python-based software, and other tools.

    Write clear, descriptive technical documentation for systems/applications, partner with data stewards of various technical levels and communicate technical details to non-technical stakeholders.Competencies, Knowledge, Skills and AbilitiesCompetencies:

    Clear and concise writing and communication skills – documentation driven.

    Creative problem-solving and critical thinking.

    Efficient time management and the ability to manage multiple workflows simultaneously.

Knowledge and Skills:

    Proficient in Systems Administration (Linux preferred, but we work with Windows too).

    Proficient with CLI (Linux and PowerShell), Bash and Python.

    Proficient with Docker

    Automation Mindset: Leverages automation for maintainability/security with CI/CD pipelines.

    Familiar or ability to learn tools like GitHub Actions, Terraform, Jenkins, Airflow.

    Understanding of Git/GitHub for version control and CI/CD pipelines.

    Experience or ability to learn databases administration (Postgres preferred) and SQL (proficiency a plus).

    Experience working with cloud technologies, containers, and orchestration tools (AWS: Batch, ECS, EKS, CloudWatch).

    Experience or ability to learn Airflow, DBT, Terraform, Kubernetes, MuleSoft.

    Experience working with spatial datasets a plus.

Abilities:

    Troubleshoot system health and understand the basics of deploying maintainable systems.

    Maintain clean and secure data environments.

    Work effectively in a hybrid (on-premises and cloud) environment.

    To communicate complex technical concepts in understandable terms.

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.