In this role, you’ll be responsible for helping to design and develop technical solutions leveraging cloud and automation technologies.  The ideal candidate must maintain technical proficiency with Microsoft Azure, scripting languages, and networking skills. Leveraging your experience performing in a client-facing, you will help define and execute our innovation strategy.  As a senior data engineer, you will also work with our Business Development team to support solutioning and writing for proposal opportunities. It is imperative that the Data Engineer has broad experience within core data engineering areas but is an expert in at least 3 of the following (listed in order of preference): Cloud architecture (Azure preferred); Data warehousing; Data architecture; Data ETL (Extract transform load) techniques; Python programming; Back-end architecture; Web application design.  An understanding of unstructured data will be very valuable.  Geospatial data and JSON and documents as data sources.  Interfacing with machine learning is a plus.Responsibilities:Design, develop, and optimize scalable data pipelines and ETL processes for ingesting, transforming, and storing large datasets from diverse sources.Manage and optimize databases on Azure SQL Server, ensuring high performance and availability.Collaborate with cross-functional teams, including Data Scientists, Analysts, and Developers, to understand data needs and deliver effective solutions.Develop and maintain robust, reusable, and efficient Python scripts to support data transformation and processing tasks.Create interactive and insightful data visualizations using Plotly to support business intelligence and decision-making processes.Monitor and troubleshoot data pipeline issues to ensure data quality and system reliability.Identify performance improvements in back end ETL processes with a focus on efficient and timely updates.Enhance performance of data and queries to support interactive queries and filteringEnsure compliance with data governance, security, and privacy policies.Stay updated with the latest industry trends, tools, and best practices in data engineeringContributes to formulation of strategies for project leadership and other functional areas.Expert in Azure architecture for both storage and application hosting.Develops standard for scalable solutions to data storage and access challenges.Assist client delivery teams with design and development of technical solutions for implementation and deployment based on client requirements.Responsible for proposal solutioning and technical writing, as well as responsible for authoring technical white papers.
