Data Engineer

Data Engineer

Vacancy expired!

Our client, a Health Insurance firm in NYC is looking for a Data Engineer. The Data Engineer will bring their expertise in designing and developing highly robust, repeatable and scalable workflow patterns to ingest, integrate and publish a wide variety of data from internal and external sources. They will be relentless in their focus on delivery and end ensuring that our data workflows and pipelines are enterprise-grade – reliable, scalable and secure.
Responsibilities include:

• Designing, implementing, maintaining highly robust, scalable and flexible ETL jobs and data workflows
• Automating workflows leveraging DevOps framework where applicable
• Ensuring quality of technical solutions as data moves across Healthfirst environments
• Working with solution and data architects to develop, construct, test and maintain architectures, prototypes and design solutions
• Helping to maintain the integrity and security of the company data
• Providing insight into the changing data environment, data processing, data storage and utilization requirements for the company and offer suggestions for solutions
• Articulating both the technical implications as well as data usage implications of proposed solutions or solution options to a wide variety of stakeholders.
• Working directly with business users to align solutions with business requirements
• Relentless focus on continuous improvement of solutions in to improve data reliability, efficiency, quality and more
• Create data monitoring capabilities for each business process and work with data consumers on updates
• Collaborating with cross functional teams comprised of technical and business colleagues

Minimum Qualifications:

• 5 + years’ experience in a data engineering
• Experience in the development of data platforms such as data warehouse, data lakes, data marts etc.
• Proficiency in SQL a must - knowledge of SQL and multiple programming languages in order to optimize data processes and retrieval
• 5+ years’ experience in data programing languages such as Python or Spark
• 5+ years’ experience working in a Big Data ecosystem processing data; includes file systems, data structures/databases, automation, security, messaging, movement, etc.
• 3+ years’ experience working in a production cloud infrastructure
• Prior backgrounds with AWS services (e.g. lambda, S3, Aurora, Redshift);
• Exposure to CI/CD for software systems
• Must be able to develop creative solutions to problems
• Demonstrates critical thinking skills with ability to communicate across functional departments to achieve desired outcomes
• Ability to work independently and as part of a team
• Skilled in Microsoft Office including Project, PowerPoint, Word, Excel and Visio

Preferred Qualifications:

• Hands on experience in leading healthcare data transformation initiatives from on-premise to cloud deployment
• Demonstrated experience working in an Agile environment as a Data Engineer
• Experience with other Cloud Data Warehouses (Big Query, Snowflake);
• Knowledge of provider-sponsored health insurance systems/processes and the Healthcare industry
• Proficiency with graph and noSQL databases