Senior Data Engineer (Hybrid Onsite/Some Remote)

Senior Data Engineer (Hybrid Onsite/Some Remote)

09 Jan 2025
New York, New york city 00000 New york city USA

Senior Data Engineer (Hybrid Onsite/Some Remote)

Req Number 137275Job DescriptionWorks directly with the Data Science and Predictive Analytics team to advance data engineering and infrastructure within Northwell, as well as migrate and support machine learning projects in production. Defines and builds the next iteration of features for the Data Science team and is responsible for modifying, expanding, and optimizing our data warehousing to include feature stores, big data, and cloud technologies. Works collaboratively with members from both the Information Technology and clinical functions to support data scientists, systems and initiatives at both the department and the enterprise level.Job Responsibility

Manages and coordinates implementation of systems and processes to meet user requirements; communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility; develops system specifications that appropriately meet department requirements.

Builds and maintains infrastructure for data management and assembles datasets from disparate sources to meet team requirements.

Maintains data acquisition process and data pipelines; verifies data quality, and/or ensures it via data cleaning and processing. Develops and optimizes ETL processes, implements transformations and quality checks results.

Designs, develops, and maintains data pipelines between serves, databases, and other sources to support Data Science research and development and production pipelines.

Identifies, designs, and implements process improvements for optimization, efficiency, greater scalability, and automation.

Develops and shares best practices for code quality, versioning, repository, documentation, and data flows among the Data Science team.

Assists data scientists, engineers, cloud architects, and subject matter advisors in testing, deploying, and maintaining artificial intelligence and machine learning algorithms.

Facilitates deployment of machine learning and other models to production; monitors performance and health; and updates/retrains models.

Works collaboratively to develop, construct, test, and maintain large scale data processing systems and databases.

Maintains development and production environments, both on-premises and cloud-based.

Participates in projects to architect (research, recommend, design, develop and deploy) advanced systems for the collection, aggregation and analysis of those data in alignment with business objectives.

Provides big data technology assessments, strategies, and roadmaps in several technical domains and act as a subject matter advisor on big data.

Works with cross functional research leadership, technical and analytical teams to understand current and future enterprise-wide big data analytics goals spanning disparate platforms and datatypes.

Assists in ensuring that systems are implemented to support Health System initiatives and goals to improve the quality of patient care, to maximize patient safety, and to provide operational efficiencies.

Demonstrates familiarity with current health system information systems.

Operates under limited guidance and work assignments involve moderately complex to complex issues where the analysis of situations or data requires in-depth evaluation of variable factors.

Makes decisions on moderately complex to complex issues regarding technical approach and completion of own tasks/responsibilities of substantial complexity.

Performs related duties as required. All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act. Duties not mentioned here, but considered related are not essential functions.

Job Qualification

Bachelor's Degree in Computer Science, Informatics, Statistics, Engineering, Data Science, or relative quantitative field required, or equivalent combination of education and related experience. Master's Degree, preferred.

3-5 years of experience with enterprise level design and implementation of relational databases, big data pipelines, cloud computing, and other advanced data science and big data technologies, required.

Advanced working knowledge and experience with SQL and relational databases, required. Strong knowledge and experience using the following software and tools, required: SQL/NoSQL, Python, R, Spark, Git, data pipeline tools (e.g., Airflow), cloud infrastructure (Microsoft Azure preferred).

Experience in building and optimizing data pipelines; deploying and maintaining production machine learning algorithms; and building, testing, and deploying code on cloud infrastructure, required.

Experience with managing healthcare data, preferred.

Experience with managing unstructured data and streaming data, preferred.

Experience in architecting data warehouses and/or data lakes with traditional database enterprise-class RDBMS technologies, preferred.

Strong knowledge of Business Intelligence & Analytics concepts and platforms, inclusive of data virtualization, data preparation, data visualization and advanced analytics technologies, preferred.

HIGHLY PREFERRED

Hands-On Experience with GCP's data pipeline tools and generative AI frameworks desirable

Additional Salary DetailThe salary range and/or hourly rate listed is a good faith determination of potential base compensation that may be offered to a successful applicant for this position at the time of this job advertisement and may be modified in the future. When determining a team member's base salary and/or rate, several factors may be considered as applicable (e.g., location, specialty, service line, years of relevant experience, education, credentials, negotiated contracts, budget and internal equity).The salary range for this position is $112,800-$197,200/yearIt is Northwell Health’s policy to provide equal employment opportunity and treat all applicants and employees equally regardless of their age, race, creed/religion, color, national origin, immigration status or citizenship status, sexual orientation, military or veteran status, sex/gender, gender identity, gender expression, disability, pregnancy, genetic information or genetic predisposition or carrier status, marital or familial status, partnership status, victim of domestic violence, sexual or other reproductive health decisions, or other characteristics protected by applicable law.

Related jobs

  • Company description

  • We are looking for a Sr Mechanical HVAC Design Engineer to join our talented team in New York City. This is an exciting opportunity to work on large-scale, complex projects across a variety of sectors

  • Senior Data Analyst

  • The team

  • The Bloomberg Terminal provides access to over 10,000 unique applications that help to drive the global financial markets, and hundreds of thousands of professionals around the world depend on it for their mission critical workflows. From a technology point of view, the Terminal can be viewed as a powerful desktop ecosystem that enables discoverability and integrated workflows for our vast portfolio of financial applications, and Application Frameworks is the group responsible for the Terminal’s application infrastructure.

  • Top Skills\' Details1) Must have 5 plus years of exp as an Azure Data Engineer

  • Microsoft’s Global Media and Partnerships team is a diverse, collaborative, solutions-oriented team committed to planning, activating and fiscally managing all paid media/advertising, strategic partnerships and agency relationships across Microsoft. The team works across business groups to tie objectives, insights and innovation together to drive business impact through world-class media investment and measurement strategies. The Senior Data Analyst will play a critical role in identifying and promoting methods that create efficiency in core work related to analytics and reporting. This will include developing solutions that are reusable, readily discoverable by decision makers, and self-service oriented, all while driving meaningful interpretation of data and supporting business decisions.

Job Details

Jocancy Online Job Portal by jobSearchi.