Data Engineer

Data Engineer

25 May 2024
Minnesota, Minneapolis / st paul, 55401 Minneapolis / st paul USA

Data Engineer

Vacancy expired!

Responsibilities:

  • ADF, Databricks, Spark
  • Development experience in Python or NodeJS
  • MQ - Common Data Model provides JSON files. Take these from the cloud and load into Databricks.
  • Go to message que so they know when to grab the message files from Azure
  • Build data pipelines
  • In legacy they get files, do some transformations, and load into database. They want to do all of this in the cloud


Must have:
  • .NET Development background and then moved into Azure Data Engineering
  • Databricks
  • ADF
  • Azure
  • CICD -Won't be building pipelines but need to be able to troubleshoot
  • Python (OOP)
  • NodeJS
  • MQ - Kafka or others


Nice to have:
  • Azure Functions
  • Scala


Interview process:
  • 2-3 rounds
  • First round 30 min
  • 2 hour technical (design and coding)


Remote? Strong preference for Eden Prairie or Franklin TN

Description:

Primary Responsibilities

• Build high performing and scalable data systems, applications, and data pipelines to process very large amounts of data from multiple sources

• Develops services, controls, and reusable patterns that enable the team to deliver value safely, quickly, and sustainably in the public cloud and on prem.

• Collaborate on Big Data systems, and features within an Agile environment?

• Collaborate with cross-function teams of developers, senior architects, product managers, DevOps, and project managers?

• Deliver solutions that are devoid of significant security vulnerabilities?

• Foster high-performance, collaborative technical work resulting in high-quality output?

• Proactively automate infrastructure, application and services to enable an automated delivery through the CI/CD pipelines to the cloud and on prem

• Help convert current on-premise ETL pipelines from .net to cloud using azure data factory/data bricks

• Help maintain current .Net framework till conversions are complete

• Excellent time management, communication, decision making, and presentation skills

• Display a strong desire to achieve and attain high levels of both internal and external customer satisfaction

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.