Data Engineer

Data Engineer

23 Jan 2024
Washington, Redmond, 98052 Redmond USA

Data Engineer

Vacancy expired!

JD for Role: Azure Data Engineer
As a Data Engineer on the Data Science and Platform team, you will:
Develop and maintain data pipelines including solutions for

data collection, management and usage.
Work closely with Data Scientists to optimize and reengineer model code to be modular, efficient and scalable, and to deploy models to production.
Maintain and enhance our data and computation platform.
Develop and implement solutions for data quality validation and continuous improvement.
Manage, execute and monitor weekly and monthly production operations; resolve and escalate production issues as appropriate.
Partner with business stakeholders to understand business and technical requirements, plan and execute projects, and communicate status, risks and issues.
Perform root cause analysis of system and data issues and develop solutions as required.
Qualifications
Required
BA/BS in business, computer science or other technical field or 5+ years of appropriate work experience
Proficient in

Azure SQL Data Warehouse, T-SQL and database architecture.
Implement data warehouses and analysis services as part of a modern data warehouse (MDW) design
Experience working with cloud-based technologies, including relational databases, data warehouse, big data (

Spark), orchestration/data pipeline tools, data frames concepts, Spark Streaming and

Spark SQL
Experience with

Azure Analytics stack, Azure Data Lake, Azure Databricks, Azure Data Factory,

Azure Cloud, Kafta.
Experience with ETL data pipelining concept.
Proficient in

Power BI
Experience working in software engineering, and can demonstrate best practices for project management, quality control, and product development.
Proven track record of collaborative development in an agile team environment.
Experience with

Python, Scala.

Expertise in Pyspark or Scala is a must.
Hands on experience of writing notebooks in

Databricks using python for complex data aggregations, transformations, schema operations.

Related jobs

  • Description

  • Why engineering at Stryker?

  • Azure Active Directory (Azure AD) is at the center of Microsoft’s cloud strategy. We build and operate critical authentication, authorization and directory services that are used by the millions of Azure, Office 365, XBOX and Windows users worldwide. In the mobile-first cloud-first world, sign-in and sign-up is the front door for reliable end user experience to use any of Microsoft cloud services. 

  • Microsoft Silicon and Cloud Hardware Infrastructure Engineering (SCHIE) is the team behind Microsoft’s expanding Cloud Infrastructure and responsible for powering Microsoft’s “Intelligent Cloud” mission. SCHIE delivers the core infrastructure and foundational technologies for Microsoft\'s over 200 online businesses including Bing, MSN, Office 365, Xbox Live, Skype, OneDrive and the Microsoft Azure platform globally with our server and data center infrastructure, security and compliance, operations, globalization, and manageability solutions. Our focus is on smart growth, high efficiency, and delivering a trusted experience to customers and partners worldwide and we are looking for passionate, high energy engineers to help achieve that mission. As Microsoft\'s cloud business continues to grow the ability to deploy new offerings and HW infrastructure on time, in high volume with high quality and lowest cost is of paramount importance.

  • Have you ever imagined a world with an infinite amount of storage available and accessible to everyone? A place where everyone in the world can easily access their data from anywhere at any time via any means (e.g., mobile phones, tablets, personal computers, smart devices, etc.). Did you ever desire a universally accessible storage system to record all the knowledge known to humankind or to store all the data collected from all the scientists in the world for them to collaborate upon? Do you want to be part of a team that strives to bring these to reality?

  • Microsoft is a company where passionate innovators come to collaborate, envision what can be, and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

  • The PowerApps platform (part of Business Application Group) aims to be the platform of choice for building components that permit high productivity, intelligent and no-code nextgen application development. The platform empowers customers to easily customize, develop, and deploy business applications that work online and offline, for consumption on mobile devices and the web,  without the need to write code. We integrate cutting edge Artifical Intelligence (AI) technology in product for “low codeno-code” app developers to build app without compromising on extensibility for professional developer or data scientists. The platform will power the business applications, and be the extensibility story for all of Office 365.  

Job Details

  • ID
    JC32298728
  • State
  • City
  • Job type
    Contract
  • Salary
    Depends on Experience
  • Hiring Company
    ENFEC
  • Date
    2022-01-21
  • Deadline
    2022-03-22
  • Category

Jocancy Online Job Portal by jobSearchi.