Senior Data Engineer- 100% Remote

Senior Data Engineer- 100% Remote

02 Nov 2021
California, Sanfrancisco, 94103 Sanfrancisco USA

Senior Data Engineer- 100% Remote



SENIOR DATA ENGINEER - SILICON VALLEY - FULL-TIME



THE COMPANY

A fast-growing automotive company is looking for a Senior Data Engineer who is looking for a challenge to make an impact not only in the company but all throughout the automotive industry.



THE ROLE

RESPONSIBILITIES WILL INCLUDE:


  • You will be hands on designing and developing streaming and IoT data pipelines

  • Utilize Kubernetes and Prometheus by monitoring pipelines

  • Deploying and maintaining jobs in CI/CD tools

  • Scripting in Python

  • Designing and implementing Apache Airflow

  • Data modeling and warehousing

  • Scripting with data frame and Apache Spark




YOU

TO BE A GOOD FIT FOR THIS ROLE YOU SHOULD HAVE THE FOLLOWING EXPERIENCE:


  • Bachelors or Masters in Software Engineering or Computer Science

  • 6+ years of experience in BI and Data Engineering

  • Development knowledge

  • Data process/ streaming knowledge

  • System design and architecture experience

  • Experience with

    • Scala, spark, Kafka, golang

    • Steaming via Spark

    • Karfka for streaming pipelines

    • Presto, Airflow, influx

    • Pyspark




U.S. CITIZEN IS A MUST, NO SPONSORSHIP AVAILABLE

Related jobs

Job Details

  • ID
    JC5436590
  • State
  • City
  • Job type
    Permanent
  • Salary
    USD $140000 - $140000 per annum 140000 - 140000 per annum
  • Hiring Company
    Jefferson Frank
  • Date
    2020-11-02
  • Deadline
    2021-01-01
  • Category

Jocancy Online Job Portal by jobSearchi.