Big Data Engineer

Big Data Engineer

02 Mar 2024
California, Santaclara, 95050 Santaclara USA

Big Data Engineer

Vacancy expired!

A rapidly growing well-funded SaaS startup seeks to add to their team a Lead Data Engineer that has experience building data processing systems at scale with Spark and Scala.

This is a chance to get in early with a company that develops AI/ML solutions in an industry that's ripe for innovation.

The Lead Data Engineer will provide technical leadership to the data engineering team, drive technology decisions, contribute on an individual level and mentor junior engineers.

This role will work hand-in-hand and with application engineers, data scientists, and product managers.

Must-Have:
- Comfortable in a technical lead role (pref. 7+ years of experience)
- Strong programming in either Java or Scala
- Experience building data processing systems at scale using Spark or similar ecosystem
- Experience building frameworks that can handle 10x TB of data at scale (Spark, Hive, AWS Glue).
- Experience building robust data pipelines (AirFlow/KubeFlow/or similar)

Additional Tech: Apache Zeppelin, AWS Athena/Presto, Lambda, Athena, EMR (equivalent tools in the Google Cloud Platform stack will also suffice)

Related jobs

Job Details

  • ID
    JC10482536
  • State
  • City
  • Job type
    Permanent
  • Salary
    $185k - 225k per year
  • Hiring Company
    Empower Associates
  • Date
    2021-03-02
  • Deadline
    2021-05-01
  • Category

Jocancy Online Job Portal by jobSearchi.