Sr. Data Engineer

Home / Oregon / Beaverton / Et cetera / Sr. Data Engineer

Sr. Data Engineer

26 Jan 2024
Oregon, Beaverton, 97003 Beaverton USA
Report job

Sr. Data Engineer

Vacancy expired!

We are looking for a talented Sr. Data Engineer.

Responsibilities:

  • Develop, mentor, design and implement features in collaboration with team engineers, product owners, data analysts, and business partners using Agile / Scrum methodology
  • Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
  • Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the EMR ecosystem
  • Build utilities, user defined functions, and frameworks to better enable data flow patterns
  • Research, evaluate and utilize new technologies/tools/frameworks centered around high-volume data processing
  • Define and apply appropriate data acquisition and consumption strategies for given technical scenarios
  • Build, incorporate, and drive teams to write automated unit tests and integration scripts using the Python test unit framework
  • Work with architecture/engineering leads and other teams to ensure quality solutions are implemented, and engineering standard methodologies are defined and adhered to
  • Work across teams to resolve operational and performance issues and to deliver data for reporting in Tableau
  • Implement security control around sensitive data

Requirements
  • MS/BS in Computer Science, or related technical field
  • 5+ years of proven experience and 5+ years of relevant big data/ETL data warehouse experience building data pipelines
  • 2+ years leading a team of data engineers – IE mentor, improve processes, peer training, coding standards
  • 3+ years’ experience in Python and Snowflake. Strong programming experience in Python
  • Professionally worked with APIs to extract data for data pipelines
  • Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, Sqoop, etc.
  • Ability to architect, design and implement solutions with AWS Virtual Private Cloud, EC2, AWS Data Pipeline, AWS Cloud Formation, Auto Scaling, AWS Simple Storage Service, EMR and other AWS products, HIVE, Athena
  • Solving production issues and performing On-Call duties, at times
  • Working knowledge with workflow orchestration tools like Apache Airflow
  • Hands on experience with performance and scalability tuning
  • Experience with Agile/Scrum application development using JIRA
  • Experience working in a public cloud environment, particularly AWS
  • Professional experience with source control, merging strategies and coding standards, specifically Bitbucket/Git

Related jobs

  • data engineer

    , Beaverton,

    data engineer.

    More info...

  • Data Engineer 4

    , Beaverton,

    Kforce has a client that is seeking a Data Engineer 4 in Beaverton, OR.Duties Include:

    More info...

  • Senior Distribution Operations Engineer - Power Quality Focus

    , Beaverton,

    At PGE, our work involves dreaming about, planning for, and realizing a smarter, cleaner, more enduring Oregon neighborhood. Its core to our DNA and we haven’t stopped since we started in 1888. We energize lives, strengthen communities and drive advancements in energy that promote social, economic and environmental progress. We’re always on the lookout for people passionate about leading and being a part of teams that are advancing innovative clean energy solutions that are also affordable and accessible to all.

    More info...

  • Silicon EDA CAD Engineer

    , Beaverton,

    We Are:

    More info...

  • Senior Advanced Manufacturing (NPI) Engineer

    , Beaverton,

    Spectra-Physics, Ophir, Newport and ESI are brands within the MKS Instruments Photonics Solutions division. We provide a full range of solutions including lasers for precision industrial and scientific research applications, laser and LED measurement, beam profiling, precision motion control, optical tables and vibration isolation systems, photonics instruments, temperature sensing, opto-mechanical components, optical elements, and systems for flexible PCB laser processing, high-speed MLCC testing, and CO2-laser-based systems HDI PCB and IC substrate manufacturing. MKS Photonics Solutions enhance our customers’ capabilities and productivity in the semiconductor, advanced electronics and specialty industrial markets.

    More info...

  • Microelectronics Process Engineer

    , Beaverton,

    Job Description

    More info...

Job Details

  • ID
    JC8605599
  • State
    Oregon
  • City
    Beaverton
  • Job type
    Permanent
  • Salary
    $120,000 - $160,000
  • Hiring Company
    BizTek People, Inc.
  • Date
    2021-01-05
  • Deadline
    2021-03-06
  • Category
    Et cetera
  • Print

Jocancy Online Job Portal by jobSearchi.

Navigation
Vacancies
© Copyright 2024 jocancy.com. Developed by MicroPHP