Vacancy expired!
FOR IMMEDIATE DETAILS ABOUT THIS POSITION, contact ANY of us direct, referencing the JOB# below:
Calance Recruiters:
KIANA AREVALO:
JOANNE SMITH:
SHERRIE KRAUS:
SUMIT KUMAR:
E M A I L:
Position:Sr. Data Engineer
Job# 37242
Duration:Direct Hire/Perm
Location:REMOTE only
Salary:Open, Depends on exp level (W2 ONLY)
=
Since this role is full-time, will not accept C2C consultants, must be W2 only
=
This role is 100% remote, candidates can reside anywhere in the US
Senior Data Engineer wanted for a full-time position, leading engineering efforts for rapid data ingestion and scalable batch jobs. You will drive key decisions along the way that will influence our entire engineering organization.
Daily Responsibilities:
Lead critical efforts designing and building our next generation Streaming Data Platform, leveraging PubSub, Finagle, Scala, Dataflow, and Google Cloud Platform.
Build scalable Dataflow data pipelines leveraging Airflow scheduler/executor framework
Design our data models for optimal storage and retrieval and to meet machine learning modeling needs.
Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of output for Data Engineers across the company
Take an active role in the technical growth of other team members and the processes that support overall team growth
Lead or participate in code and technical design reviews
REQUIRED SKILLS/EXPERIENCE:
Please only apply if you looking for a full-time, direct hire position
5+ years of significant professional experience in server-side development written in Scala, Java, Go, or Python
5+ years of professional experience developing large-scale, high-volume services using Finagle, Akka, or gRPC to handle PetaBytes of data
5+ years of experience managing data pipelines and infra, using Dataflow, Spark, Hadoop, Flink, and Airflow.
Professional experience across the entire software development process, from development environment, to CI & CD including CircleCi, Jenkins, or TravisCi, to production
deployment, product and application performance measurement
Confident articulating complex technical content to peers and partners across the organization via Technical Design Documents.
Excellent written and communication skills
Education: Bachelor's Degree
DESIRED SKILLS:
DevOps experience with Google Cloud Platform, AWS, or Azure
Data quality experience especially using & improving internal tools to automatically detect issues
Experience with Data Quality tools, including Deequ or Apache Griffin
Experience building Scala based services in a production environment
