Senior Data Engineer

Senior Data Engineer

Vacancy expired!

Genuent, LLC is currently seeking a Senior Data Engineer for a long term contract opportunity for our banking client based in Los Angeles, CA (and NYC). This role will be remote with some hybrid into the office occationally. This position will be responsible for writing new ETL jobs to create data pipelines to ingest data continuously with minimal failure.Skills:

• Write tools that validate data quality and improve workflow
• Refactor existing ETL jobs that may become outdated due to updates in dependencies
• Collaborate with product owner to turn business requirements into production code
• Help transition teams from traditional data stacks to our stack
• Expertise with Spark, SQL/Hive, and other big data technology
• Experience programming in Python and/or Scala
• Experience with Bash scripting, distributed systems and API design
• Experience with Databricks is a huge plus
• Experience with AWS (S3, EC2, EMR, IAM, VPC)
• Experience with Kubernetes and Docker

• Familiarity with testing practices (unit, integration, performance)
• Familiarity with continuous integrations tools (Jenkins or equivalent)
• Familiarity with visualization tools like Tableau or Microstrategy