Data Engineer

Data Engineer

Vacancy expired!

Senior Data Engineer
6 month contract
Austin, TX (onsite after Covid)
Job Overview
Our Engineers are energetic influencers who thrive on designing simple and scalable solutions to complex problems and delivering leading edge software products for our customers. We are looking for exceptionally ambitious and communicative hands-on individuals who are comfortable collaborating within the Agile methodology as part of a cross-functional team, have experience working in fast-paced environments, and who have the passion and skills to take our product offerings to the next level.
As a Senior Data Engineer, you will be a technical leader in a collaborative team environment that encourages you to perform at your best, while contributing to the engineering efforts of one of our data scrum teams. You will be challenged to engineer right-sized solutions for complex business problems focused on building patterns to support data pipelines, data warehousing, and data transformations. You will apply your knowledge of modern software design, best practices, design patterns, and frameworks, with an understanding of application performance and maintainability. You will aspire to use new technologies and challenge yourself to develop innovative solutions. You will work alongside developers and technical leads on a team where collaborative programming and mentoring is regularly practiced.
Technologies we use

• NET Core, C#, Python
• Oracle, Snowflake
• Apache Spark
• AWS
• Compute: EC2, Lambda
• Containers: ECS, EKS, Fargate, ECR
• Data: S3, RDS, Aurora, DynamoDB, ElastiCache, DMS
• Analytics: EMR, Elasticsearch
• Networking: VPC, Route 53, API Gateway, Direct Connect
• DevOps: CodeBuild, CodePipeline, CloudWatch
• Messaging: SQS, SNS
• Terraform
• Tableau

Your Role

• Display a high level of critical thinking in bringing success to the organization
• Influence technical solutions while coaching newer or less experienced members on your Scrum team
• Construct and manage services which extract data from disparate databases, transform the data and loads into a Snowflake data warehouse
• Collaborate with team members on best practices, code reviews, internal tools and process improvements
• Evangelize new ideas within your team as well as across teams
• Develop high performing, scalable and secure solutions
• Plan and deliver core technology upgrades
• Diagnose, design, and implement solutions to key technology or application problems

Qualifications:
Required

• 5+ years of professional software development experience
• BA/BS degree in Computer Science or related field (or equivalent work experience in lieu of education)
• Understanding of ETL and ELT processes
• Data Warehousing experience, including Snowflake or other data warehousing tools
• AWS/Cloud experience
• Programming experience with data sets in Python, Scala, Java or C#
• Understanding of SQL, relational databases, columnar data warehouses, and data modeling
• Apache Spark experience
• Experience with automated infrastructure tooling
• A history of taking applications from conception/design to implementation/support
• Experience designing and implementing applications with highly optimized and scalable architectures

Preferred

• Experience with CDC (Change Data Capture) and parquet formats
• Experience with data replication tools (Attunity, DeltaLake, or Hudi)
• AWS Data Migration Services (DMS)
• Amazon EMR
• Experience developing on Oracle databases
• Work monitoring and tuning EMR/Spark/YARN
• Experience working with/implementing CI/CD pipelines
• Experience with Terraform
• Familiarity with BI tools such as Tableau
• Strong understanding of industry development, deployment processes and agile development methodologies
• Advanced degree in Computer Engineering/Science or related field

What We Look For

• Ability to work on multiple projects and be flexible to adapt to changing requirements
• Ability to turn high-level requirements into a working system through iterative development
• Proven ability to work collaboratively and independently to design, develop and deploy solutions
• High energy, confident, ambitious and self-motivated individual
• Must be an effective communicator

Please contact or