Senior Data Engineer

Senior Data Engineer

18 Feb 2024
Georgia, Atlanta, 30301 Atlanta USA

Senior Data Engineer

Vacancy expired!

OverviewIntuit Mailchimp is a leading marketing platform for small businesses. We empower millions of customers around the world to build their brands and grow their companies with a suite of marketing automation, multichannel campaigns, CRM, and analytics tools.As a part of the Observability Platforms team, you’ll join us in maintaining, scaling, optimizing, and migrating our Observability and data pipeline infrastructure. It consists of Kafka and PubSub, which pushes up to 10 billion events per day, and Splunk, Elasticsearch and OpenSearch clusters that ingest 1 trillion documents. This data pipeline we manage is the 2nd largest piece of the Mailchimp infrastructure. We provide our internal and external customers with highly available, approachable data pipelines and discovery tools such as Wavefront, Spunk, and Grafana. Together with the rest of the Observability Platforms, we enable Mailchimp’s understanding of business-critical processes and support the tools and features that Mailchimp’s customers use to find and fine-tune their audiences.What you'll bring

Experience writing APIs, tools, and scripts (Python, Golang, or Bash)

Experience with cloud technologies (AWS, Google Cloud)

Experience with Elasticsearch, OpenSearch, or Solr

Familiarity with other pieces of our technical stack (Kafka, PubSub, Kubernetes, Wavefront, Splunk, Prometheus)

Experience with git or other version control tools

Ability to utilize automation and orchestration tools to build large scalable systems

Experience with Splunk, Wavefront, and creating Dashboards and Visualizations

Experience with large-volume data pipelines

How you will lead

Collaborate across teams to support the organization's data pipeline priorities

Automate processes, create tools, and build features that will improve everyone's experience with our data pipeline infrastructure

Guide engineers on how they can best utilize the data streaming platform to gain confidence that their services are performing as expected

Develop, communicate, and enforce standards

Rethink and migrate the data streaming platform to AWS

Participate in an on-call schedule, and assist in mitigating issues that may arise

Troubleshoot and maintain existing infrastructure to ensure the smooth operation of data pipelines, observability tools and storage platforms

Contribute to technical documentation of our infrastructure

Track work in assigned tickets and contribute to project planning

EOE AA M/F/Vet/Disability. Intuit will consider for employment qualified applicants with criminal histories in a manner consistent with requirements of local law.

Related jobs

Job Details

  • ID
    JC51082706
  • State
  • City
  • Full-time
  • Salary
    N/A
  • Hiring Company
    Intuit
  • Date
    2024-02-18
  • Deadline
    2024-04-18
  • Category

Jocancy Online Job Portal by jobSearchi.