Vacancy expired!
To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.Job CategoryProducts and TechnologyJob DetailsSlack is looking for a senior engineer to join our Data Engineering organization. You will build scalable services and tools to help partners implement, deploy and analyze data assets with a high level of autonomy and limited friction. You will play a meaningful role in making partner interactions with the Data Warehouse pleasant and productive (Data Science, Business Intelligence, Application Engineering, Machine Learning and IT).At Data Ingestion, we build and operate the platform that ingests data into our Data Warehouse. We write software to manage data ingestion for thousands of stateful hosts and stateless real time logging events. Currently, our infrastructure handles 65PB+ of storage, processes 900B records a day, 400+ ETL pipelines and 900+ Active Airflow DAGs. As Slack’s data grows (along with the number of customers, features and employees), the goal of the Data Ingestion team is to build a highly scalable and resilient ingestion platform to acquire high quality data efficiently and provide easy to use workflow and orchestration capabilities for our users to manage the data lifecycle.As a member of Data Ingestion, you will develop and maintain our ingestion pipelines, help to design and build abstractions that hide the complexity of the underlying Big Data stack and allow partners to focus on their strengths: data modeling, data analysis, search or machine learning. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack!We recommend reading some of our blog posts that shed light into what we do here at Slack:Data Lineage at Slack (https://slack.engineering/data-lineage-at-slack/)
Reliably Upgrading Apache Airflow at Slack's Scale
Introducing Data Residency for Slack (https://slackhq.com/introducing-data-residency-for-slack)
Data Wangling At Slack
What you will be doingDesign and develop highly scalable and resilient services/pipelines for data ingestion and processing
Optimize the end-to-end workflow for data users at Slack (from crafting libraries to schedule data pipelines and access data assets).
Provide transparency into our data flows (comprehensive view of sources, transformations, sinks and data lineage).
Automate and handle the lifecycle of data sets (schema evolution, metadata management, change and backfill management, deprecation and migration).
Streamline the creation of new data sets with accessible frameworks and Domain Specific Languages (DSL).
Improve the data quality and reliability of the pipelines (monitoring and failure detection).
Comfortably collaborate with cross functional partners and lead technical initiatives end to end.
Be a role model and a multiplier, coaching and mentoring junior and intermediate engineers.
Write, review, or provide feedback on a technical design proposal from others.
What you should have5+ years of software/data engineering experience, including experience with Big Data technologies, e.g. Spark, Kafka, Hive, Airflow, Presto, EMR, S3, etc.
You have extensive experience of building and maintaining large scale data pipelines and in-depth knowledge of various big data frameworks and architectures
You are skilled at crafting and building robust distributed microservices with tools like Docker, Kubernetes, AWS ECS/EKS etc.
You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests.
You are proficient in object-oriented and/or functional programming languages: Python, Java/Scala, Go
You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders
You have high growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them
Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience.
Slack has a positive, diverse, and supportive culture—we look for people who are curious, inventive, and work to be a little better every single day. In our work together we seek to be smart, humble, hardworking and, above all, collaborative.Slack is registered as an employer in many, but not all, states. If you are not located in or able to work from a state where Slack is registered, you will not be eligible for employment.Visa sponsorship may not be available in certain remote locations.Visa sponsorship is not available for candidates living outside the country of this position.Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.For Colorado-based roles: Minimum annual salary of $142,000. You may also be offered a bonus, restricted stock units, and benefits. More details about our company benefits can be found at the following link: https://www.getsalesforcebenefits.com/At Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.Salesforce.com and Salesforce.org are Equal Employment Opportunity and Affirmative Action Employers. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce.com and Salesforce.org will not pay any third-party agency or company that does not have a signed agreement with Salesforce.com or Salesforce.org.AccommodationsIf you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form (https://careers.mail.salesforce.com/accommodations-request-form) .Posting StatementAt Salesforce we believe that the business of business is to improve the state of our world. Each of us has a responsibility to drive Equality in our communities and workplaces. We are committed to creating a workforce that reflects society through inclusive programs and initiatives such as equal pay, employee resource groups, inclusive benefits, and more. Learn more about Equality at Salesforce and explore our benefits.Salesforce.com and Salesforce.org are Equal Employment Opportunity and Affirmative Action Employers. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Salesforce.com and Salesforce.org do not accept unsolicited headhunter and agency resumes. Salesforce.com and Salesforce.org will not pay any third-party agency or company that does not have a signed agreement with Salesforce.com (http://salesfore.com/) or Salesforce.org .Salesforce welcomes all.Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.As a federal contractor, Salesforce is required to verify that all US-based employees are fully vaccinated against COVID-19. If you receive an offer and are unable to get vaccinated for religious or medical reasons, you may request a reasonable accommodation.Founded in 1999, Salesforce is the global leader in Customer Relationship Management (CRM). Companies of every size and industry are using Salesforce to transform their businesses, across sales, service, marketing, commerce, and more by connecting with customers in a whole new way. We harness technologies that can revolutionize companies, careers, and, hopefully, our world.Salesforce is built on a set of four core values: Trust, Customer Success, Innovation, and Equality. By making technology more accessible, we're helping create a future with greater opportunity and equality for all. This has taken our company to great heights, including being ranked by Fortune as one of the “Most Admired Companies in the World” and one of the “100 Best Companies to Work For” eleven years in a row, and named “Innovator of the Decade” and one of the “World’s Most Innovative Companies” eight years in a row by Forbes.There are those who choose to work with the best and brightest. And then, there are those who want to do more than just a job. They are the ones improving lives, not only their careers. Having an impact now instead of later. Doing something that’s so much bigger than themselves, an industry, and their company.We believe everyone can be a Trailblazer. Join Salesforce and discover a future of new opportunities.
