DescriptionWant to change the world with Big Data and Analytics? Come join us on the Amazon EMR team in Amazon Web Services!Amazon EMR is a web service which enables customers to run massive clusters with open-source data processing frameworks like Apache Spark, Hive, Presto, Hadoop, HBase and more, with the ability to effortlessly scale up and down as needed. We run a large number of customer clusters, enabling a variety of customer use cases including analytics and web-scale machine learning. The AWS DBS EMR organization is doing innovative work on these open source data processing frameworks with the goal of making EMR the best place to run big data workloads. A critical part of this goal is delivering top speed for EMR's big data frameworks.The AWS EMR Developer & Productivity team is looking for exceptional engineers to help in our mission to provide the world’s fastest cloud Big Data processing platform. As part of our team, you will build and improve benchmarking frameworks that underpin AWS Analytics optimization efforts. Your features will automatically schedule, analyze, and evaluate the differences between experimental, regression, and production workloads and respective baselines. The features should automatically detect and correlate performance anomalies using team-developed ML models and will enable engineers to visually deep-dive their optimizations’ impacts. The features should also be highly-extensible. The features should support all of AWS Analytics’ engines (with a focus on Spark, Iceberg and Trino) and will enable further enhancements to be rapidly delivered by engineers across AWS Analytics.Successful candidates will exhibit outstanding software development skills and demonstrate an understanding of distributed systems and parallel data processing. You should not only have a strong record of delivery but also excel at leadership and customer obsession and have a real passion for massive-scale computing. By joining our team, you will get to collaborate with some of the best and brightest minds in the industry and work on cutting-edge software and systems. You'll enjoy a competitive salary, great benefits, a creative and agile work environment, and the exciting opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies - but most of all, you will get the satisfaction of making products that millions use everyday to great effect!To learn more about EMR:
AWS EMR: https://aws.amazon.com/emr/
AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/
Key job responsibilities
Designing and building the next-generation technologies ensuring that EMR is the best environment for running large-scale data processing workloads.
Working on complex problems in distributed systems and query engines.
Translation of complex functional and technical requirements into detailed architecture and design.
Deliver systems and features with top-notch quality, on time.
Own the end-to-end Software Development Life Cycle (SDLC).
A day in the lifeYour role requires deep technical expertise, leadership acumen, a passion for software, data, and infrastructure solutions, excellent organizational and communication skills, and the ability to deliver results in a dynamic environment. You must be adept at managing complex software products, translating business cases into technical requirements, and creating reliable, scalable solutions.You'll engage in diverse technical activities, coding in Java and other popular programming languages, or exploring innovative technologies in big data. Your expertise in building stable and scalable software and data solutions, along with your experience in databases and designing parallel systems, will be invaluable.We are open to hiring candidates to work out of one of the following locations:Redmond, WA, USABasic Qualifications
3+ years of non-internship professional software development experience
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Master's degree in computer science or equivalent
Experience designing and building data science pipelines and/or applying machine learning models
Experience designing and building highly-scaled distributed systems and web services
Thorough understanding of parallel algorithms, concurrency, asynchronous architectures
Experience working in an agile software development organization
Experience building with SOA using Java on Linux
Proficiency in high-performance, multi-threaded programming
Experience with distributed systems architecture
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $115,000/year in our lowest geographic market up to $223,600/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
