Vacancy expired!
Hadoop Engineer with DevOps
As a platform admin & DevOps Engineer, you will be responsible for the installing/upgrading CDH components, setting up new clusters, collaborating with SA team on OS revisions, conducting capacity planning, optimizing platform performance, testing/troubleshooting Hadoop components, and exploring new big data tools & technologies. This person should have around 5-7 years of experience.
Qualifications:
DevOps Engineer and Platform Admin for a large Hadoop data & analytics environment running on CDH 6.2 /CDP 7.x & RHEL 6/7 environments. The platform is shared by multiple applications and multiple development teams. As a platform admin & DevOps engineer - install/upgrade CDH components, set up new clusters, collaborate with SA team on OS revisions, conduct capacity planning, optimize platform performance, test/troubleshoot Hadoop components, explore new big data tools & technologies; collaborate with development teams to create common libraries, establish Hadoop programming standards/best practices, CI/CD automation with Ansible.
Required Skills:
Must have 3+ yrs Cloudera, 7+ yrs in data oriented solutions. 3+ years in configuring/managing Hadoop components (Sqoop, Impala, Spark, Hive, HDFS, Oozie, HUE, HBase, Kafka, Nifi). Programming experience in Java and strong Linux Shell scripting and automation skills.
Ability to work independently, and on multiple deliverables at the same time with aggressive deadlines.
Solid understanding of Linux OS, networking, security using Kerberos/Active Directory/SSL/PowerBroker, space management to run Hadoop on bare metal servers.
Familiarity with Python notebooks, Cloud computing, Kubernetes/Docker containers, Object Storage, mysql administration for metadata, software development using continuous integration and deployment are desirable.
Experienced in Agile methods & Jira storyboarding. Familiarity with DW, ETL & BI technologies.
Critical/Niche Skills:
Must have 3+ yrs Cloudera
7+ yrs in data oriented solutions
3+ years in configuring/managing Hadoop components (Sqoop, Impala, Spark, Hive, HDFS, Oozie, HUE, HBase, Kafka, Nifi
Experience level: 7 Years
Hadoop, ansible, scripting and automation
