Hadoop DevOps Engineer

Hadoop DevOps Engineer

16 Nov 2024
North Carolina, Charlotte, 28202 Charlotte USA

Hadoop DevOps Engineer

Vacancy expired!



Hadoop DevOps Engineer Summary:

Signature Consultants is seeking a Hadoop DevOps Engineer for an opportunity with a client in Charlotte, NC. The client needs a DevOps Engineer and Platform Admin for a large Hadoop data & analytics environment running on CDH 6.2 /CDP 7.x & RHEL 6/7 environments. The platform is shared by multiple applications and multiple development teams.

Responsibilities:




  • Install/upgrade CDH components, set up new clusters, collaborate with SA team on OS revisions, conduct capacity planning, optimize platform performance, test/troubleshoot Hadoop components, explore new big data tools & technologies

  • Collaborate with development teams to create common libraries, establish Hadoop programming standards/best practices, CI/CD automation with Ansible.


Experience Requirements:


  • Must have 3+ yrs Cloudera, 7+ yrs in data oriented solutions.

  • 3+ years in configuring/managing Hadoop components (Sqoop, Impala, Spark, Hive, HDFS, Oozie, HUE, HBase, Kafka, Nifi).

  • Programming experience in Java and strong Linux Shell scripting and automation skills.

  • Ability to work independently, and on multiple deliverables at the same time with aggressive deadlines.

  • Solid understanding of Linux OS, networking, security using Kerberos/Active Directory/SSL/PowerBroker, space management to run Hadoop on bare metal servers.

  • Familiarity with Python notebooks, Cloud computing, Kubernetes/Docker containers, Object Storage, mysql administration for metadata, software development using continuous integration and deployment are desirable.

  • Experienced in Agile methods & Jira storyboarding.

  • Familiarity with DW, ETL & BI technologies.

  • Critical/Niche Skills: Must have 3+ yrs Cloudera, 7+ yrs in data oriented solutions. 3+ years in configuring/managing Hadoop components (Sqoop, Impala, Spark, Hive, HDFS, Oozie, HUE, HBase, Kafka, Nifi)


About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.

Related jobs

Job Details

Jocancy Online Job Portal by jobSearchi.