Hadoop Admin

Hadoop Admin

23 Jan 2024
California, Sanramon, 94582 Sanramon USA

Hadoop Admin

Vacancy expired!

Role: Hadoop Admin

Location: San Ramon CA (Remote till Covid-19)

Duration: 9+ Months

Tax Term: W2

Required skills:
  • 8 years’ experience in Big Data Hadoop administration and configuration.
  • Responsible for implementation and ongoing administration of Hadoop infrastructure. Horton Works (HDP) Stack is a must.
  • Experience in Apache Atlas, Apache Ranger, Apache Kafka, Kerberso, HA cluster setup is a must
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
  • Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
  • Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise/Horton Works Ambari, Dell Open Manage and other tools.
  • Performance tuning of Hadoop clusters & MR, Apache Spark HBase, Druid
  • Screen Hadoop cluster job performances and capacity planning
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files.
  • File system management and monitoring.
  • HDFS support and maintenance.
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
  • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
  • Enabling prodOps teams for data pipeline maintenance
  • Experience with streaming technologies such as Spark streaming.
  • Experience with various messaging systems, such as Kafka
  • Experience with Apache Airflow
  • Experience in implementing Real Time Streaming Architecture
  • Experience with Data Lab concept with Zeppelin, Jupyterhub
  • Experience in Docker, Kubernetes is a plus.
  • Experience with Grafana, Prometheus is a plus.
  • Experience with scripting tools like Python, Ansible , Java is a plus
  • CI/CD automation using Gitlab

Thanks
Praveen Kumar
Apolis

222 N Sepulveda Blvd., Suite 2250 | El Segundo, CA 90245
Email: praveen.kumar[at]apolisrises[dot]com | Website: www.apolisrises.com

About Apolis: Apolis. is an ERP and IT consulting services provider focused on providing innovative and successful business solutions. We are capable of working across all technology platforms, operating systems and infrastructures. Apolis has experience in performing implementations, technical and functional upgrades, optimization projects, and full-service staffing.
Apolis is an Equal Opportunity Employer and s & all those who are authorized to work in the US are encouraged to apply.
Want to know more about Apolis: Click here to visit our website or click on following link ( )


Connect with Apolis through Social Media: Learn more about our company including latest events at Apolis, new job opportunities, job seeker tips and more. Follow us on LinkedIn, Facebook etc.

Job Details

  • ID
    JC8497327
  • State
  • City
  • Job type
    Contract
  • Salary
    Depends on Experience
  • Hiring Company
    Apolis
  • Date
    2021-01-22
  • Deadline
    2021-03-23
  • Category

Jocancy Online Job Portal by jobSearchi.