Role: Hadoop Admin Location: San Ramon CA (Remote till Covid-19) Duration: 9+ Months Tax Term: W2 Required skills:
8 years’ experience in Big Data Hadoop administration and configuration.
Responsible for implementation and ongoing administration of Hadoop infrastructure. Horton Works (HDP) Stack is a must.
Experience in Apache Atlas, Apache Ranger, Apache Kafka, Kerberso, HA cluster setup is a must
Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users.
Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios, Cloudera Manager Enterprise/Horton Works Ambari, Dell Open Manage and other tools.
Screen Hadoop cluster job performances and capacity planning
Monitor Hadoop cluster connectivity and security
Manage and review Hadoop log files.
File system management and monitoring.
HDFS support and maintenance.
Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability.
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
Enabling prodOps teams for data pipeline maintenance
Experience with streaming technologies such as Spark streaming.
Experience with various messaging systems, such as Kafka
Experience with Apache Airflow
Experience in implementing Real Time Streaming Architecture
Experience with Data Lab concept with Zeppelin, Jupyterhub
Experience in Docker, Kubernetes is a plus.
Experience with Grafana, Prometheus is a plus.
Experience with scripting tools like Python, Ansible , Java is a plus
CI/CD automation using Gitlab
Thanks Praveen Kumar Apolis
222 N Sepulveda Blvd., Suite 2250 | El Segundo, CA 90245 Email: praveen.kumar[at]apolisrises[dot]com | Website: www.apolisrises.com
About Apolis: Apolis. is an ERP and IT consulting services provider focused on providing innovative and successful business solutions. We are capable of working across all technology platforms, operating systems and infrastructures. Apolis has experience in performing implementations, technical and functional upgrades, optimization projects, and full-service staffing. Apolis is an Equal Opportunity Employer and s & all those who are authorized to work in the US are encouraged to apply. Want to know more about Apolis: Click here to visit our website or click on following link ( )
Connect with Apolis through Social Media: Learn more about our company including latest events at Apolis, new job opportunities, job seeker tips and more. Follow us on LinkedIn, Facebook etc.