Big Data Engineer

Big Data Engineer

Vacancy expired!

KEY Skills –
Need strong resource who has hands on 10-12+ years of experience in Big Data/ Hadoop/ Pyspark.
VERY STRONG WITH PYSPARK
VERY STRONG WITH HADOOP
VERY STRONG WITH BIG DATA
Strong HIVE
AIRFLOW
CLOUD PALTFORM -AZURE
AZURE DATA BRICKS OR DATA BRICKS ON AWS
EMR
Dockers
JSON
Strong SQL to develop products, tools and software features.
Experience developing with SQL (Oracle, SQL Server)
Exposure to NoSQL (Mongo, Cassandra)
Apache NiFi
Understanding of Agile Principles (Scrum)
Experience developing with Python
Exposure to VCS (Git, SVN)

Responsibilities:
Take ownership of features and drive them to completion through all phases of SDLC. This includes external facing and internal applications as well as process improvement activities such as:

• Participate in design of Big Data platforms and SQL based solutions
• Perform development of Big Data platforms and SQL based solutions
• Perform unit and integration testing
• Partner with senior resources, gaining insights
• Participate in retrospective reviews
• Participate in the estimation process for new work and release