Big Data/ Hadoop Lead

Big Data/ Hadoop Lead

Greetings from Sligo Software Solutions, Inc.

This is Vilasini from SLIGO. We have a urgent requirement for Big Data/Hadoop Lead position with our client. Title : Big Data/Hadoop Lead Location : Albany, New York Duration : 12 Months Client : Sligo Software Solutions - Sligo Software Solutions Inc Client ID: ANM-001 Respond by: 12/31/22 4:00 PM
Greetings from Sligo Software Solutions, Inc.

SLIGO is a Software Development & IT Consulting company. We have around 100+ IT associates working with our esteemed clients across several domains such as IT, Banking, Healthcare, and Government.

We have a urgent requirement for Data Technical Lead position with our client. Role: Big Data/ Hadoop Lead with Scala and Spark Location: Albany, New York Duration: 12 Months Client Job ID#: ANM-001 Duties

• Lead data engineer and analyst to deliver data sets and analysis results as per business requirements
• Assemble large, complex data sets that meets functional/Non-Functional business requirements.
  Automating manual processes, optimizing data delivery, recommending platform greater scalability/improvements
  Collaborate with initiative leads to optimize and enhance new capabilities
• Mentor team in migrating Hadoop on-prem to cloud/AWS
• Create and maintain optimal data pipeline architecture.
• Presenting analysis results/recommendations using Powerpoint

Mandatory Requirements

• Experience (10+ Years)

Requirements

• This is an 100% Onsite
• 10+ yrs IT experience and good expertise in SDLC/Agile
• 3+ yrs Healthcare IT projects
• 5+ yrs in programing language any (Python, Java, Scala, Spark)
• Hands on experience in writing advanced SQL queries, familiarity with variety of database
• Experience in building and optimizing 'Big-Data' pipelines, architecture, and data sets
• Tools: - Big-Data, Spark, Python, Scala
• Cloud platform: - AWS S3, Snowflake
• Experience in Hadoop file formats like ORC, Avro, Parquet, CSV
• Hands on experience in migrating Hadoop on-prem to cloud/AWS
• Experience in analyzing data using 'Big-Data' platform, AWS and Snowflake
• Strong Analytical skills in relating multiple data sets and identify patterns
• Experience in NoSQL databases like MongoDB and Cassandra
• Visualize data sets using Power BI or Tableau

Desired skills:

• Kafka streaming and Shell scripting
• Scheduling tools like Control-M, Oozie
• NoSQL databases like MongoDB
• Implement Python flex APIs to share data insights to digital systems

Ashok Reddy Akkala Sligo Software Solutions, Inc.
NYS and NYC MBE Certified Company
Email:
Office : X 113
;/a>