Big Data/ Hadoop Lead

Big Data/ Hadoop Lead

31 Dec 2025
New York, Albany, 12243 Albany USA

Big Data/ Hadoop Lead

Vacancy expired!

Greetings from Sligo Software Solutions, Inc.

This is Vilasini from SLIGO. We have a urgent requirement for Big Data/Hadoop Lead position with our client. Title : Big Data/Hadoop Lead Location : Albany, New York Duration : 12 Months Client : Sligo Software Solutions - Sligo Software Solutions Inc Client ID: ANM-001 Respond by: 12/31/22 4:00 PM
Greetings from Sligo Software Solutions, Inc.

SLIGO is a Software Development & IT Consulting company. We have around 100+ IT associates working with our esteemed clients across several domains such as IT, Banking, Healthcare, and Government.

We have a urgent requirement for Data Technical Lead position with our client. Role: Big Data/ Hadoop Lead with Scala and Spark Location: Albany, New York Duration: 12 Months Client Job ID#: ANM-001 Duties

  • Lead data engineer and analyst to deliver data sets and analysis results as per business requirements
  • Assemble large, complex data sets that meets functional/Non-Functional business requirements.
    Automating manual processes, optimizing data delivery, recommending platform greater scalability/improvements
    Collaborate with initiative leads to optimize and enhance new capabilities
  • Mentor team in migrating Hadoop on-prem to cloud/AWS
  • Create and maintain optimal data pipeline architecture.
  • Presenting analysis results/recommendations using Powerpoint
Mandatory Requirements
  • Experience (10+ Years)
Requirements
  • This is an 100% Onsite
  • 10+ yrs IT experience and good expertise in SDLC/Agile
  • 3+ yrs Healthcare IT projects
  • 5+ yrs in programing language any (Python, Java, Scala, Spark)
  • Hands on experience in writing advanced SQL queries, familiarity with variety of database
  • Experience in building and optimizing 'Big-Data' pipelines, architecture, and data sets
  • Tools: - Big-Data, Spark, Python, Scala
  • Cloud platform: - AWS S3, Snowflake
  • Experience in Hadoop file formats like ORC, Avro, Parquet, CSV
  • Hands on experience in migrating Hadoop on-prem to cloud/AWS
  • Experience in analyzing data using 'Big-Data' platform, AWS and Snowflake
  • Strong Analytical skills in relating multiple data sets and identify patterns
  • Experience in NoSQL databases like MongoDB and Cassandra
  • Visualize data sets using Power BI or Tableau
Desired skills:
  • Kafka streaming and Shell scripting
  • Scheduling tools like Control-M, Oozie
  • NoSQL databases like MongoDB
  • Implement Python flex APIs to share data insights to digital systems
Ashok Reddy Akkala Sligo Software Solutions, Inc.
NYS and NYC MBE Certified Company
Email:
Office : X 113
;/a>

Related jobs

Job Details

  • ID
    JC48236729
  • State
  • City
  • Job type
    Contract
  • Salary
    USD 80/hour 80/hour
  • Hiring Company
    Sligo Software Solutions Inc.,
  • Date
    2022-12-31
  • Deadline
    2023-03-01
  • Category

Jocancy Online Job Portal by jobSearchi.