Lead Data Analyst-Hadoop AND Core Java

Lead Data Analyst-Hadoop AND Core Java

25 Sep 2024
Illinois, Naperville, 60540 Naperville USA

Lead Data Analyst-Hadoop AND Core Java

Vacancy expired!

Title : Data Analytics Lead with Hadoop and Azure

Location : NAPERVILLE, IL

Duration : 12 Months

Sharing JD –

Essential Job Functions:
  • Design and development of data ingestion pipeline.
  • Perform Data Blending and Data harmonization.
  • Perform data migration and conversion activities.
  • Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
  • Apply knowledge and experience to develop, test, and document enhancements or extension to the Palantir (Lava) Datalake as needed.
  • Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
  • Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
  • Develop and execute test scripts independently or in concert with testing personnel.

Required Tools/Languages:


Must Have
  • PySpark
  • Hadoop
  • Core Java
  • Strong SQL
  • Unix / Linux Shell Scripting

Nice to Have
  • Azure Databricks, ADF
  • NoSQL databases (Mongo, Couchbase, Cassandra)
  • JavaScript UI frameworks (Angular, NodeJS, Bootstrap)
  • Jenkins

Minimum Qualifications and Job Requirements:
  • Must have a Bachelor’s degree in Computer Science or related IT discipline
  • Must have at least 5+ years of IT development experience ( for Lead Role)
  • Must have 3-5 years relevant professional experience working in PySpark, Big Data/ Hadoop Python or equivalent scripting language ( Lead Role)
  • Must have strong, hands-on J2EE development
  • Must have experience with ETL tools
  • Familiar with Agile and Scrum.
  • Strong communication skills.

Related jobs

  • Description:

  • We inspire purpose-filled living that brings joy to the modern home. With a team of more than 8,000 associates spanning 130 store and distribution locations across the U.S. and Canada, we achieve together, drive results and innovate to inspire. Drawn together by a shared passion for our customers and a spirit of fun, we deliver high-quality home furnishings that are expertly designed, responsibly sourced and bring beauty and function to people’s homes. From the day we opened our first store in Chicago in 1962 to the digital innovations that engage millions of customers today, our iconic brand is nearly 60 years in the making—and our story is still unfolding.

  • Sanitation Lead – $20.10 per hour

  • Position Overview

  • Taking care of people is at the heart of everything we do, and we start by taking care of you, our valued colleague. A career at Sedgwick means experiencing our culture of caring. It means having flexibility and time for all the things that are important to you. It’s an opportunity to do something meaningful, each and every day. It’s having support for your mental, physical, financial and professional needs. It means sharpening your skills and growing your career. And it means working in an environment that celebrates diversity and is fair and inclusive.

Job Details

  • ID
    JC20222992
  • State
  • City
  • Job type
    Contract
  • Salary
    Depends on Experience
  • Hiring Company
    Cygnus Professionals
  • Date
    2021-09-24
  • Deadline
    2021-11-22
  • Category

Jocancy Online Job Portal by jobSearchi.