Big Data Developer - Spark

Big Data Developer - Spark

16 Apr 2024
Michigan, Livonia, 48150 Livonia USA

Big Data Developer - Spark

Vacancy expired!

Genoa Employment Solutions has an immediate need for a Big Data Developer.
We are seeking a Spark Scala developer who possesses key skills in Spark, Kafka, big data platform tools, i.e. Cloudera/Horton Works/Databricks.
Responsibilities:
Design and development of data ingestion pipelines.
Perform data migration and conversion activities.
Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures.
Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments).
Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform.
Required:
SCALA
SQL
Spark/Spark Streaming
Big Data Tool Set
Linux
Python
Requirements:
Must have a bachelor’s degree in Computer Science or related IT discipline.
Must have at least 8 years of IT development experience.
Must have knowledge of 3 years of SCALA/Python – Spark programming.
Must have relevant professional experience working with big data toolsets.
Knowledge of standard software development methodologies such as Agile and Waterfall
Strong communication skills.
Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary.
Document and maintain project artifacts.
Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
Other duties as assigned.
At Genoa Employment Solutions, we have been an active and participating member of the American Staffing Association since 2005. As a privately held organization and a certified member of the SFMSDC (South Florida Minority Supplier Diversity Council), we are dedicated to the pursuit of helping organizations diversify their professional personnel.

Job Details

  • ID
    JC12298984
  • State
  • City
  • Job type
    Contract
  • Salary
    $40 - $60
  • Hiring Company
    FlexIT Global
  • Date
    2021-04-12
  • Deadline
    2021-06-11
  • Category

Jocancy Online Job Portal by jobSearchi.