Pyspark Developer

Pyspark Developer

17 Sep 2024
New York, New york city, 10001 New york city USA

Pyspark Developer

Vacancy expired!

Hi,
we are looking for Pyspark Developer with ETL hands on please find job details below,
This have 2 open roels and Full time - Please note ; remote only till Dec 2022 and later at New York, NC
or Jacksonvilla FL.

ETL PySpark role

FTE
  • Preparing HLD and LLD document with ETL methodology transformation rules for data pipelines.
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Knowledge on Sqoop and Impala
  • Involves in build and unit test of data pipeline ETL's.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same
  • SIT and UAT support.
  • Conduct code reviews and provide improvement guidelines
  • Extensive experience on Spark, PySpark and Hive SQL Scripts.
  • Coding and development, unit test the ETL code changed/developed.
  • Provide support and bug fixes during trial validation runs and UAT.
  • Performs ETL code packaging, sequencing and validations of same.

Related jobs

  • UI Developer

    , New york city,

    UI Developer

  • Software Developer

  • Anaplan Solution Architect/Lead Developer

  • Job duties: Integrate applications by designing database architecture and server scripting. Develop and implement connectivity with network systems, search engines, and information servers. Design and develop high-volume, low-latency applications for mission-critical systems to deliver high-availability and performance. Complete application development by coordinating requirements, schedules, and activities. Troubleshoot development and production problems across multiple environments and operating platforms. Ownership and development of software components and modules in line with the product needs.Job requirements: Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related, and two (2) years of software development experience. Must have one (1) year of experience in each of the following: Linux or Unix; C, C, C#, Java, JavaScript, Python, or another high-level programming language; and SQL or NoSQL.

  • Job Duties: Responsible for planning and executing small and mid-size software development projects by working through the project life cycle such as requirements elicitation, risk assessment, development through operations, and maintenance. Responsible for training and coaching staff members. Contribute to projects outside of regular scope, including technical reviews, influencing design and making recommendations for improvement. Develop requirements for software with Bloomberg and assign implementation to junior developers. Own and ensure quality of projects. Organize test production rollout. Analyze client requirements. Prepare project deliverables and participate in preparing technical proposals. Perform system design and application development. Escalate and resolve any issues on projects. Hands-on software development including selecting and implementing efficient algorithms, writing clear, well-documented code, conducting code reviews, ensuring adequate testing of all code, and debugging using various tools.Job Requirements: Position requires a Master\'s degree or foreign equivalent in Computer Science, Engineering, or related, and one (1) year of software development experience. Alternatively, employer will accept a Bachelor\'s degree or foreign equivalent in Computer Science, Engineering, or related, followed by five (5) years of progressively responsible software development experience.Must have one (1) year of experience in each of the following: Linux or Unix; C, C, C#, Java, JavaScript, Python, or another high-level programming language; SQL or NoSQL; and, Data structures, algorithms, and object-oriented design concepts.Any suitable combination of education, training or experience is acceptable.

  • Job duties: Integrate applications by designing database architecture and server scripting. Develop and implement connectivity with network systems, search engines, and information servers. Design and develop high-volume, low-latency applications for mission-critical systems to deliver high-availability and performance. Complete application development by coordinating requirements, schedules, and activities. Troubleshoot development and production problems across multiple environments and operating platforms. Ownership and development of software components and modules in line with the product needs.Job requirements: Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related, and two (2) years of software development experience. Must have one (1) year of experience in each of the following: Linux or Unix; C, C, C#, Java, JavaScript, Python, or another high-level programming language; and SQL or NoSQL.

  • Job duties: Integrate applications by designing database architecture and server scripting. Develop and implement connectivity with network systems, search engines, and information servers. Design and develop high-volume, low-latency applications for mission-critical systems to deliver high-availability and performance. Complete application development by coordinating requirements, schedules, and activities. Troubleshoot development and production problems across multiple environments and operating platforms. Ownership and development of software components and modules in line with the product needs.Job requirements: Position requires a Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related, and two (2) years of software development experience. Must have one (1) year of experience in each of the following: Linux or Unix; C, C, C#, Java, JavaScript, Python, or another high-level programming language; and SQL or NoSQL.

Job Details

  • ID
    JC45767889
  • State
  • City
  • Job type
    Permanent
  • Salary
    Depends on Experience
  • Hiring Company
    Acumenz Consulting
  • Date
    2022-09-14
  • Deadline
    2022-11-12
  • Category

Jocancy Online Job Portal by jobSearchi.