First and foremost, I hope you and your loved ones are safe and doing okay during these difficult times.During thess unprecedented times of uncertainty with respect to the COVID-19 situation, we at Collabera, inform you that many of our clients are still hiring and wanted to reach out to explore potential job opportunity. I am here to help you in this hard time and request you to look at the below job description which we have for one of my Top-notch Retail company for a position of a Pyspark Developer . Position Details: Industry: Retail company Work Location: Initially Remote (Cincinnati, OH) Job Title: Pyspark Developer Duration: 06-12 months (extensions based on performance)
Manager’s Note:
The Developer is responsible for leading the design, development, testing, debugging, maintaining and documenting software components in accordance to Software Development Life Cycle (SDLC) best practices.
The Developer has overall responsibility in the technical design process.
Leads and participates in the application technical design process and completes estimates and work plans for design, development, implementation, and rollout tasks.
The Developer also communicates with the appropriate teams to ensure that assignments are delivered with the highest of quality and in accordance to standards.
The Developer strives to continuously improve the software delivery processes and practices.
6+ years experience in systems analysis, design or programming and the associated development methodologies.
Requirements:
BS or MS in Computer Science or equivalent work experience
In-depth knowledge of Python
In-depth knowledge of Spark
In-depth knowledge of Big Data, data engineering, databases, data wrangling, relational databases
Exposure to Azure
Exposure to Data Science principles
Exposure to REST and scalable APIs
Exposure to Flask or another python web framework
Exposure to server-side development in Python
Exposure to systems design and architecture
Experience estimating, developing, releasing, and supporting backend code in production environments
Excellent judgment, problem solving, critical thinking, and communication skills
Ability to operate semi-independently
Responsibilities:
Identify and uphold data engineering best practices
Operate independently or with limited supervision on projects or initiatives to build and enhance our data assets and processes
Work with Engineers and Data Scientists within and beyond their scrum team
Make recommendations, suggestions, provide code review and support to other team members on work you may not be directly involved in
Monitor performance of production processes, pro-actively deal with any problems.