Senior Software / Data Engineer

Senior Software / Data Engineer

04 Mar 2024
New York, New york city, 10036 New york city USA

Senior Software / Data Engineer

Vacancy expired!

Must have experience with OOP Python.

Must have experience building data pipelines Terms: Contract to hireLocation: Remote is okayRole Details: In this role you will be collaborating with architects & senior engineers of the team to build and evolve our current data / ML pipelines, delivery of services and cloud infrastructure.

What you will do:
  • Work with senior engineers to develop & enhance data pipelines, tools & services.
  • Develop software in Python / Java that is modular, scalable, stable and optimized code using TDD methodologies.
  • Work with state-of-the-art tools and frameworks to build scalable and efficient solutions for data management, processing and dataset building.
  • Perform data processing steps like cleaning, reduction, normalization, transformation, feature extraction and analysis.
  • Participate in design and code reviews with other engineers, giving and taking feedback.
  • Support existing services and data pipeline, triage defects and perform root cause analysis with various members of the team.
  • Apply DevOps skills to create essential plumbing in the AWS cloud such as CI/CD for software applications and the compute infrastructure needed to develop ML models.
  • Work with technical and non-technical staff to translate functional requirements into technical requirements for execution.
Qualifications:
  • 2-5 years of experience and a bachelor’s degree in CS or related fields
  • Strong object-oriented software development skills (e.g., Python, Java, Python preferred).
  • Knowledge of relational databases, big data concepts and distributed computing frameworks (e.g. Spark, Hadoop, SQL etc.).
  • Experience building efficient, large-scale data collection, storage and processing pipelines.
  • DevOps skills with public clouds (AWS, Azure, or Google Cloud Platform; AWS preferred).
  • Good communication skills.
Bonus Qualifications:
  • Interest & knowledge in Machine Learning, understanding of supervised, unsupervised & deep learning techniques.
  • Experience with machine learning frameworks (e.g. scikit-learn, TensorFlow, PyTorch).
  • Experience with Django or other web frameworks.
  • Cloud certifications.

Related jobs

  • Senior Software Engineer - Real-time Data Distribution

  • Senior C# Azure Software EngineerNew York, NY,

  • Overview

  • Overview

  • Description

  • 114 5th Ave (22114), United States of America, New York, New York

  • \"Job Title:Senior Software Engineer-1 Overview:Overview Responsible for the analysis, design, development and delivery of software solutions Defines requirements for new applications and customizations, adhering to standards, processes and best practicesResponsibilities Participate in team prioritization discussions with Product/Business stakeholders Estimate and own delivery tasks (design, dev, test, deployment, configuration, documentation) to meet the business requirements Automate build, operate, and run aspects of software Drive code/design/process trade-off discussions within their team when required Report status and manage risks within their primary application/service Drive integration of services focusing on customer journey and experience Perform demos/acceptance discussions in interacting with Product owners Understands operational and engineering experience, actively works to improve experience and metrics in ownership area Develop complete understanding of end-to-end technical architecture and dependency systems Drive adoption of technology standards and opinionated frameworks, and review coding, test, and automation work of team members Mentor and guide new and less-experienced team members Identify opportunities to improve an overall process and trim waste Share and seek knowledge within their Guild/Program to drive reuse of patterns/libraries/practices and enhance productivityExperiences Has ability to write secure code in three or more languages (e.g., C, C+, C#, Java, JavaScript) and familiar with secure coding standards (e.g., OWASP, CWE, SEI CERT) and vulnerability management Understands the basic engineering principles used in building and running mission critical software capabilities (security, customer experience, testing, operability, simplification, service-oriented architecture) Understands internals of operating systems (Windows, Linux) to write interoperable and performant code Able to perform debugging and troubleshooting to analyze core, heap, thread dumps and remove coding errors Understands and implements standard branching (e.g., Gitflow) and peer review practices Has skills in test driven and behavior driven development (TDD and BDD) to build just enough code and collaborate on the desired functionality Understands use cases for advanced design patterns (e.g., service-to-worker, MVC, API gateway, intercepting filter, dependency injection, lazy loading, all from the gang of four) to implement efficient code Understands and implements Application Programming Interface (API) standards and cataloging to drive API/service adoption and commercialization Has skills to author test code with lots of smaller tests followed by few contract tests at service level and fewer journey tests at the integration level (Test Pyramid concept) Apply tools (e.g., Sonar, Zally, Checkmarx ) and techniques to scan and measure code quality and anti-patterns as part of development activity Has skills to collaborate with team and business stakeholders to estimate requirements (e.g., story pointing) and prioritize based on business value Has skills to elaborate and estimate non-functional requirements, including security (e.g., data protection, authentication, authorization), regulatory, and performance (SLAs, throughput, transactions per second) Has skills to orchestrate release workflows and pipelines, and apply standardized pipelines via APIs to achieve CI and CD using industry standard tools (e.g., Jenkins, AWS/Azure pipelines, XL Release, others). Has skills to understand, report, and optimize delivery metrics to continuously improve upon them (e.g., velocity, throughput, lead time, defect leakage, burndown) Has skills to document and drive definition-of-done for requirements to meet both business and operational needs Understands how to build robust tests to minimize defect leakage by performing regression, performance, deployment verification, and release testing Has skills to conduct product demos and co-ordinate with product owners to drive product acceptance signoffs Has skills to Understands customer journeys and ensure a Mastercard good experience by continuously reducing Mean time to mitigate (MTTM) for incidents and ensuring high availability (99.95% as a starting point)PDN-9b62bc7d-63d9-4f24-8744-df8deb4e0168\"

Job Details

  • ID
    JC10593161
  • State
  • City
  • Job type
    Contract
  • Salary
    Depends on Experience
  • Hiring Company
    The Execu|Search Group
  • Date
    2021-03-02
  • Deadline
    2021-05-01
  • Category

Jocancy Online Job Portal by jobSearchi.