Big Data Software Engineer

Big Data Software Engineer

19 Sep 2024
New York, New york city, 10001 New york city USA

Big Data Software Engineer

Vacancy expired!

Job Description
One of the largest hedge funds and private equity administrator globally is looking forward to adding a Big Data Software Engineer to their team for a full-time and fully remote role. They provide investment, financial services, and software for their different clients all around the world.

As a Big Data Software Engineer, you will be working with multiple functional and technical teams to scope and implement a micro service work for data pipelining, design, implement, create, and build for their platform. The ideal engineer will be proficient in Python, Kafka, Spark, Docker, and experience working with cloud environments.
Required Skills & Experience

  • Bachelor's Degree in Computer Science or Computer Engineering.
  • Experience working with Python.
  • Cassandra is preferred but experience working with either MongoDB, Redis, PostgreSQL, Hadoop, Minio or S3 is also valid.
  • Proficiency in Kafka, Spark, Citus.
  • Solid understanding of cloud computing design and development principles.
  • Proficient in cloud development methods such as Docker, RESTful APIs, terraform, GIT, CI/CD.
  • Familiar with microservices architectures and building a decoupled system.
Desired Skills & Experience
  • Previous experience with financial institutions IT or similar.
  • Experience developing financial applications is a plus.
  • Experience in deploying multi-node, scalable, web applications.
  • UI hands-on experience (JavaScript or python web framework).
The Offer
  • Bonus

    OR Commission eligible

You will receive the following benefits:
  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k) {including match- if applicable}

The Motion Recruitment network provides IT Staffing Solutions (Contract, Contract-to-Hire, and Direct Hire) in major North American markets. Our unique expertise in today's highest demand tech skill sets, paired with our deep networks and knowledge of our local technology markets, results in an exemplary track record with candidates and clients.

#LI-CG2

Related jobs

  • Overview

  • Description

  • Description We are hiring a Master Data Management Engineer who will work with teams in a fast-paced technology organization. As a Master Data Manatement Engineer, you will support the analytic, technical and operational aspects of enterprise data management and governance. You will support data analysis and mining activities and act as a liaison to Information Technology teams, as well as providing ongoing support for data initiatives through master data management, data quality, data lineage, and cataloging.

  • Summary:

  • Duties: Works with a small group of four to six engineers, including offshore associates, for assigned Engineering projects by proving pertinent documents, direction, and examples; identifying short- and long-term solutions and timeline; reviewing and providing feedback for proposed solutions; and performing design and code reviews of changes. Troubleshoots business and production issues by gathering information (for example, issue, impact, criticality, possible root cause); engaging support teams to assist in the resolution of issues; formulating an action plan; performing actions as designated in the plan; interpreting the results to determine further action; performs root cause analysis to prevent future occurrence of issues; and completing online documentation. Provides support to the business by responding to user’s questions, concerns, and issues (for example, technical feasibility, implementation strategies); and facilitating resolutions. Participates in the discovery phase of medium to large projects by reviewing project requirements; translating requirements into technical solutions; gathering requested information (for example, design documents, product requirements, wire frames); writing and developing code; conducting unit testing; communicating status and issues to team members and stakeholders; collaborating with project team and cross-functional teams; troubleshooting open issues and bug-fixes; ensuring on-time delivery and hand-offs; and interacting with project manager to provide input on project plan. Collaborates with hardware team and third party smart devices partners to build delivery services for Walmart customers using cryptography. Work on public facing systems and products that serves millions of customers and enable best practices and procedures to allow deployment of mass scale.Minimum education and experience required: Bachelor\'s degree or equivalent in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years of experience in software engineering or related area; OR Master\'s degree or equivalent in computer science, computer engineering, computer information systems, software engineering, or related area and 1 year of experience in software engineering or related area.Skills required: Experience designing and implementing REST API web services using NodeJS and ExpressJS. Experience designing and implementing graphQL queries and mutations. Experience writing SQL queries scripts using relational database tool. Experience writing unit test and integration test cases using Mocha. Experience writing CICD pipeline scripts using container orchestration. Experience performing stress testing for web services using devops tools. Experience documenting technical solutions by developing flow charts, diagrams using confluence. Experience implementing second-level in-memory cache using redis. Experience Implementing cron job schedulers using k8s. Experience coding in object-oriented language including JavaScript and typescript. Experience implementing Kafka pipeline to managed events to/from other systems. Employer will accept any amount of experience with the required skills.Salary Range: $115,918/year to $216,000/year. Additional compensation includes annual or quarterly performance incentives.  Additional compensation for certain positions may also include: Regional Pay Zone (RPZ) (based on location) and Stock equity incentives.Benefits: At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting. Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.

  • Minimum qualifications:

  • Description

Job Details

Jocancy Online Job Portal by jobSearchi.