Big Data Software Engineer

Big Data Software Engineer

24 Sep 2024
New York, New york city, 10001 New york city USA

Big Data Software Engineer

Vacancy expired!

Job Description
One of the largest hedge funds and private equity administrator globally is looking forward to adding a Big Data Software Engineer to their team for a full-time and fully remote role. They provide investment, financial services, and software for their different clients all around the world.

As a Big Data Software Engineer, you will be working with multiple functional and technical teams to scope and implement a micro service work for data pipelining, design, implement, create, and build for their platform. The ideal engineer will be proficient in Python, Kafka, Spark, Docker, and experience working with cloud environments.
Required Skills & Experience

  • Bachelor's Degree in Computer Science or Computer Engineering.
  • Experience working with Python.
  • Cassandra is preferred but experience working with either MongoDB, Redis, PostgreSQL, Hadoop, Minio or S3 is also valid.
  • Proficiency in Kafka, Spark, Citus.
  • Solid understanding of cloud computing design and development principles.
  • Proficient in cloud development methods such as Docker, RESTful APIs, terraform, GIT, CI/CD.
  • Familiar with microservices architectures and building a decoupled system.
Desired Skills & Experience
  • Previous experience with financial institutions IT or similar.
  • Experience developing financial applications is a plus.
  • Experience in deploying multi-node, scalable, web applications.
  • UI hands-on experience (JavaScript or python web framework).
The Offer
  • Bonus

    OR Commission eligible

You will receive the following benefits:
  • Medical Insurance
  • Dental Benefits
  • Vision Benefits
  • Paid Time Off (PTO)
  • 401(k) {including match- if applicable}

The Motion Recruitment network provides IT Staffing Solutions (Contract, Contract-to-Hire, and Direct Hire) in major North American markets. Our unique expertise in today's highest demand tech skill sets, paired with our deep networks and knowledge of our local technology markets, results in an exemplary track record with candidates and clients.

#LI-CG2

Related jobs

  • Description We are hiring a Master Data Management Engineer who will work with teams in a fast-paced technology organization. As a Master Data Manatement Engineer, you will support the analytic, technical and operational aspects of enterprise data management and governance. You will support data analysis and mining activities and act as a liaison to Information Technology teams, as well as providing ongoing support for data initiatives through master data management, data quality, data lineage, and cataloging.

  • Summary:

  • Duties: Works with a small group of four to six engineers, including offshore associates, for assigned Engineering projects by proving pertinent documents, direction, and examples; identifying short- and long-term solutions and timeline; reviewing and providing feedback for proposed solutions; and performing design and code reviews of changes. Troubleshoots business and production issues by gathering information (for example, issue, impact, criticality, possible root cause); engaging support teams to assist in the resolution of issues; formulating an action plan; performing actions as designated in the plan; interpreting the results to determine further action; performs root cause analysis to prevent future occurrence of issues; and completing online documentation. Provides support to the business by responding to user’s questions, concerns, and issues (for example, technical feasibility, implementation strategies); and facilitating resolutions. Participates in the discovery phase of medium to large projects by reviewing project requirements; translating requirements into technical solutions; gathering requested information (for example, design documents, product requirements, wire frames); writing and developing code; conducting unit testing; communicating status and issues to team members and stakeholders; collaborating with project team and cross-functional teams; troubleshooting open issues and bug-fixes; ensuring on-time delivery and hand-offs; and interacting with project manager to provide input on project plan. Collaborates with hardware team and third party smart devices partners to build delivery services for Walmart customers using cryptography. Work on public facing systems and products that serves millions of customers and enable best practices and procedures to allow deployment of mass scale.Minimum education and experience required: Bachelor\'s degree or equivalent in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years of experience in software engineering or related area; OR Master\'s degree or equivalent in computer science, computer engineering, computer information systems, software engineering, or related area and 1 year of experience in software engineering or related area.Skills required: Experience designing and implementing REST API web services using NodeJS and ExpressJS. Experience designing and implementing graphQL queries and mutations. Experience writing SQL queries scripts using relational database tool. Experience writing unit test and integration test cases using Mocha. Experience writing CICD pipeline scripts using container orchestration. Experience performing stress testing for web services using devops tools. Experience documenting technical solutions by developing flow charts, diagrams using confluence. Experience implementing second-level in-memory cache using redis. Experience Implementing cron job schedulers using k8s. Experience coding in object-oriented language including JavaScript and typescript. Experience implementing Kafka pipeline to managed events to/from other systems. Employer will accept any amount of experience with the required skills.Salary Range: $115,918/year to $216,000/year. Additional compensation includes annual or quarterly performance incentives.  Additional compensation for certain positions may also include: Regional Pay Zone (RPZ) (based on location) and Stock equity incentives.Benefits: At Walmart, we offer competitive pay as well as performance-based incentive awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty and voting. Other benefits include short-term and long-term disability, education assistance with 100% company paid college degrees, company discounts, military service pay, adoption expense reimbursement, and more. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms. For information about benefits and eligibility, see One.Walmart.com.

  • Minimum qualifications:

  • Description

  • Lead Software Engineer, QBE Insurance Corporation, New York, NY:Responsible for working with business and IT disciplines to develop and enhance business systems that align with strategic direction and roadmap. Act as a technical subject matter expert for Majesco Policy Admin, Billing, and Digital 1st products. Oversee system changes for sound design and quality of delivery. Deliver features and functions to businesses under the project and production support model. Work with the Principal technologists on upgrading the IT infrastructure to the latest versions so the QBE has the latest and greatest technology infrastructure. Work with the demand and supply to develop work and resource forecasts for the applications delivery support. Manage the continuous improvement of development processes and methodologies. Assess and address customer impacts in the design and delivery of solutions. Review the application design of other senior members of the team and provide feedback. Perform quality reviews and lead the end-to-end implementation of a solution. Complete impact analysis and ensure quality checks are performed. Perform implementation, handover, and support activities as required. Define the best practices in the designated technology area. Estimate effort for activities, report on progress, and manage all activities within an agreed budget. Provide performance management, mentoring, and staff development.Full time, Monday to Friday, 40 hours per week, $182,054.00 per year.MINIMUM REQUIREMENTS:Bachelor’s degree in Computer Science or a related field, and 8 years of progressive, post-baccalaureate related work experience in the IT industry. In lieu of a Bachelor’s degree, employer will also accept additional 2 years of related work experience in the IT industry.Of the required experience, must have 5 years of experience in each of the following:· Majesco Policy Admin;· Billing;· Requirements analysis, solution design and development;· Working with the business and IT to develop plans and strategies in alignment with the strategic direction;· CI/CD;· SDLC and associated methodologies, including DevOps, Agile, Iterative, and Waterfall; and· Assessing customer requests impact to existing design and delivering future proof solutions.Of the required experience, must have 3 years of experience in Digital 1st products solution design and development. Telecommuting permitted up to 2 days/week.Domestic travel required up to 5%.Method to apply: Email CV to Jonathan.Stalder@us.qbe.com with Job Code KBGFJG185656-5 in the subject line

  • Senior C# Azure Software EngineerNew York, NY,

Job Details

Jocancy Online Job Portal by jobSearchi.