Sr. Data Engineer

Sr. Data Engineer

Vacancy expired!

TITLE: SR. DATA ENGINEER

Location: Chicago, IL; Des Moines, IA; Kansas City, MO; Winter Park, FL

Compensation Range : $135k - $150k + bonus

A global financial firm is seeking a Sr. Data Engineer to join their growing, local team. The Sr. Data Engineer is responsible for ingesting, transforming, and exposing snapshot, real-time, event-driven data streams pertaining to the firm's data assets. The ideal candidate will exhibit passion for continuous improvement and a dedicated focus on enabling consumers to achieve their goals by making data driven decisions. Excellent communication skills are required.

Responsibilities:

• Prioritizes and executes rapid raw data collection from source systems, targets and implements efficient storage of, employs fast and reliable access patterns.
• Understands system protocols, how systems operate and data flows.
• Aware of current and emerging technology tools and their benefits.
• Expected to independently develop a full software stack.
• Understands the building blocks, interactions, dependencies, and tools required to complete software and automation work. Independent study of evolving technology is expected.
• Drives engineering projects by developing software solutions; conducting tests and inspections; building reports and calculations.
• Strong focus on innovation and enablement, contributes to designs to implement new ideas which improve an existing and new system/process/service.
• Understands and can apply new industry perspectives to our existing business and data models.
• Reviews existing designs and processes to highlight more efficient ways to complete existing workload more effectively through industry perspectives.
• Maintains knowledge of existing technology documents. Writes basic documentation on how technology works using collaboration tools like Confluence. Creates clear documentation for new code and systems used.
• Drives team practices and procedures to achieve repeatable success and defined expectation of services
• Monitors and evaluates overall strategic data infrastructure; tracks system efficiency and reliability; identifies and recommends efficiency improvements and mitigates operational vulnerabilities.

Requirements:

• Bachelor's degree or relevant work experience in Computer Science, Mathematics, or related technical discipline.
• 5+ years of experience as a Data Engineer
• Strong understanding of Data Engineering architecture (data lakes, working with data science and machine learning engineers)
• Experience building and managing pipelines
• Foundational knowledge of data structures, algorithms, and designing for performance.
• Python scripting
• Understanding of SQL query language and be able to write based database queries
• Experience with PySpark, Airflow, Databricks, Kubernetes or other similar tools
• Understanding of SQL query language and be able to write based database queries
• Strong understanding of data structures, algorithms, various design patterns, core principles of OO design, and practical application of designs within a highly scalableperformant architecture
• Problem solving skills - able to work through a problem, analyze root cause and propose solution.
• Familiarity with API based data distribution.
• Solid understanding of Enterprise architecture patterns, Object Oriented & Service Oriented principles, design patterns, industry best practices
• Exposure to containers, microservices, distributed systems architecture, orchestrators, and cloud computing.
• Enjoys working with algorithms and data structures (e.g. trees, hash maps, queues)
• Excellent communication skills and the ability to work with subject matter expert to extract critical business concepts.
• Ability to work in an Agile methodology environment.

W2 employees are offered comprehensive benefits including health, dental and vision.

About Infinity Consulting Solutions

At Infinity Consulting Solutions our mission is to cultivate successful long term relationships with candidates and clients matching the right candidate with the right client. We believe technology cannot replace the real personal relationships we cultivate. We reject the notion that technology alone is the answer to staffing which is why we our successful partnerships rely on collaboration NOT automation. ICS has been providing flexible staffing solutions for over 20 years in Information Technology, Compliance, Accounting / Finance and Corporate Support. Our staffing solutions include Contract, Temp to Perm and Permanent Placement.

ICS is an Equal Opportunity Employer.