Lead Data Engineer

Lead Data Engineer

Vacancy expired!

TITLE: LEAD DATA ENGINEER

Location: Chicago, IL; Des Moines, IA; Kansas City, MO; Winter Park, FL

Compensation Range : $150k - $160k + bonus

A global financial firm is seeking an experienced Data Engineer who will be responsible for empowering the Data team to achieve its primary objectives: ingesting, mastering, and exposing real-time, event-driven data streams pertaining to the essential relational data dimensions that are crucial to the evolution and continued success of the organization. The Lead Data Engineer will focus heavily on utilizing advanced techniques and cutting-edge technologies around data mastering specific dimensional data and exposing it rapidly to internal and external consumers. The ideal candidate will exhibit passion for continuous improvement and a dedicated focus on enabling our consumers to achieve their goals and make data driven decisions. This role will actively collaborate with various streams to deliver source, shape, and deliver data effectively to empower business lines to make data driven decisions. Establishes and implements processes, standards, and KPIs for Data Engineering, Statistical Analytics, Business Intelligence, with attention to all technical aspects. Excellent communication skills are required.

Responsibilities:

• Prioritizes and executes rapid raw data collection from source systems, targets and implements efficient storage of, employs fast and reliable access patterns.
• Understands system protocols, how systems operate and data flows. Aware of current and emerging technology tools and their benefits. Expected to independently develop a full software stack.
• Understands the building blocks, interactions, dependencies, and tools required to complete software and automation work. Independent study of evolving technology is expected.
• Create cloud and big data technical design recommendations for developing and integrating new software and system technologies - from the physical layer through to the virtual layer; test, evaluate, engineer, implement and support said technologies
• Strong focus on innovation and enablement, contributes to designs to implement new ideas which improve an existing and new system/process/service.
• Understands and can apply new industry perspectives to our existing business and data models. Reviews existing designs and processes to highlight more efficient ways to complete existing workload more effectively through industry perspectives.
• Maintains knowledge of existing technology documents. Writes basic documentation on how technology works using collaboration tools like Confluence. Creates clear documentation for new code and systems used. Documenting systems designs, presentations, and business requirements for consumption and consideration at the manager level.
• Collaborates with technical teams and utilizes system expertise to deliver technical solutions. Continuously learns and teaches others existing and new technologies. Contributes to the development of others through mentoring or in-house workshops and learning sessions.
• Drives team practices and procedures to achieve repeatable success and defined expectation of services
• Provides a significant collaborative role in long-term department planning, with focus on initiatives achieving data empowerment, operational efficiency, and sustainability
• Monitors and evaluates overall strategic data infrastructure; tracks system efficiency and reliability; identifies and recommends efficiency improvements and mitigates operational vulnerabilities
• Respond to and resolve emergent service problems. Design solutions using automation and self-repair rather than relying on alarming and human intervention
• Coordinate with other teams within Data Services and broader business partners to ensure providing quality data in coordination with established business needs.

Requirements:

• 5+ years of hands-on Data Engineering or Software Development experience in capital markets / trading industry
• 5+ years of experience working within Data Architecture, Data Management and/or Production Support across large enterprises.

• Strong understanding of Enterprise architecture patterns, Object Oriented & Service Oriented principles, design patterns, industry best practices
• Previous experience to mentor and lead a small team
• Experience facilitating discussions and resolving issues across a diverse set of cross functional business & IT stakeholders.
• Experience facilitating discussions and resolving issues across a diverse set of cross functional business & IT stakeholders.
• Leadership & persuasive communication skills. Strong influencing and mentoring skills; demonstrated success in building credibility with peers and key stakeholders (Both IT & Business) to drive the action and change.
• Foundation knowledge of Data Structures, Algorithms and Designing for performance.
• Experience with PySpark, Airflow, Databricks, Kubernetes or other similar tools
• Proficiency in Python, spark and one object-oriented programming language among C#, Java
• Experience in database technology like MSSQL or Postgres or MySQL and one of key value and document databases like MongoDB, DynamoDB, Casandra
• Exposure to containers, microservices, distributed systems architecture, orchestrators, and cloud computing.
• Excellent communications skills and ability to work with business to extract critical concepts and transform into technical task items
• Ability to work and lead in an Agile methodology environment

W2 employees are offered comprehensive benefits including health, dental and vision.

About Infinity Consulting Solutions

At Infinity Consulting Solutions our mission is to cultivate successful long term relationships with candidates and clients matching the right candidate with the right client. We believe technology cannot replace the real personal relationships we cultivate. We reject the notion that technology alone is the answer to staffing which is why we our successful partnerships rely on collaboration NOT automation. ICS has been providing flexible staffing solutions for over 20 years in Information Technology, Compliance, Accounting / Finance and Corporate Support. Our staffing solutions include Contract, Temp to Perm and Permanent Placement.

ICS is an Equal Opportunity Employer.