Direct Client Data Engineering Lead/Architect (Prod Modernization Project; Migrating Big Data to Cloud; Not Dev/Strategic Role)

Direct Client Data Engineering Lead/Architect (Prod Modernization Project; Migrating Big Data to Cloud; Not Dev/Strategic Role)

Vacancy expired!

Title: Direct Client Data Engineering Lead/Architect (Prod Modernization Project; Migrating Big Data to Cloud; Not Dev/Strategic Role)
Location: Hybrid (2 to 3 days On site; Local to Seattle)
As a Software Engineer Tech Lead, you will be responsible for leading a team of software engineers in an initiative to migrate an on-premises large-scale data warehouse and associated data pipelines to Azure. You will have core competencies in the big data analytics platforms including Spark/ Databricks as well as Data Warehouse/Data Lakehouse architectures. You will also have very strong project management skills, specifically using Agile Methodologies such as Scrum/ Kanban/ Lean.
Tops 3 Skills Needed
1
Experience in big data platforms 10+ years
2
Agile / Scrum
10+ years
3
Experience uplifting/migrating big data to the cloud
10+ years
Years of Experience:

• 10+ years

Degree or certifications required:

• Bachelor's degree in Computer Science or related field

Required Background/ skills:

• Experience leading a team of software engineers in large-scale data warehouse and data pipelines migration.
• Experience designing and implementing data pipelines and workflow management
• Experience with data warehouse/ lake house architectures and data modeling
• Strong problem-solving skills
• Strong communication and leadership skills
• Strong ability to drive engineering trade-off discussions with the goal of driving consensus
• Experience in Agile methodologies such as Scrum, specifically in the role of Scrum Master

Technology requirements:

• Experience with Azure Cloud Analytics Platforms including PaaS and IaaS services: Azure Data Lake Storage, Azure Data Factory, Kafka, Azure Synapse
• Experience with Analytics Platforms and related technologies: Spark/Databricks, Apache Streaming, Delta Tables, and Airflow

Daily Responsibilities:

• Lead a team of software engineers in the migration of a large-scale data warehouse and associated data pipelines.
• Ability to have trade-off discussions, with engineering team, around data pipeline design with the goal of driving consensus on approach.
• Attend cross-functional meetings with project Technical Product Manager (TPM).
• Work with the TPM to translate requirements into backlog items
• Lead the engineering team in backlog grooming and refinement meetings.
• Work with team to prioritize product and engineering backlog items in planning meetings
• Lead daily stand-up meetings and drive action items and ownership around blocking items.
• Communicate schedule/project timeline status to engineering manager and TPM, highlighting key trade-off discussions.
• Mentor junior engineers and help them to grow their skills in story creation, decomposition, and estimation.

Key projects:

• Prod modernization NDA

Nice-to-Haves:

• Migration into the cloud
• Scrum master certification

Dis qualifiers:

• This assignment is not for strong hands on engineering, this would be closer to driving project management. Not looking for someone who is wanting to do the engineering need to lead the projects.