Team Lead - Data Engineering (Remote)

Team Lead - Data Engineering (Remote)

Vacancy expired!

We are looking for a Team Lead to join our Data Engineering team and help build next generation datalake and data pipeline solutions. You will be leading a team of highly skilled data engineers responsible for designing and implementing a scalable datalake/data pipeline solution utilizing various data extraction and transformation technologies. You will provide technical leadership, prioritize and manage day to day technical work of a team of data engineers. You will be core part of a broader Data, Analytics and ML team with the chance to make a significant impact to the broader data initiative within the company.

Principal Responsibilities:

• Provide technical leadership to a team of data engineers by managing technical aspects of day to day work (No people management responsibilities)


• Contribute, as part of a team, in designing, testing, and implementing sophisticated data pipeline technologies to extract and transform data from source systems


• Perform data-modeling on target systems to store data and support analytic querying


• Communicate with other development teams to gather and document requirements


• Work in Agile methodology, help manage work in JIRA and lead/participate in design and review discussions


• Help create/follow best practices for the software development life-cycle including coding standards, reviews, source management, build and testing


• Collaborate with other engineers in the team to implement best-practices around large scale data processing

• 3+ years of experience as a technical manager or as a team lead


• 5+ years of experience as a Data Engineer or in a similar role working with large data sets and ETL processes


• 7+ years of industry experience in software development


• Knowledge and practical use of a wide variety of RDBMS technologies such as MySQL, Postgres, SQL Server or Oracle


• Strong SQL experience with an emphasis on analytic queries and performance


• Experience with cloud-based data warehouse technologies such as Snowflake, AWS RedShift, Google BigQuery


• Familiarity with either native database or external change-data-capture technologies


• Practical use of various data formats such as CSV, XML, JSON, and Parquet


• Use of Data flow and transformation tools such as PDI (Pentaho Data Integration), Apache Nifi or Talend


• Implementation of ETL processes in languages such as Java, Python or NodeJS


• Use of large shared data stores such as Amazon S3 or Hadoop File System


• Thorough and practical use of various Data Warehouse data schemas (Snowflake, Star, OLAP cube)


• Experience with various "NoSQL" technologies such as MongoDB or ElasticSearch


• Practical experience with Public Cloud Services such as AWS/Azure/Google Cloud Platform a plus