Data Engineer/Analyst IV - New York, NY / Boston, MA / Bellevue, WA
Vacancy expired!
Minimum Qualifications
8+ years of experience
Strong SQL skills are a MUST
Data Modeling skills are a MUST and considered a portion of the SQL signals we look for
For Coding, should have familiarity with major concepts and a comfort level with at least one language of the candidate’s choice
Problem Solving is required
Partnership is less of a thing here as most of the work will be directed by FTE Data Engineers, however this is a PLUS if the candidate exhibits good soft skills
5+ years of Python development experience.
5+ years of SQL experience.
3+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
3+ years experience with Data Modeling.
Experience analyzing data to discover opportunities and address gaps.
5+ years experience in custom ETL design, implementation and maintenance.
Experience working with cloud or on-prem Big Data/MPP analytics platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).
Preferred Qualifications
Experience with more than one coding language.
Designing and implementing real-time pipelines.
Experience with data quality and validation.
Experience with SQL performance tuning and e2e process optimization.
Experience with anomaly/outlier detection.
Experience with notebook-based Data Science workflow.
Experience with Airflow.
Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.
Description We are hiring a Master Data Management Engineer who will work with teams in a fast-paced technology organization. As a Master Data Manatement Engineer, you will support the analytic, technical and operational aspects of enterprise data management and governance. You will support data analysis and mining activities and act as a liaison to Information Technology teams, as well as providing ongoing support for data initiatives through master data management, data quality, data lineage, and cataloging.
