Responsible for the ingestion, maintenance, improvement, cleaning, and manipulation of data during the dev and maintenance phase of the warehouse.
Define and build large-scale near real-time streaming data processing pipelines that will enable faster, better, data-informed decision-making within the business.
Keep up with industry trends and best practices on new and improved data engineering strategies that will drive departmental performance leading to improvement in an overall improvement in data governance across the business, promoting informed decision-making, and ultimately improving overall business performance.
4+ Years of Data Engineering.
3+ years of Python development.
Proven data analysis skills.
Experience in working with AWS.
Experience building Data pipelines from scratch.
Strong fundamental and production-level SQL skills.
Core understanding of relational databases.
Design, develop, deploy, and support data integration, data movement, and data analysis jobs for various lines of businesses.
Strong experience in advanced SQL, query optimization, and performance improvements
Database Concepts (SQL, Joins, Normalization).
SQL (complex queries, store procedures, partitions, PL/SQL, cursors).
Possess expertise in writing and tuning, views, stored procedures, and functions.
