Description Job Summary:We are seeking a highly skilled Data Engineer to design, build, and maintain data infrastructure in a cloud-based environment. The ideal candidate will have hands-on experience with Azure Data Bricks, Azure Data Lake, Azure Data Factory, and Snowflake. You will play a critical role in enabling data-driven decision-making by creating scalable and efficient data pipelines, integrating data sources, and optimizing data storage and processing systems.Key Responsibilities:Data Architecture & Engineering:
Design and implement scalable, reliable, and secure data pipelines using Azure Data Factory, Azure Data Bricks, and Snowflake.
Develop, optimize, and maintain Azure Data Lake for data storage and processing.
Create ETL/ELT workflows to extract, transform, and load data from various sources.
Integration & Cloud Operations:
Integrate data from disparate systems into centralized platforms using Azure tools.
Collaborate with DevOps teams to ensure robust CI/CD pipelines for data infrastructure.
Monitor and troubleshoot data pipelines, ensuring high availability and performance.
Data Management & Optimization:
Implement best practices for data storage, indexing, partitioning, and retrieval to optimize performance.
Ensure data security and compliance with enterprise standards and regulations.
Work with business stakeholders to gather requirements and provide data solutions tailored to their needs.
Analytics & Reporting Support:
Prepare data for analysis, ensuring compatibility with visualization tools and platforms.
Support data scientists and analysts by providing clean, reliable, and well-documented data sets.
Requirements
Required Qualifications:
Bachelor’s degree in Computer Science, Data Engineering, or a related field (or equivalent experience).
Proven experience with Azure Data Bricks, Azure Data Lake, and Azure Data Factory.
Hands-on experience with Snowflake for data warehousing and analytics.
Strong understanding of SQL and experience in database management.
Proficiency in Python, Scala, or a similar programming language for data processing.
Knowledge of cloud architecture and data engineering best practices.
Technology Doesn't Change the World, People Do.®
Robert Half is the world’s first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app (https://www.roberthalf.com/us/en/mobile-app) and get 1-tap apply, notifications of AI-matched jobs, and much more.All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.© 2024 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking “Apply Now,” you’re agreeing to Robert Half’s Terms of Use (https://www.roberthalf.com/us/en/terms) .
