Senior Data Engineer - ETL, Bigdata and Azure Richmond, VA Long term Contract
Looking for the candidates who can work on our W2. 1. 8+years in total, ETL/Data Warehouse background (3-5 years) with more recent Big Data/Data Engineering experience (5-8 years) 2. 3 years of Azure experience (writing new pipelines in data bricks, setting up arm templates, data factory) 3. 5+ years of development/coding (mostly Python, but also maybe Spark/Spark SQL)
Must have very good communcation skills. This is a part of the Enterprise Data Lake team who is focused on delivery and new ingestion gonig into data lakes, creating new piplines with data bricks and Python. Databricks WITHIN AZURE and Azure Data Factory are going to be non-negotiable. Work collaboratively and creatively with data architects, engineers, and developers to develop scalable and maintainable data pipelines using the latest Microsoft Azure technologies and leading industry practices Develop patterns and build data pipelines that ingest enterprise-wide data into the Enterprise Data Lake and make it available for consummation for both data analytics and data science Partner with a variety of internal stakeholders across the organization to deliver creative, cutting-edge, high-quality engineering solutions that meet business requirements in a fast-paced, ever-changing business environment.
• 8+ years overall data engineering experience including guiding ideation, design, and decisions in a collaborative team setting • Data pipeline development with Azure Data Factory and Azure Databricks • Focus on complete solutions including unit/function/integration testing, documentation, pipeline monitoring and support, and team teach-outs • Experience working with streaming data and technologies, such as Azure Event Hubs
Qualifications/Requirements • Experience with Azure cloud data engineering solutions. • Experience developing scalable and supportable Enterprise Data Lake patterns • Experienced in working with Big Data frameworks, preferably Apache Spark • Experienced in software development experience in either Python, Scala, C# or Java • Experienced with transactional/relational data and SQL • Experience working on Agile teams implementing DevOps practices • Years of experience typically 8+ years
Skills • Strong people skills including the ability to interact with employees at all levels • Excellent communication skills, adapting to various audience types • Strong on ideas for system optimization, support, and monitoring • Passionate about innovation and loves solving complex problems in a highly- collaborative, fast-paced team environment • Advanced knowledge of team software development concepts and techniques and the ability to communicate those concepts to junior team members including patterns in the areas of security, scalability, and usability • Experience in creating and developing software and effectively communicating the rationale behind the designs • Demonstrated ability to compare-and-contrast alternative approaches to meet objectives while assessing risk both quantitatively and qualitatively • Possess strong organizational and time management skills
Preferred Qualifications: • 8+ years overall data engineering experience including guiding ideation, design, and decisions in a collaborative team setting • Data pipeline development with Azure Data Factory and Azure Databricks • Focus on complete solutions including unit/function/integration testing, documentation, pipeline monitoring and support, and team teach-outs • Experience working with streaming data and technologies, such as Azure Event Hubs
Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Project Delivery Senior Analyst- Senior Data Governance Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel. If so, consider an opportunity with Deloitte under our Project Delivery Talent Model. Project Delivery Model (PDM) is a talent model that is tailored specifically for long-term, onsite client service delivery.
We are the movers of the world and the makers of the future. We get up every day, roll up our sleeves and build a better world together. At Ford, we’re all a part of something bigger than ourselves. Are you ready to change the way the world moves?