Design, development, and testing of data ingestion pipelines, perform end to end automation of ETL process and migration of various datasets that are being ingested
Participate in discussion for technical architecture, Migration activities, collaborate with Product Managers and Architects to establish the Physical application framework
Develop transformation logic, interfaces and reports as need to meet project requirements.
Required Skills
10+ years of experience building and managing complex products / solutions
5+ years of experience supporting data heavy applications and databases leveraging Python and Pyspark
Strong data handling and text log analysis skills
Expert level experience in Python, Pyspark and SQL
Good to have Scala, distributed computing, Kafka and REST based API skills
We are the movers of the world and the makers of the future. We get up every day, roll up our sleeves and build a better world together. At Ford, we’re all a part of something bigger than ourselves. Are you ready to change the way the world moves?
