Brief description about job ETL developer will be responsible for developing an ETL process in AWS Cloud. ETL work is predominately for Data ingestion, Data transformation, and Data Loading. As a senior developer, you will be responsible for create new ETL Batch Jobs, identifying areas of improvements within existing ETL processes. Writing Unit test cases, integration test cases. Perform functional testing. Ensure that all functionality is comprehensively tested in an automated way before rollout to production. This position will also require you to partner with data analysts, product owner within the team to understand the data and deliver successful implementation.
Technical skills
6-8 years of experience Python. Competent knowledge in Python is required.
Strong understanding of Database technology (PostgreSQL)
Experience with Spark, PySpark, ETL process. Databricks knowledge is a plus.
Development Tools/Applications (GitHub, PyCharm, Jenkins)
