URGENT NEED - Sr. ETL Developer - Pentaho (PDI) role in White Plains, NY
Location: White Plains, NY 10601 (#Remote Work allowed only during pandemic; Local candidates will only be considered) Duration: 12 months + contract Work hours: 9am -5pm (Mon - Fri) i.e. 7.5 paid hours plus half an hour unpaid lunch (37.5 hours/week)
Project Overview : Currently our client has 2 legacy systems, ESA and the ECC Data Warehouse, supporting this function. The project will replace these 2 legacy systems which have extensive modifications and multiple ongoing issues requiring manual interventions and support. The project will provide our client with a dashboard and reports accessible to all levels of the organization, enabling departments to automate analytical work instead of manual machinations.
Job Functions & Responsibilities: Collaborate with all developers and business users to gather required data and execute all ETL programs and scripts on systems and implement all data warehouse activities. Collaborate and perform tests and provide update to all ETL activities within schedule and provide support to all large data volumes and assist in data processing. Documents all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required programs and scripts. Analyze and interpret all complex data on all target systems and analyze and provide resolutions to all data issues and coordinate with data analyst to validate all requirements. Perform tests and validate all data flows and prepare all ETL processes according to business requirements and incorporate all business requirements into all design specifications. Develop all data warehouse models and prepare reports for all meta data integration into systems and draft all ETL scripts and prepare required reports for all end users. Provide support to all ETL schedule and maintain compliance to same and develop and maintain various standards to perform ETL codes and maintain an effective project life cycle on all ETL processes. Document all test procedures for systems and processes and coordinate with business analysts and users to resolve all requirement issues and maintain quality for same. Monitor all business requirements and validate all designs and schedule all ETL processes and prepare documents for all data flow diagrams.
Must have Skills & Experience: Bachelor's degree in computer science or equivalent with around 6+ years of experience in ETL Development, Data transformations using Pentaho Data Integrator tool (PDI) Must be excellent Pentaho developer Experience in dealing with Data Quality issues. Pentaho Data Integrator tool (PDI) Python & Java scripting Write SQL complex queries and Store Procedures PySpark language AWS RDS, API and S3 buckets