Vacancy expired!
Required Skills: Google Cloud Platform, -Airflow, -Hadoop ecosystem, -HiveQL, -Python ETL and -SQLThe Digital organization is looking for a self-driven individual who will combine strong technical abilities and collaboration skills to deliver business value in a fast-paced and collaborative development environment. We are looking for a seasoned engineer with strong passion for customer focused solutions, insight and industry knowledge. The candidate will have the opportunity to apply technical expertise in implementing Cloud solutions and further manage and optimize them at scale. In this role, the engineer will be responsible to deliver data pipelines and analytics solutions implemented on Hadoop, Google Cloud Platform and other platforms to help build Digital processes. The Data Engineer will be responsible for creating, maintaining, testing and evaluation complex solutions in close partnership with the Data Science team and other analytic partners.
MAJOR DUTIES AND RESPONSIBILITIES:
• Builds complex technical solutions that turn business requirements into operational processes
• Design, build and optimize big data pipelines, architectures and data sets
• Create data models and logical mappings to enable new data pipelines
• Design, implement, maintain, and support end-to-end ETL solutions
• Aligns complex technical solutions to corporate governance requirements to ensure data security and maintain data quality standards
• Remains on the cutting edge of industry trends to ensure that the Clients COE is aligned with industry best practices
• Builds automation and self-service consumption tools to operationalize data science solutions
• Aligns technical solutions to corporate standards to ensure that security and privacy requirements are met
• Communicates clearly and concisely to key leadership and stakeholders to ensure alignment on project status and deliverables
• Partners with Big Data architects and other key stakeholders to ensure that project deliverables align with cost and timing standards
• Partners with the main data platform engineering team and data architects to build the data pipelines
QUALIFICATIONS
• 3-5 years of progressive, post-bachelors experience in Data Engineering/Management.
• Knowledge of data management fundamentals and data storage principles.
• Demonstrated strength in data modeling, ETL development and asynchronous pipelines.
• Strong experience with using IDEs and Software development environments including one or more of the followings: Eclipse, NetBeans and Intellij Idea.
• 2 years of experience applying Agile development practices and working with distributed, component-based architectures.
• Experience in Big Data Solutions using technologies including one or more of the followings: Hadoop, Hive, HBase, MapReduce, Spark, Sqoop, Oozie.
• Strong SQL skills.
• 2 Years of experience in Spark/Scala.
• 1-2 years of experience with REST API development.
• 2 years of experience on Cloud platforms. Experience with Google Cloud Platform is an advantage.
• Strong experience in performance Tuning, troubleshooting application issues & analyzing production issues.
• 1-2 years of experience in Python or Java.
• Experience applying Agile development practices and working with distributed, component-based architectures.
• Experience with automation using Jenkins and Shell scripting.
• Comfortable with support tools (Docker, Git, Bash)
MINIMUM QUALIFICATIONS:
• Bachelor's Degree in Computer Science, Engineering, or related field
• 3-5 years of experience in Data Management
PREFERRED QUALIFICATIONS:
• Master’s Degree in Computer Science, Engineering or related field
Send resumes to: ranadheer at delviom dot com
