Google Cloud Platform Data Engineer

Google Cloud Platform Data Engineer

26 Apr 2024
Colorado, Lonetree, 80124 Lonetree USA

Google Cloud Platform Data Engineer

Vacancy expired!



Note : Must have

Google Cloud Platform Experience



  • Build a and operationalize pipelines to include data acquisition, staging, integration of new data sources, cataloging,

  • Layout and architect a strategic data vision for SAMS

  • Cleansing, batch and stream processing, transformation, and consumption

  • Work with our cloud engineering team to setup and provision a team-sandbox with approved managed Google Cloud Platform data services to build the data pipeline and provided sample data sets.

  • Provide architecture to integrate metadata management, integrate with on-prem Data quality engine.

  • Provide automated source / destination data comparison architecture

  • Design and develop a data preparation and quality control mechanism

  • Implement data classification of incoming data and access controls based on data domains

  • Architect and implement data exploration platform for data architects and data scientists on staged data sets.

  • Build and refine job automation and orchestration for pipeline to handle exception handling, rerun jobs, fault tolerance, retrospective, logging, alerts, notifications etc.,

  • Develop transformation process for handling batch and streaming data

  • Build compatible target data state to include compatible schema design, catalog, data modeling acceptable for consumption via APIs, Client and analytics

  • Provide data usage pattern for analytics, API and other consumption patterns from target data store.

  • Build target state data publishing and visualization and integration

  • Implement Identity and Access Management (IAM) roles across the data pipeline. Also define and execute different delegate roles as needed.

  • Implement IAM and dataset-level-access-controls in target data store

  • Build an CICD automation pipeline facilitating automated deployment and automated testing

  • Deliver end to end comprehensive documentation along with code samples





Related jobs

  • Are you ready to unleash your technical creativity? Dream, Innovate, Inspire and Empower the next generation to transform humanity through technology and imagination! Electrical engineers at Sierra Nevada Corporation research, design, develop, test, certify, deploy and improve cutting edge products and services. These cover a very wide range from advanced mission payloads and electronic systems through highly integrated aircraft to orbital and space exploration systems. You\'ll conceptualize and design new products and processes throughout the product lifecycle from analog and digital electronic circuit card assemblies to fully integrated systems.

  • If you like solving complex IT and security problems using your deep analytical skills, this is the opportunity for you! As a Sr Systems Security Engineer, you will be using your skills and expertise to design, test, and implement our secure operating systems, networks, security monitoring, and tuning. You\'ll be responsible for the management of our IT security systems and applications, incident response, digital forensics, loss prevention, and eDiscovery actions, conducting risk and vulnerability assessments, and developing and implementing security controls. You\'ll research, evaluate, and recommend new security tools, techniques, and technologies in alignment with our IT security strategy and introduce them to the enterprise.

Job Details

  • ID
    JC12629940
  • State
  • City
  • Job type
    Contract
  • Salary
    N/A
  • Hiring Company
    Kriscon
  • Date
    2021-04-21
  • Deadline
    2021-06-20
  • Category

Jocancy Online Job Portal by jobSearchi.