Data Engineer

Data Engineer

24 Oct 2024
Michigan, Lansing, 48901 Lansing USA

Data Engineer

R4040Employment TypeFull timeWorksite FlexibilityRemoteJob SummaryWe are looking for a motivated Data Engineer ready to take us to the next level! If you have 5 or more years of experience with Google Cloud Platform services, Hadoop and Hive, and are looking for your next career move, apply now.Job DescriptionWe are looking for a Data Engineer to development, and implement new systems, and major enhancements to existing systems, as well as provide production support for systems with high complexity. This position will be Full-Time and Remote as a 6-month contract with the ability to renew.Candidates must reside in and be legally authorized to work in the U.S. to be eligible for this role.What You’ll Do

Develop and implement new data systems to support business objectives

Design and execute major enhancements to existing systems to improve performance and functionality

Provide production support for systems with high complexity, ensuring minimal downtime and quick resolution of issues

Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs

Optimize and maintain data pipelines to ensure efficient data processing and storage

Ensure data quality and integrity through rigorous testing and validation processes

Stay up to date with the latest industry trends and technologies to continually improve our data engineering practices

What You'll NeedRequired:

Bachelor’s degree in computer science, Data Analytics or a related field

At least five years of experience performing data engineering tasks, containing but not limited to the following experiences

Data engineering tools and technologies, such as Apache Spark, Hadoop, and Hive as well as their API’s such as PySpark

Cloud computing platforms, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)

Google Cloud Platform services (GCP), such as: Google Cloud Storage, Cloud Functions, Pub/Sub, Cloud Scheduler, Cloud Run, BigQuery, and Cloud SQL

Experience with Google Cloud Platform API’s and SDK’s

Familiarity with cloud computing concepts, such as virtual machines, storage, and networking

Familiarity with data modeling and database design

Strong problem-solving and analytical skills

Excellent communication and teamwork skills

Preferred:

Experience writing Python scripts for data engineering tasks

Familiarity with Python libraries for data manipulation and analysis, such as NumPy, Pandas, and SciPy

Experience with Hadoop and Hive

Physical Demands

Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state, and local standards

Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Must be able to communicate with customers/team members over the phone and in person

Reasonable Accommodation StatementIf you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.Equal Employment Opportunity Policy StatementIt is the policy of CAI not to discriminate against any employee or applicant due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. It is also the policy of CAI to take affirmative action to employ and to advance in employment, all persons regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Employees and applicants of CAI will not be subject to harassment due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. Additionally, retaliation, including intimidation, threats, or coercion, because an employee or applicant has objected to discrimination, engaged or may engage in filing a complaint, assisted in a review, investigation, or hearing or have otherwise sought to obtain their legal rights under any Federal, State, or local EEO law is prohibited.

Related jobs

  • R4203

  • Summary:

  • Our work matters. We help people get the medicine they need to feel better and live well. We do not lose sight of that. It fuels our passion and drives every decision we make.

  • Job Description

  • Overview

  • SUMMARY: Manages a team responsible for assembling and managing data to facilitate a variety of Actuarial and Data Science functions including predictive modeling projects, advanced actuarial analysis, etc. The team works with other Actuarial and Data Science resources and Information Technology to deploy predictive models into a production environment to support key business functions. The team creates and maintains applications that leverage Actuarial and Data Science information. The manager participates with an interdepartmental group to develop and maintain the enterprise data strategy. RESPONSIBILITIES/TASKS: Manages collecting and organizing of data from various internal and external sources to prepare analyses and data sets for report generation, statistical analysis and data mining projects. Establishes ownership of key data fields: Creates, classifies and documents data definitions. Creates, implements, and assesses appropriate data controls (e.g. reasonability checks, dollar/count controls, field requirements). Provides data necessary to measure the performance of models that are in production. Assists with building model monitoring reports. Develops, deploys and maintains diagnostic reports, dashboards and scorecards that assess and monitor enterprise, operating company and business unit performance and results on an ongoing basis. Leads the data group as it assists the rest of the Predictive Modeling team working with Information Technology, Project Management and the Business Units on the implementation efforts required to move completed predictive models into a production environment to support key business processes. Ensures processes related to deploying models or creating applications are coordinated with IT best practices. Prepares and delivers reports and presentations with a level of detail appropriate for the intended audience. This includes the creation of appropriate documents (PowerPoint presentations, etc.) to be used in the communication of Actuarial and Data Science initiatives. Maintains an understanding of predictive analytics techniques necessary to successfully lead analytics data assembly efforts. Keeps abreast of data developments within the industry and transfers knowledge to the rest of the data team. Active participant in the data center of excellence. Manages data team and participates in creation of departmental strategy. Responsibilities include budgeting, balancing workloads, creating efficiency through automation, special projects, quality improvement and oversight, acting as a subject matter expert and mentor and continuously evaluating toolset and methodologies. DIRECTION EXERCISED: Directly supervises exempt and non-exempt staff in accordance with company policies and applicable Federal and State Laws. Responsibilities include but are not limited to effectively interviewing, hiring, terminating, and training employees; planning, assigning and directing work; appraising performance; rewarding and counseling employees; addressing complaints and resolving problems; supporting and encouraging the engagement process. This position description identifies the responsibilities and tasks typically associated with the performance of the job. Other relevant essential functions may be required. EMPLOYMENT QUALIFICATIONS: SKILLS/KNOWLEDGE/ABILITIES (SKA) REQUIRED: Knowledge in quantitative analytics, including experience using statistical analysis software. Demonstrated skills in a variety of database platforms, data acquisition techniques, business intelligence and analysis tools. Demonstrated ability to use programming to engineer solutions to tasks. Ability to manage projects and determine efficient and cost effective means to manage and improve data. Demonstrated skills with process development and governance of data standards. Expert level understanding of data architecture as it relates to business processes Solid understanding of statistical principles

  • Job Description SUMMARY: The Data Governance Architect is the main coordinator between the business owners of products and platforms and the data solutions to meet their needs. This role is the design and business lead within the Data Governance organization, driving responsible and scalable data practices across data teams right-sized to the business needs across Stride. ESSENTIAL FUNCTIONS: Reasonable accommodations may be made to enable individuals with disabilities to perform the essential duties. Gather, refine, prioritize, and manage business and product data use-cases into an actionable backlog triaged between Data Engineering, Data Modeling, Data Science, Data Analytics, and Data Governance teams; Drive data protection, traceability, and privacy compliance processes as the administrator of the OneTrust platform; Drive business ownership, data quality rule definition, and appropriate data uses and protections for domain-based data modeling; Coordinate and communicate data priorities, delivery, and value to varied audiences from executive leadership to product stakeholders to data and development implementation teams, aligning expectations and resolving conflicts as they arise. Advocate for the business and their data needs, helping to translate into actionable requirements, and connecting stakeholders to the teams and solutions that best meet their needs. Coordinate between data delivery teams (modeling, architecture, engineering, analytics, data science) to map business data needs to solutions, roadmaps, and delivery. Consult on product and platform development through design, development, and release phases to provide actionable requirements to meet data governance standards. This position has no formal supervisory responsibilities. MINIMUM REQUIRED QUALIFICATIONS: Seven (7) years of relevant professional experience working with data including analytics and BI, data modeling, data science, data architecture, or database management Experience desiging and standing up technical data governance and management practices including metadata management, data ownership and stewardship, data lineage, data quality, data contracts/sharing agreements, and data tagging. Experience working with, designing, and/or developing data solutions across database types (relational, unstructured, graph) in cloud and on-prem environments Deep understanding of data governance and management practices including metadata management, data ownership and stewardship, data lineage, data quality, data contracts/sharing agreements, and data tagging. Ability to develop relationships across functions and inspire trust and confidence through effective communication and interpersonal skills. Excellent communication and presentation skills (verbal and written), able to target content to fit the audience, both execuitive and operational, technical and non-technical. Demonstrated ability to translate complex business processes and technical designs into clear and actionable data requirements. Demonstrated project management planning and organization skills, both as a team lead and between partnering organizations. Ability to travel up to 10% of the time Ability to clear required background check Certificates and Licenses: None required. DESIRED QUALIFICATIONS: Bachelor\'s or graduate degree in Computer Science, Mathematics, Statistics, Information Systems, Library Science or a related field, or equivalent training Ten (10) years of relevant professional experience working with data including analytics and BI, data modeling, data science, data architecture, database management Experience in K-12 education as a teacher, researcher or data personnel Demonstrated experience in creating end to end products to drive business outcomes WORK ENVIRONMENT: The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable acco

Job Details

Jocancy Online Job Portal by jobSearchi.