Data Engineer

Data Engineer

24 Oct 2024
Michigan, Lansing, 48901 Lansing USA

Data Engineer

R4040Employment TypeFull timeWorksite FlexibilityRemoteJob SummaryWe are looking for a motivated Data Engineer ready to take us to the next level! If you have 5 or more years of experience with Google Cloud Platform services, Hadoop and Hive, and are looking for your next career move, apply now.Job DescriptionWe are looking for a Data Engineer to development, and implement new systems, and major enhancements to existing systems, as well as provide production support for systems with high complexity. This position will be Full-Time and Remote as a 6-month contract with the ability to renew.Candidates must reside in and be legally authorized to work in the U.S. to be eligible for this role.What You’ll Do

Develop and implement new data systems to support business objectives

Design and execute major enhancements to existing systems to improve performance and functionality

Provide production support for systems with high complexity, ensuring minimal downtime and quick resolution of issues

Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs

Optimize and maintain data pipelines to ensure efficient data processing and storage

Ensure data quality and integrity through rigorous testing and validation processes

Stay up to date with the latest industry trends and technologies to continually improve our data engineering practices

What You'll NeedRequired:

Bachelor’s degree in computer science, Data Analytics or a related field

At least five years of experience performing data engineering tasks, containing but not limited to the following experiences

Data engineering tools and technologies, such as Apache Spark, Hadoop, and Hive as well as their API’s such as PySpark

Cloud computing platforms, such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)

Google Cloud Platform services (GCP), such as: Google Cloud Storage, Cloud Functions, Pub/Sub, Cloud Scheduler, Cloud Run, BigQuery, and Cloud SQL

Experience with Google Cloud Platform API’s and SDK’s

Familiarity with cloud computing concepts, such as virtual machines, storage, and networking

Familiarity with data modeling and database design

Strong problem-solving and analytical skills

Excellent communication and teamwork skills

Preferred:

Experience writing Python scripts for data engineering tasks

Familiarity with Python libraries for data manipulation and analysis, such as NumPy, Pandas, and SciPy

Experience with Hadoop and Hive

Physical Demands

Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state, and local standards

Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc.

Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor

Must be able to communicate with customers/team members over the phone and in person

Reasonable Accommodation StatementIf you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111.Equal Employment Opportunity Policy StatementIt is the policy of CAI not to discriminate against any employee or applicant due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. It is also the policy of CAI to take affirmative action to employ and to advance in employment, all persons regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Employees and applicants of CAI will not be subject to harassment due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. Additionally, retaliation, including intimidation, threats, or coercion, because an employee or applicant has objected to discrimination, engaged or may engage in filing a complaint, assisted in a review, investigation, or hearing or have otherwise sought to obtain their legal rights under any Federal, State, or local EEO law is prohibited.

Related jobs

  • Summary:

  • Our work matters. We help people get the medicine they need to feel better and live well. We do not lose sight of that. It fuels our passion and drives every decision we make.

  • Job Description

  • Overview

  • Job Description

  • Job Description

  • Cribl does differently. What does that mean? It means we are a serious company that doesn\'t take itself too seriously; and we\'re looking for people who love to get stuff done, and laugh a bit along the way. We\'re growing rapidly - looking for collaborative, curious, and motivated team members who are passionate about putting customers first. As a remote-first company we believe in empowering our employees to do their best work, wherever they are. As the data engine for IT and Security many of the biggest names in the most demanding industries trust Cribl to solve their most pressing data needs. Ready to do the best work of your career? Join the herd and unlock your opportunity. Why You\'ll Love This Role As a Windows Software Engineer at Cribl, you will play a crucial role in defining the technical direction of our Edge product on Windows nodes, working closely with our established team of engineers and product managers. Our Edge platform stands as an intelligent and highly-scalable solution for edge-based data collection, serving thousands of machines with diverse configurations. Your primary responsibility will be to enhance the performance, reliability, and user experience of our Edge product, with a specific emphasis on optimizing for the Windows ecosystem. What You\'ll Do Spearhead the technical strategy for Edge deployment on Windows, ensuring optimal performance and functionality. Actively engaging in architecture discussions and design reviews, collaborating closely with fellow team members to refine our solutions. Form dynamic partnerships across various departments, including engineering, design, SRE, support, sales engineering, and product management, to deliver top-notch features. Take charge of the end-to-end development lifecycle, from design and coding to testing and maintenance, to deliver clear, concise, and robust code that aligns with customer expectations. Implement rigorous testing methodologies, including comprehensive automated tests, to validate product functionality and reliability. Offer valuable assistance to our Support and SRE teams in troubleshooting and resolving intricate technical issues, ensuring seamless operations for our customers. Potentially be on-call for rotations to help support our SRE team If You Got It, We Want It Proficient expertise in Windows environments, encompassing both Windows 10/11 and Server editions. Hands-on experience working with Windows Management Instrumentation (WMI), PowerShell, Windows SysInternals, Windows Event Log, Active Directory Demonstrated capability in orchestrating large-scale Windows deployments Experience building installers with Windows Installer and WiX Proven track record of crafting innovative solutions using Node.js, Typescript, and React to build robust software products. Strong knowledge of key operating system concepts, including memory management, filesystems, networking, and process management. Extensive familiarity with the Windows API Experience with Agile processes and rapid iterative development A steadfast commitment to ownership, ensuring that deliverables consistently meet high standards of quality and performance. Exceptional troubleshooting and debugging skills for swiftly resolving technical challenges. A relentless drive to transform concepts into tangible, high-quality software solutions. Salary Range ($155,000 - $210,000) The salary for this role is dependent on geographic location. The salary offered within the range described will be based on the individual candidate\'s job-related knowledge, skills, and experience. In addition to a competitive salary, Cribl also offers a generous benefits package which includes health, dental, vision, short-term disability, and life insurance, paid holidays and paid time off, a fertility treatment benefit, 401(k), equity, and eligibility for a discretionary company wide bonus. #LI-JB1 Bring Your Whole Self Diversity drives innovation, enables better decis

Job Details

Jocancy Online Job Portal by jobSearchi.