Vacancy expired!
Data EngineerSan Francisco, California100% RemoteContract$100/hr - $100/hrOur large crypto company is looking for a Data Engineer. This is a remote contract position.The Data Engineering team builds reliable and trusted data sources and products to enable timely and accurate data-driven decision making across the company. We stand at the forefront of data science and business intelligence innovation. By transforming how data is discovered and consumed, we're laying the groundwork for the future of analytics.Building and maintaining a foundational data layer, that serves as the single source of truth across the client. Designing and implementing robust data pipelines, guaranteeing data quality and timely data delivery across our organization Pioneering developer tools that inject automation into data science processes, improving efficiency Delivering tailored data products, designed to empower users with self-serve capabilities and ensure accurate answers to their data queries.Contract Duration: 6-MonthsRequired Skills & Experience
Data Modeling: Understanding of best practices for data modeling, including star schemas, snowflake schemas, and data normalization techniques.
ETL/ELT Processes: Experience in designing, building, and optimizing ETL/ELT pipelines to process large datasets.
Apache Airflow: Experience in building, deploying, and optimizing DAGs in Airflow.
Python and SQL: Must be adept at scripting in Python, particularly for data manipulation and integration tasks, and have a solid grasp of advanced SQL techniques for querying, transformation, and performance optimization.
GitHub: Experience with version control, branching, and collaboration on GitHub.
Data Visualization: Knowledge of tools like Superset, Looker or Python visualization libraries (Matplotlib, Seaborn, Plotly…etc) Collaboration and Communication: Ability to work closely with data scientists, analysts, and other stakeholders to translate business requirements into technical solutions. Strong documentation skills for pipeline design and data flow diagrams.
Desired Skills & Experience
Proficiency in constructing, refining, and managing data pipelines specific to marketing platforms and channels.
Experience in the marketing data pipeline and third party tools integration.
Familiarity with email management platforms and tools like Iterable and understanding of the data structures that support email targeting.
Familiarity with Docker, Kubernetes, and cloud platforms like AWS/GCP Knowledge of fundamental DevOps practices, including unit testing and repository management.
Data governance experience preferred but not required Some knowledge of ML, AI, or NLP
What You Will Be DoingDaily ResponsibilitiesData modeling:
Build and refactor data marts to enhance data discovery and accuracy.
Design, architect and maintain a marketing data mart.
Introduce automation mechanisms to enforce data best practices and optimal design principles where possible
Data pipeline development and optimization:
Develop new data pipelines and ETL processes, and enhance the efficiency of existing ones to reduce cost and improve landing times and SLAs.
Transition data pipelines to dbt and create features that allow data scientists to utilize the platform.
Build scalable systems:
Build systems to automate monitoring and alerting for data anomalies Build internal data products aimed at streamlining workflows, minimizing manual interventions and driving operational efficiencies.
Collaboration:
Collaborate closely with data scientists and other stakeholders to ensure alignment on data needs and deliverables.
Maintain clear and comprehensive documentation of processes to facilitate smooth team collaboration and hand-offs
You will receive the following benefits:
Medical Insurance - Four medical plans to choose from for you and your family
Dental & Orthodontia Benefits
Vision Benefits
Health Savings Account (HSA)
Health and Dependent Care Flexible Spending Accounts
Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
Hospital Indemnity Insurance
401(k) including match with pre and post-tax options
Paid Sick Time Leave
Legal and Identity Protection Plans
Pre-tax Commuter Benefit
529 College Saver Plan
Motion Recruitment Partners is an Equal Opportunity Employer, including disability/vets. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under Motion Recruitment Employment Accommodation policy. Applicants need to make their needs known in advance.Posted by: Angela SalvatoMotion Recruitment Partners is an Equal Opportunity Employer, including EOE Protected Veterans/Disability/Women. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment background screening including a criminal check. Accommodation will be provided in all parts of the hiring process as required under Motion Recruitment Employment Accommodation policy. Applicants need to make their needs known in advance.
