Big Data Engineer

Home / California / Sanfrancisco / Et cetera / Big Data Engineer

Big Data Engineer

04 Aug 2024
California, Sanfrancisco, 94101 Sanfrancisco USA
Report job

Big Data Engineer

Vacancy expired!

Big Data Engineer


About Tredence­: -
Tredence focuses on last mile delivery of insights into actions by uniting its strengths in business analytics, data science, and software engineering. The largest companies across industries are engaging with Tredence and deploying its prediction and optimization solutions at scale –empowering end users to improve decision making. Headquartered in the San Francisco Bay Area, the company serves clients in the US, Canada, Europe, and SE Asia. Learn more at www.tredence.com or follow us.

Responsibilities:
  • Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
  • Develop and maintain data pipelines implementing ETL process, monitoring performance and advising any necessary infrastructure changes.
  • Translate complex technical and functional requirements into detailed designs.
  • Investigate and analyze alternative solutions to data storing, processing etc. to ensure most streamlined approaches are implemented.
  • Serve as a mentor to junior staff by conducting technical training sessions and reviewing project outputs.
  • Roles & Responsibilities

Skills and Qualifications:
  • Strong understanding of data warehousing and data modeling techniques.
  • Proficient understanding of distributed computing principles - Hadoop v2, MapReduce, HDFS
  • Experience with building stream-processing systems, using solutions such as Storm or Spark Streaming
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
  • Experience with Spark, SQL, and Linux.
  • Knowledge of various ETL techniques and frameworks, such as Flume, Apache NiFi, or DBT.
  • Experience with various messaging systems, such as Kafka or RabbitMQ.
  • Good understanding of Lambda Architecture, along with its advantages and drawbacks

Qualifications:
Bachelor's and/or master’s degree

About you:
You are self-motivated, collaborative, eager to learn, and hands on
You love trying out new apps, and find yourself coming up with ideas to improve them
You stay ahead with all the latest trends and technologies
You are particular about following industry best practices and have high standards regarding quality

Why join Tredence?
There is a reason we are one of the fastest growing private companies in the country! You will have the opportunity to work with some of the smartest, friendliest, hardest working people in the data analytics space. You will work with the latest technologies and interface directly with the key decision stakeholders at our clients, some of the largest and most innovative businesses in the world. We offer a 401k match; full medical, dental and vision benefits, a fun team atmosphere and a work life balance. Our people are our greatest asset and we value every one of them. Come see why we’re so successful in one of the most competitive and fastest growing industries in

Related jobs

Job Details

  • ID
    JC17807008
  • State
    California
  • City
    Sanfrancisco
  • Job type
    Permanent
  • Salary
    $120,000 - $140,000
  • Hiring Company
    Tredence
  • Date
    2021-07-08
  • Deadline
    2021-09-06
  • Category
    Et cetera
  • Print

Jocancy Online Job Portal by jobSearchi.

Navigation
Vacancies
© Copyright 2024 jocancy.com. Developed by MicroPHP