Sr Data Engineer (100% Remote)

Sr Data Engineer (100% Remote)

Vacancy expired!

About Us
Tachyon Technologies is a Digital Transformation consulting firm that partners with businesses to implement customer-focused business transformation. Tachyon Technologies understands what it takes for a consulting partner to be effective and strives to deliver a meaningful solution that exceeds its clients' expectations.

Role: Sr Data Engineer
Location: Milpitas, CA
Duration: Long Term
JD:

Required

• 5+ years of relevant experience in the field of Data Engineering
• Bachelor's in Computer Science or related disciplines
• Knowledge of Data Structures and Algorithm.
• Strong Python programming skills with ability to implement OOPs and functional programming. Knowledge of Scala/Java would be plus.
• Strong knowledge on RDBMS and NoSQL databases with the ability to implement them from scratch. Knowledge of Graph databases will be a plus.
• Strong expertise in building & optimizing data pipelines, architectures, and data sets.
• Experience working with different file formats like Parquet, ORC, Avro, RC, etc.
• Experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.
• Experience building ETL pipelines using ETL tools like Informatica, TalendD, Pentaho, etc.
• Knowledge and experience of using orchestration frameworks like Airflow, Oozie, Luigi, etc.
• Experience using Spark, and building jobs using Python/Scala/Java.
• Experience or Knowledge building stream processing platforms using Spark Streaming, Storm, etc. Knowledge of Kafka/Flink+Beam would be plus.
• Knowledge of building REST API end points for data consumption.
• Excellent oral and written communication is a must.

Preferred

• Master's in Computer Science or related disciplines
• Experience building self-service tools for analytics would be plus.
• Knowledge of ELK stack would be a plus.
• Knowledge of implementing CI/CD on the pipelines is a plus.
• Knowledge of Containerization (Docker/Kubernetes) will be plus.
• Experience working with one of the popular Public Cloud based platforms is preferred

Tachyon's full-time employees receive complete and competitive benefits. We offer a collaborative work environment, competitive compensation, generous work/life opportunities, and an outstanding benefits package that includes paid time off plus holidays. In addition, all colleagues are eligible for a number of rewards and recognition programs. Encouraging a healthy work/life balance and providing our colleagues with great benefits are just part of what makes Tachyon a great place to work.

A disclaimer: The above statement is not a complete job description. The Client retains the discretion to add or change the duties of the position at any time.