Big Data Engineer

Big Data Engineer

Vacancy expired!

Big Data Engineer (Big Data, Spark, Python, AWS, Nifi, Airflow) Location - Beaverton OR, ok with remote for now Need 8+ years experience Profiles without these skills will not be considered: Big Data, Spark, Python, AWS, Nifi, Airflow

• Good knowledge in Python/Apache Spark/Data Management Experience with relational SQL (Snowflake or Teradata or Oracle)
• Strong problem solving and analytical mindset
• Experience building scalable real time and high-performance cloud data lake solutions
• Hands on coder who understands the concepts behind distributed databases batch and stream processing
• Experience building and shipping data production pipelines sourcing data from a diverse array of sources
• Experience with Nifi and Airflow Experience working on NoSQL databases such as Hbase and DynamoDB
• Understanding on Rest API Ability to influence and communicate effectively with team members and business partners
• Experience with source control tools such as GitHub and related dev process
• Experience with workflow scheduling orchestration tools
• Hands-on experience of cleaning preparing and optimizing data for ingestion and consumption