Vacancy expired!
RESPONSIBILITIES:
Kforce has a client seeking a Senior Data Engineer in Hillsboro, OR.
With a commitment to innovation, this client employs some of the world's top engineers and designers! It was ranked as one of the 'Happiest Companies to Work For' and awarded an 'Employees' Choice Award 2018 Best Place to Work' by Glassdoor. Its culture thrives by embracing diversity and rewarding imagination. If you would like to make a difference globally and locally, apply now.
Responsibilities:
Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile/Scrum methodology
Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
Translate product backlog items into engineering designs and logical units of work
Profile and analyze data for the purpose of designing scalable solutions
Define and apply appropriate data acquisition and consumption strategies for given technical scenarios
Design and implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
Implement complex automated routines using workflow orchestration tools
Work with architecture, engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to
Anticipate, identify and solve issues concerning data management to improve data quality
Build and incorporate automated unit tests and participate in integration testing efforts
Utilize and advance continuous integration and deployment frameworks
Troubleshoot data issues and perform root cause analysis
Work across teams to resolve operational & performance issues
REQUIREMENTS:
5+ years of experience in large-scale software development, 3+ years of big data experience
Experience with Scala or Java
Experience working in a public cloud environment, particularly AWS, and with services like EMR, S3, Lambda, ElastiCache, DynamoDB, SNS, SQS, etc.
Familiarity with cloud warehouse tools like Snowflake
Experience building RESTful API's to enable data consumption
Familiarity with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI
Familiarity with practices like Continuous Development, Continuous Integration and Automated Testing
Experience in Agile/Scrum application development
MS/BS in Computer Science, or related technical discipline
Strong programming experience, Python preferred
Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.
Experience with messaging/streaming/complex event processing tooling and frameworks with an emphasis on Spark Streaming or Structured Streaming and Apache Nifi
Good understanding of file formats including JSON, Parquet, Avro, and others
Familiarity with data warehousing, dimensional modeling, and ETL development
Experience with RDBMS systems, SQL and SQL Analytical functions
Experience with workflow orchestration tools like Apache Airflow
Familiarity with data warehousing, dimensional modeling, and ETL development
Experience with performance and scalability tuning
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
