Vacancy expired!
RESPONSIBILITIES:
Kforce is working with fast growing adtech firm located in New York, NY and we are seeking a Data Engineer. We create best of breed consumer search technology using cutting-edge architectures with millisecond response time and crunch through terabytes of data every day. The ideal candidate is motivated to design for massive scale, developing for low latency and pushing the boundaries of using real-time data in automated decisions. Our team uses a modern tech stack including Kafka, Spark, Scala, Akka, Java8+, NoSQL, Kubernetes, Docker, AWS, Azkaban, and Airflow.
Responsibilities:
Hands-on development and maintenance of ad-tech related data systems and system components using Java and other software technologies
Data streaming, processing, and aggregation solutions
Data-driven applications
24/7 low latency large-scale distributed systems
Cloud migration and containerization projects
Clients integration automation components (Google, Amazon, LiveRamp)
Data Engineer will work with team for technical implementation of Data Engineering projects, including data streaming and aggregation pipelines
Work closely with QA, DevOps, and other engineering teams to integrate, test, and release different system components (all stages of SDLC)
As a Data Engineer, you will solve complex technical challenges related to low latency large scale distributed systems
Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions
REQUIREMENTS:
BS in Engineering, Computer Science, or related discipline
Must have 3+ years strong hands-on development experience using Java (Java 8+ preferred)
Experience with big data and streaming technologies like Apache Kafka, Apache Spark, Confluent Platform, Apache Storm, Hadoop, and Zookeeper
Experience developing, delivering, and maintaining scalable data streaming and aggregation pipelines
Experience with relational SQL and NoSQL databases
Ability to collaborate with multiple teams and understanding testing, hardware, and deployment methodologies
Good understanding of object-oriented design patterns and effective use of data structures
Familiarity and hands-on experience with profiling, code efficiency, and testing/release concepts
Experience working in a Linux environment
Experience building software in continuous integration and delivery fashion in an automated way
Excellent documentation, communication, and troubleshooting skills
Is a plus:
Experience with data pipeline and workflow management tools like Airflow, Luigi, Azkaban
Experience with AWS, RabbitMQ, MySQL, Vertica, and Aerospike
Experience with Spring or another dependency injection framework
Familiarity with Docker, CI/CD and Microservices
Scala and/or Python development experience
Experience working in an agile software development team using Jira
Digital advertising industry experience
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
