Candidate MUST be eligible to work on W2. Description:Data team is looking for a Data Engineer to join our Data Engineering (DE) team which is responsible for building our data lake, maintaining our data pipelines / services and facilitating the movement of large data each day. We work directly with business teams and platform and engineering teams to ensure growth strategies. You are an out-of-the-box, structured thinker who is passionate about building services that scale. You will play a key role in providing the end-to-end data engineering solutions to support key business initiativesOn a typical day you will help our partner teams ingest data faster into our data lakes while maintaining Data Governance and Compliance standards, find ways to make our data products more efficient, or innovate ideas to help build self-serve data engineering within the company. You will also build micro-services, architecting, designing, and promoting self-serve capabilities at scale to help us grow.ResponsibilitiesAs a data engineer in the DE team, you will apply your strong technical experience building highly reliable services on managing and orchestrating multi-terabyte scale data lakes and implement a Data Mesh architecture, working closely with the Data Architecture/Modeling team. You enjoy working in an agile environment and are able to take vague requirements and transform them into solid solutions. You are motivated by solving challenging problems, where innovation, problem-solving, and creativity is as important as your ability to write code and test cases.Minimum Qualifications and Expectations: At least 3 years (5 or 10 based on level) of professional experience as a software engineer or data engineer A BS in Computer Science or equivalent experience Strong programming skills (some combination of Python, Java, and Scala) Experience writing SQL, structuring data, and data storage practices Experience NoSQL databases like Mongodb and Cassandra Experience with data modeling Knowledge of data warehousing concepts Experienced building data pipelines and micro services Experience with Spark, Kafka, Flink, Hive, Airflow and other streaming and data pipeline technologies to process large volumes of streaming data Experience working on Amazon Web Services (in particular using EMR, Kinesis, RedShift, S3, SQS and the like) Experience with object-oriented/object function scripting languages: Python, Java, C, Scala, etc. An open mind to try solutions that may seem impossible at firstIt's preferred, but not technically required, that you have: Experience building self-service tooling and platforms Built and designed Data Mesh architecture platforms A passion for building and running continuous integration pipelines. Built pipelines using Databricks and well versed with their API’s Contributed to open source projects (Ex: Operators in Airflow)Skills:python, scala, sql, nosql, data modeling, data warehousing, Spark, kafka, flink, hive, airflow, AWS web servicesTop Skills Details:python,scala,sql,nosql,data modeling,data warehousing,Spark,kafka,flink,hive,airflow,AWS web servicesAbout TEKsystems: We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company. The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.
