Job DescriptionA streaming client is in need of hiring a unique candidate who is a true Data Engineer who not only understands data and has the technical background, but also someone who has a 'quality engineering and testing mindset'. You will be responsible for validating all streaming-related data for subscriber info (etc.), from this client's multiple streaming platforms. You will be required to attend team/scrum meetings and sprint stand ups and planning sessions. You will use automation while doing ETL validations (i.e. the ETL is already built by a different team), so you will be responsible for validating the ETL and adhere to standards. You must also know write queries as well as test your own scripts/queries. In addition, this team is really looking for a candidate who is passionate about learning, is collaborative, and has excellent communication.Skills and Requirements-3-5 years of experience as a Data Engineer with ETL validation experience (this team is looking for a true Data Engineer with a 'Quality Engineer mindset')-Strong background in SQL-Big data processing experience/ experience working with large data processes/amounts of data-Experienced in Python programming-Understanding of business logic validations-Big data experience (Hadoop, Spark, Hive - any is fine)-Experience working in a Scrum environment -Previous experience working in the streaming industry-Snowflake experience-Databrix experience-AWS experience nullWe are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.
