Vacancy expired!
RESPONSIBILITIES:
Kforce has a client in NYC that is seeking a Data Engineer - Data Lake.
Job Responsibilities of the Data Engineer include:
Operationalize our data lake platform built on S3 and Dremio
Optimize our data lake storage, leveraging file compaction and archiving strategies
Create and maintain our data catalog
Implement a layered architecture to enable self-service business intelligence and data science initiatives while maintaining query performance
In this capacity, you will be hands-on in the design and implementation of our new platform while working in a small, cross-functional team
REQUIREMENTS:
Strong expertise in advanced data modeling, schema and ETL process design, implementation and maintenance
Experience with numerous Data Lake and Analytics technologies (Dremio preferred, Snowflake, AWS Athena, Presto)
Strong knowledge of Data Lake best practices
Strong background in advanced SQL and focused on understanding, manipulating, processing and extracting values from large datasets and data streams
AWS experience (Glue, Lambda, Fargate)
Scripting and coding experience (Python, Typescript)
Experience with different variety of data types (JSON, Parquet, Excel, Flat files)
Experience with databases and data stores including: Microsoft SQL, Postgresql, Elasticsearch, Mongo, AWS S3
Candidates qualifying for this position will have similar experience along with the skills and abilities to perform the duties mentioned
Any relevant education and/or training will be considered a plus
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
