A client of ours in New York City NY is looking for a Big Data DevOps Engineer for a Contract opportunity.
Description:
looking for Data Platform Engineer Data Engineering with 7+ years of proven industry experience; Masters or bachelor's degree in IT or related fields.
Mandatory skills:
Java
microservices
spring boot
SQL
Azure & good to have python as well.
Primary Responsibilities:
Part of a team to deliver API platforms, Use API Management platform to design and implement requirements of the API layer. Such as policies that will cover security, caching, limits, logging, request, and response modifications
Harness modern application best practices with code quality, API test Coverages, Agile Development,DevOps, and Observability and support.
Maintain programming standards and ensure the usage of the pattern / template for API Proxy.
Design and implementation of data pipeline solutions that improve data engineer productivity for onboarding data, while maintaining accuracy and joinability.
Conduct code reviews and automatic test coverage
Standardize the CI/CD setup for API management tools and automated deployment.
Utilize problem-solving skills to help your peers in the research and selection of tools, products, and frameworks (which is vital to support business initiatives)
Responsible for large data API requests and security of API consumption
Ensuring stability of API and APIM performance and maintain SLAS
Implement OAuth Okta integration for communication between API producers and consumers.
Qualifications & Experience:
7+ years of proven industry experience; Masters or bachelor's degree in IT or related fields
Hands-on development expertise in Java, Python, GraphQL, SQL, Junit, Spring Boot, OpenAPI, Spark, Flink, Kafka
Experience working in cloud data platforms such as Azure, Snowflake, Yellowbrick, Singlestore, GBQ
Understanding of Databases, API Frameworks, Governance Frameworks, and expertise in hosting and managing platforms like: Hadoop, Spark, Flink, Kafka, SpringBoot, BI Tools like Tableau, Alteryx, Governance Tools like Callibra, Soda, Amazon DeeQu
Strong understanding of Twelve-Factor App Methodology
Solid understanding of API and integration design principles and pattern experience with web technologies.
Design object-oriented, modularized, clean, and maintainable code and creating policies in Java, JavaScript, Node JS, Python etc.
Experience implementing requirements of the API layer like security, throttling, OAuth 2.0, TLS, certificates, Azure KeyVault, caching, logging, request, and response modifications etc. using API management platform.
Experience creating custom policies in XML, Java, JavaScript, Node JS, Python etc. in API management platform.
Experience with test-driven development and API testing automation.
Demonstrated track record of full project lifecycle and development, as well as post-implementation support activities
Significant experience of designing, deploying, and supporting production cloud environments like Azure and Kubernetes
Experience with Azure DevOps CI/CD Tools to build and deploy Java/API packages and API deployment automation.
Hands-on experience in designing and developing high volume REST using API Protocols and Data Formats.
Additional Qualifications:
Financial experience: Public and Alternatives Asset Management
Familiar in NoSQL\NewSQL databases
Working with Azure API and DB Platforms
Strong documentation capability and adherence to testing and release management standards
Design, development, modification and testing of databases designed to support Data Warehousing and BI business teams
