Designs and develops multiple, diversified applications using big data platform leveraging hybrid clouds. These applications are primarily consumed for parsing, analyzing, discovering, and visualizing the potential business insights.
Works with critical data stake holders and technical teams for optimal solutions and service delivery. Provides strategic, tactical direction in the delivery of big data solutions
Works with various cross functional teams such as infrastructure, data and enterprise architects to build scalable, optimal, self-service analytics solutions, both on premise and in the cloud.
Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows.
The ability to apply such methods to solve business problems using one or more Azure Data and Analytics services in combination with building data pipelines, data streams, and system integration.
Assists in developing evaluation of emerging and/or new firm solutions for business/technology/security fitment.
Can code/decode advanced algorithms and trouble shoot to build high-performance, parallel, and distributed solutions. Ensures the design, code, and procedural aspects of solution are production ready, in terms of operational, security and compliance standards.
Applies innovation, problem solving and best practices to create and execute road maps that improve efficiencies, agility, performance, stability, and lower TCO.
Applies technical expertise to configure and tune technical environments. Continually optimize the data pipe with automation, and tools with the latest DevOps and Agile methodologies to improve cycle times, consistency, and quality.
Participates in day to day project and production delivery status meetings and provide technical support for faster resolution of issues.
Strong team collaboration and experience working with geographically distributed team.
Qualifications
Bachelor's degree in Computer Science, Mathematics, or Engineering
7+ years of experience in Data and Analytics and Data Integrations
5+ years of experience in big data stack and solutions, including cloud technologies
5+ years of designing, implementing and successfully operationalizing large-scale data lakes solutions in production environments using Big data Stack (On-prem and Azure)
3+ years of experience in architecting and implementing end to end Azure cloud big data solutions.
3+ years of experience implementing Real-time Solutions & data integrations
Experience with Big Data Management Tool (Zaloni) is a Plus.
Hands on experience with building, optimizing the data pipe CI/CD, integrated - build and deployment automation, configuration management, test automation solutions.
Professional training and certifications in various big data solutions (Preferred).
Solid understanding of Azure Cloud Stack including ADF Data flows, Event Hub, Databricks, HDInsight, Azure DevOps
Deep hands on experience with Hadoop, HIVE, HBase, Spark, Kafka, Snowflake, Python, R, SQL, Java, Scala, Zeppelin, RStudio, Spark RDDs and Data Frames, Ambari, Ranger, Kerberos, Atlas and Collibra etc.
Informatica MDM, BDQ, BDM, ETL architecture experience is a Plus
Communication and presentation skills, to articulate functionality, issues and risks with business communities
