Role: Sr. Data Bricks Architect Engineer Location: United States/Remote Job Type: Full time This role is 75% hands-on coding and 25% architecting Big Data and BI solutions. You must have at least five years of hands-on Azure expertise in designing, developing scalable multi-tenant Big Data and machine learning products using Azure Data Lake Gen2, Azure Databricks, Power BI, Data Pipelines for near real-time data analytics and machine learning, and near real-time Azure SQL cloud-based data warehouse. The ideal candidate will be an expert with 10 years of hands-on experience in designing, implementing, and delivering into production, large scale near real-time data warehouse. The Senior Azure Data Architect is expected to evangelize and educate others on the engineering design and development standards. Senior Azure Data Architect is expected to function as a productive member of a team, working and communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers. The ideal candidate is an exceptional critical thinker that is adept at solving complex problems and designing and developing elegant business solutions Essential Functions
Design and develop data pipelines
Design and develop Azure ML model execution architecture
Design and develop methods for handling 3rd party data for use within ML models
Evangelize engineering design and development standards
Acts as a key contributor to the design and development lifecycle of analytic applications utilizing Microsoft Azure and BI technology platforms
Participate in Agile ceremonies including daily stand-ups, sprint planning, retrospectives, and product demonstrations
Produce efficient and elegant code that meets business requirements
Author unit tests that adhere to code coverage guidelines
Proactively communicate progress, issues, and risks to stakeholders
Accurately estimate assignments
Create and maintain technical documentation
Mentor less experienced engineers
Contribute to the growth and maturity of the Software Engineering group
Performs other related duties as directed
Required Skills & Competencies
5 years of hands-on experience designing and implementing multi-tenant solutions using Azure Databricks for data governance, data pipelines for near real-time data warehouse, and machine learning solutions
10 years of extensive, hands-on experience designing and implementing large scale multi-tenant distributed data architecture for BI and OLTP systems
5 years of hands-on experience designing and developing multi-tenant solutions using Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow
10 years of advanced hands-on experience designing and implementing large scale multi-tenant data pipeline (TB or PB in size) including Change Data Capture (CDC) solutions for structured, semi-structured, and unstructured data in batch and real-time environments
5 years of hands-on experience in Azure services including Azure SQL Database, Azure Databricks, Azure Analysis Services, Azure ML Services, and Azure Synapse Analytics
5 years of hands-on experience with data integration using ETL / ELT tools (e.g., SSIS, Azure Data Factory, Airflow)
Advanced knowledge of Python programming
Expert in data modeling
Broad experience in Microsoft SQL technologies including SSAS Tabular models, DAX, T-SQL, Service Broker, Replication, and Performance Tuning
Broad multi-tenant data architecture and implementation experience across different data stores (e. g., Azure Data Lake GEN2, Azure SQL Data Warehouse, Azure Blob Storage, HDFS), messaging systems (e. g., Azure Event Hubs, Apache Kafka), and data processing engines (e. g., Azure Data Lake Analytics, Apache Hadoop, Apache Spark, Apache Storm, Azure HDInsight)
Experience with data integration through APIs, Web Services, SOAP, and/or REST services
Experience using Azure DevOps and CI/CD as well as Agile tools and processes including Git, Jenkins, Jira, and Confluence
Additional programming experience is a plus including experience with NET, Scala, R, Java
Must have demonstrated experience designing and implementing data pipelines for consumption by machine learning and BI solutions.
Knowledge of SOA and Micros Services Application Architecture
Ability to work in a fast-paced, collaborative team environment
Excellent written and verbal communication skills and ability to express ideas clearly and concisely
Education or Prior Work Experience
Bachelor's degree in CS or related field, master’s degree preferred
10+ years of experience with designing and developing complex data architecture solutions
5+ years of design and development experience with Microsoft Azure data architecture and related solutions (e.g., Azure Data Lake Gen2, Azure Data Factory, CDM, Event Hub, Azure Databricks, Synapse, Azure SQL DW)
Keywords: Azure Data Bricks Architect Engineer, Azure Data Bricks Engineer, Azure Data Bricks Architect, Azure Data Bricks Developer, Azure engineer, Azure Data Engineer, Senior Azure Data Bricks Engineer
Thanks & Regards, Merlin Antonita X E-Business International Inc. 4365 US Highway 1 South, Suite 212, Princeton, NJ 08540 Direct: Email:
