AI Architect – Production LLM Systems (Azure)

15 May 2026

AI Architect – Production LLM Systems (Azure)

As an AI Architect, you will lead the architectural evolution of Oscar, our enterprise AI platform used across the organization. This is a highly technical, hands-on role focused on building secure, observable, production-grade LLM systems at scale.You will define the architectural runway for future capabilities like agent orchestration, tool-use frameworks, and enterprise data integration while staying deeply engaged in technical spikes, design reviews, and delivery execution.This role sits at the intersection of LLM engineering, Azure cloud architecture, and real-world enterprise deployment.

This position will offer flexibility for hybrid work schedules to include both in-office presence and telecommute/virtual work, to be based from either Houston or Dallas, TX.

Key ResponsibilitiesDefine and evolve the AI architecture roadmap for Oscar, building scalable patterns for LLM integration, RAG pipelines, and agent-based workflowsArchitect and optimize production-grade RAG systems, including retrieval strategies, embedding design, vector search tuning, and model orchestration in AzureLead technical spikes and convert prototypes into secure, production-ready implementationsEstablish observability, alerting, cost efficiency, and performance standards for AI services operating at enterprise scaleMentor engineers through Sprint execution, conduct design and code reviews, and elevate overall engineering qualityEvaluate emerging AI frameworks (e.g., MCP, orchestration patterns) and introduce practical innovations aligned to product roadmap needs

Jocancy Online Job Portal by jobSearchi.