Responsibilities
- Design and build enterprise-scale AI systems, including custom Retrieval-Augmented Generation pipelines and autonomous agent workflows that meet high-performance institutional standards.
- Develop and oversee MLOps and continuous integration/continuous deployment pipelines using platforms like GitHub Actions or GitLab, making key decisions on infrastructure code for model lifecycle management.
- Assess and choose foundational AI models and deployment environments, weighing open-source versus proprietary options and cloud versus on-premise hosting to optimize resource use and cost.
- Serve as the lead expert in AI security, applying the OWASP Agentic AI framework to detect and address emerging threats such as prompt injection and flawed plugin architectures.
- Define and enforce Model Context Protocol (MCP) standards to ensure consistent, secure access to institutional data by AI applications.
- Implement secure authentication mechanisms using OIDC, OAuth2, and SAML to ensure AI agents operate within defined user permissions and prevent data leaks.
- Perform threat modeling for new AI integrations, acting as the final technical reviewer for high-risk projects involving sensitive or protected information.
- Set observability benchmarks for AI systems by deploying OpenTelemetry and tracing tools like Langfuse or MLFlow to monitor unpredictable agent behavior and system latency.
- Create comprehensive evaluation frameworks to assess model accuracy, hallucination rates, and bias, establishing performance baselines for all internal AI tools.
- Address novel technical issues arising from stochastic system behavior, serving as the top-tier support for debugging and performance tuning.
Work Arrangement
On-site
Other
- Closing Date: 03/17/2026, 11:59PM ET
- Employee Group: USW
- Appointment Type: Budget - Continuing
- Schedule: Full-Time
- Job Category: Information Technology (IT)
- Recruiter: Khristen Sivaramalingam
- Lived Experience Statement: Candidates who are members of Indigenous, Black, racialized and 2SLGBTQ+ communities, persons with disabilities, and other equity deserving groups are encouraged to apply, and their lived experience shall be taken into consideration as applicable to the posted position.
