SENIOR AI PRODUCT ENGINEER (1043) - DEPARTMENT OF TECHNOLOGY

We are a small, mission-driven Emerging Technologies team leading responsible AI adoption across City government within DT.

We work on:

1. Testing and making AI tools available to other departments,
2. Setting technical standards for safe and responsible AI use, and
3. Building and experimenting with prototypes that demonstrate the potential of applied AI

As our AI Product Engineer, your primary focus will be designing and building prototypes that showcase how AI can solve real challenges in government. You’ll create end-user applications that surface retrieval-augmented generation (RAG) and LLM features, making them usable, transparent, and trustworthy.

Because we are a small team, you’ll also need to flex into other areas: contributing to standards, supporting tool evaluations, and helping translate AI’s potential to departments across the City. This role is hands-on, creative, and highly collaborative — ideal for someone who enjoys working at the intersection of technology, product, and impact.

Position Responsibilities

• Prototype and ship applied AI tools (chat interfaces, knowledge assistants, workflow integrations) that demonstrate new use cases for City departments.
• Design and implement front-end applications to surface RAG/LLM outputs with transparency and usability
• Collaborate with the team to connect prototypes to retrieval pipelines, APIs, and model orchestration.
• Experiment rapidly: run pilots, gather feedback from staff, and iterate on features to improve adoption.
• Flex into other areas of the team’s mandate as needed — contributing to tool evaluations, standards-setting, and AI adoption guidance.
• Help make technical choices that balance innovation, safety, and responsible use in a public sector context.