Applied AI Engineer II
Blitz · Bengaluru, India
Blitz is hiring an Applied AI Engineer II to ship production AI agents end-to-end, building conversational and workflow agents, evaluation systems, and shared platforms.
What you will do
- Build conversational agents: chat and voice agents that resolve real user queries in production, at scale.
- Build workflow agents: agents that take on multi-step operational tasks, call tools and systems, and know when to hand off to a human.
- Build evaluation systems: the eval sets, graders and monitoring that tell us whether an agent is working and getting better.
- Build shared agent platform: reusable harnesses, tool integrations, context and memory patterns that make each new agent faster to ship than the last.
- Own agents end to end: scope the problem with the team that has it, design the prompts, tools and context, ship to production, and keep improving it.
- Ship fast and in parallel. Expect to take a new agent from idea to live pilot in weeks, and to run several at once.
- Treat evals as core craft: define success metrics, build eval sets from production data, and gate every prompt or model change on them.
- Monitor agents after launch: read transcripts and traces, find failure patterns, and fix them at the root.
What you need
- 2-5 years of software engineering, with at least one LLM agent shipped to real users and run in production.
- Strong Python, and solid backend fundamentals: APIs, queues, databases, cloud deployment.
- Hands-on agent craft: prompt and context design, tool calling, retrieval, multi-step workflows, and handling non-deterministic failures.
- Eval discipline: you have built eval sets, used LLM-as-judge or human review, and can show how a change moved a metric.
- Heavy daily use of AI coding tools to move at several times normal speed.
- A track record of picking up new technology fast and comfort with ambiguity.
- Clear written communication and ease working with non-technical teams.
Good to have
- Voice agent experience: speech-to-text, text-to-speech, telephony, latency tuning.
- Work with multilingual or Indic-language models.
- Fine-tuning or serving open models for cost and latency.
- Experience building in a high-volume operations or consumer business.
Eligibility
- 2-5 years of software engineering experience.
How to apply
- Apply through the job portal and submit your resume.
- Participate in the screening, AI interview, assignments, and interviews hiring process steps.