AI Engineer

For one of our clients, we are looking for a Mid/Senior AI Engineer (m/f/n).

You'd work on a live LLM system with real users — not a proof of concept. We're looking for a Senior AI Engineer who can take an LLM-based feature from idea to production and then keep it accurate, fast, observable and efficient.

Tasks and responsibility

• Build LLM-powered features end to end. Design and implement agentic flows, retrieval, and tool calling using LangGraph — then ship them as FastAPI services with streaming, persistence and proper tests.

• Own answer quality. Build evaluation datasets, regression suites and LLM-as-judge checks so we know whether a prompt or model change made things better before it reaches users.

• Get the right context to the model. Turn user questions into effective queries against our search platform, orchestrate multi-step research loops, and shape the context the model reasons over. When an answer is wrong, work out whether retrieval, the query or the prompt is at fault — and fix the right one.

• Debug production. Instrument flows with tracing (Langfuse), investigate bad answers from real traces, and manage latency, token and cost budgets — including routing across model sizes and families behind an AI gateway.

Requirements

• Experience in building and operating backend services — APIs, async, testing.

• Hands-on experience taking LLM features to production and keeping them running — not only prototypes.

• Agent / orchestration frameworks. LangGraph ideally.

• Practical RAG experience.

• Experience debugging LLM systems in production — tracing, evaluation, cost and latency.

• Experience running services in the cloud (we're on Azure).

• Strong problem-solving skills, analytical thinking, and technical decision-making.

• Fluent in English, proactive communicator, and a collaborative team player.

• Open-minded, creative, and motivated to push boundaries in AI and automation.

Tech stack

• Python

• FastAPI

• LangGraph

• Azure OpenAI, Google Gemini, Anthropic Claude

• FAISS

• PostgreSQL

• Langfuse

• Azure App Insights

• Bicep

• Docker / Podman

Nice to have

• Azure OpenAI, AI Search, App Service

• Infrastructure-as-code (Bicep)

• Mentoring or tech-lead experience

What We Offer:

• Rate: 175 PLN/H net + VAT

• B2B contract via SHIMI

• Location: Remote

• Availability: ASAP

• Long-term engagement