Senior MLOps Developer with AWS AgentCore Runtime

Technologies we use

Expected

• AWS
• Amazon EKS

Optional

• LangChain

About the project

The AI Platform project is centered on building a reliable versioning model for LLM agents as immutable deployment units.

It supports controlled release workflows, evaluation based promotion gates, and rollback patterns to help maintain quality and consistency across environments.

This is how we organize our work

Team size

20+

This is how we work

• you focus on a single project at a time
• you have influence on the technological solutions applied
• you focus on product development

Team members

• backend developer
• technical leader
• data scientist

Your responsibilities

• Develop immutable versioning workflows for agent container images, prompt configuration, tool bindings, and policy associations as a single deployment unit.
• Design and maintain CI/CD pipelines with evaluation gates for AI systems before promotion to production.
• Implement agent promotion workflows across development, QA, and production environments.
• Support rollback patterns for agent versions and validate that restored versions continue to work as expected.
• Manage AWS ECR image practices including ARM64 tagging, lifecycle policies, and image signing for agent immutability.
• Integrate agent versions with a registry and maintain metadata such as evaluation results and promotion status.
• Collaborate on endpoint management patterns for default and named runtime endpoints.

Our requirements

• 5+ years of MLOps or DevOps engineering experience with AI or ML systems.
• Experience with versioning and lifecycle management for LLM agents or ML models.
• Experience with immutable artifact versioning at enterprise scale using ECR or model registries.
• Experience designing CI/CD pipelines with quality gates for AI systems.

Optional

• Hands on experience with AWS AgentCore Runtime versioning.
• Experience with agent evaluation frameworks such as Langfuse, LangSmith, or PromptLayer.
• Experience with multi environment agent promotion patterns.
• Experience with agent version comparison and regression detection.

This is how we work on a project

• code review
• Continuous Deployment
• Continuous Integration
• technical debt management
• integration tests
• regression tests
• test automation

Development opportunities we offer

• mentoring
• technical knowledge exchange within the company

DataArt Poland sp. z o.o.

DataArt’s Data & Analytics team designs and implements modern data and analytics solutions for mid- and large-sized organizations. Operating remotely and in numerous R&D centers, our Center of Competence drives innovation in data and big data, ensuring rapid expansion of domain expertise and greater customer satisfaction.