Test Automation Engineer

We are looking for an experienced Senior Test Automation Engineer to take ownership of QA for a complex solution combining data processing, AI, and optimization components. The system processes diverse and often incomplete input data, with some components producing non-deterministic results and others relying on mathematical optimization. The solution includes backend and frontend components, automated data pipelines, and PDF generation, creating an interesting mix of functional, integration, performance, and quality challenges. This is a hands-on senior role where you will shape the QA strategy and automation approach, define quality standards, and help ensure reliable releases.

What You Will Do:

• Own and evolve the QA strategy, including test levels, risk-based testing, environments, test data, defect classification, and release criteria.

• Design and develop automated tests in Python using pytest, covering APIs, integrations, data pipelines, and batch processing.

• Build frontend automation with Playwright or a comparable tool, integrate automated tests into CI pipelines, and develop PDF regression testing, including visual comparison and PDF/X-3 validation.

• Create synthetic and rule-based test data, cover data quality issues and edge cases, and apply property-based testing approaches such as Hypothesis.

• Design and execute performance and volume tests, including parallel processing, analyse runtime and quality metrics in Grafana, and test scaling in AWS EKS.

• Perform exploratory and release testing, monitor quality trends and regressions, and optionally explore AI-assisted testing, including LLM-based automation..

Requirements:

• Senior-level QA experience, including previous ownership of QA in at least one project.

• Hands-on experience independently creating and implementing a test concept/test strategy.

• Strong Python and pytest test automation skills.

• Experience configuring and maintaining automated tests in CI pipelines.

• Strong experience testing backend and data-oriented systems, including APIs, integrations, data pipelines, and batch processing.

• Experience generating synthetic or rule-based test data.

• Experience with runtime, performance, and volume testing of backend or batch systems, including parallel processing.

• Ability to design performance scenarios, define relevant metrics, and analyse bottlenecks.

• Frontend test automation experience with Playwright or a comparable tool.

• Manual and exploratory testing experience.

• Practical knowledge of defect classification, severity levels, and release criteria.

• Fluent English.

Nice to have

• Experience testing AI/ML/LLM systems, including evaluating non-deterministic outputs.

• Knowledge of Langfuse or similar tools.

• Experience building AI-supported test agents or LLM-based test automation.

• Experience with property-based testing.

• Experience testing optimization or planning systems.

• Experience with PDF validation or print materials.

• Publishing or media industry experience.

• German language skills.

Benefits:

• Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.

• Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.

• Global collaboration - work with a diverse, international team.

• Innovative environment - be part of a forward-thinking and growth-oriented workplace.

• Engaging community – Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.

• Team-building events including our company tradition (annual company event in Mazury). A pleasant surprise to start your journey with us in the form of a welcome pack.