AI Test Engineer (f/md)

Tasks

• Design, implement, and maintain testing strategies for AI-powered applications and machine learning systems

• Evaluate AI model performance, accuracy, robustness, and reliability across different use cases

• Identify system weaknesses, edge cases, biases, hallucinations, and security vulnerabilities

• Develop automated test frameworks and quality assurance processes for AI solutions

• Collaborate closely with AI Engineers, Product Managers, and Software Developers throughout the development lifecycle

• Analyze datasets and outputs to ensure compliance with quality and ethical standards

• Support continuous improvement of AI systems through structured feedback and testing insights

• Document testing methodologies, findings, and recommendations for internal and external stakeholders

• Contribute to establishing best practices for responsible and trustworthy AI within public administration environments

Requirements

• Degree in Computer Science, Software Engineering, AI, Data Science, or a related field

• Experience in software testing, quality assurance, or AI/ML system evaluation

• Strong understanding of machine learning concepts, AI system behavior, and testing methodologies

• Familiarity with automated testing tools, scripting languages, and test frameworks

• Experience analyzing model outputs, performance metrics, and potential biases

• Understanding of security, privacy, and compliance considerations in AI applications

• Strong analytical thinking and problem-solving skills

• Excellent communication skills and the ability to work in interdisciplinary teams

• Fluent in English; German is a plus