QA Engineer (Playwright and Python)

Experienced

Balkans

Remote

Wiser Technology is a leading software development company. Our team of 600 engineers across Europe excels in web and mobile software development, video streaming, defense, machine learning, automotive, e-commerce, and AI. We leverage top-tier technologies and expertise driven by a passion for innovation to drive progress.

You will be joining an initial team of engineers and QAs, responsible for knowledge transfer from the current client team. This role requires a self-starter who can work independently, proactively ask questions, and bring structure to the QA process.

WHAT YOU WILL DO:

Architect, design, and evolve scalable Playwright (Python) automation frameworks for web, API, and end-to-end testing, ensuring maintainability and extensibility.
Define automation strategy, test architecture, and quality gates, integrating test suites into CI/CD pipelines with robust reporting and failure analytics.
Lead test automation efforts across complex distributed systems, collaborating with engineering and DevOps to ensure reliability, performance validation, and production-grade quality standards.
Architect and implement automation frameworks using Playwright (Python) to validate AI-driven systems, including RAG pipelines, LLM integrations, and conversational workflows.
Design and maintain Golden Dataset–based evaluation suites to measure answer correctness, grounding (faithfulness to retrieved documents), hallucination detection, and regression across model versions.
Implement automated validation of RAG metadata (retrieved sources, chunk IDs), response latency monitoring, and quality metrics reporting integrated into CI/CD pipelines.
Collaborate with ML engineers and backend teams to define evaluation criteria, quality thresholds, and AI-specific test strategies for production-grade reliability.

WHAT YOU WILL NEED:

Strong experience with Python test automation (e.g., Pytest, Unittest, Behave).
Solid understanding of QA methodologies, test planning, and execution.
Experience building automation frameworks from scratch.
Hands-on experience with smoke testing, regression testing, and CI/CD test integration.
Ability to work with minimal documentation and quickly absorb domain knowledge.
Excellent communication skills and self-management abilities.
Strong problem-solving skills and attention to detail.

Nice to Have:

Experience with clinical, healthcare, or regulated environments.
Knowledge of PHP/React systems to support integration testing.
Familiarity with CI/CD tools (Jenkins, GitHub Actions, GitLab CI).

Key Success Factors

Ability to independently establish QA structure and automation in a greenfield environment.
Strong collaboration with cross-functional teams to bridge knowledge gaps.
Quick adaptability and ownership of QA processes.
Delivering reliable, repeatable test coverage to ensure product stability.

WHAT’S IN IT FOR YOU?

Culture & Development:

Friendly Environment: We take pride in our culture and love spending time together.
Team Spirit: Be part of a supportive team that uplifts each other.
Mentorship and coaching: Our colleagues are experts in their field, and you can expect to have a solid team to rely on.
Personalized Development Program: We realize that one size doesn’t fit all, so you'll receive an individual development plan tailored to your career aspirations.

Social Benefits:

Work Flexibility: Embrace flexible working hours and choose from remote, hybrid, or onsite work models. Multiple Office Locations: In Sofia, Plovdiv, Stara Zagora, and Nis, you can choose where you would like to work.
A Suite of Perks: Enjoy food vouchers, additional health insurance, sports cards, and more.
Community and Connections: Engage in exciting social events and team initiatives.

At Wiser, every role is instrumental. You will have the power to make a difference!

Ready to advance your career with a tech leader passionately driven by innovation?

Join Wiser - Become Wiser!