Python QA Automation Engineer - Banking

About Qualysoft

·25 years of experience in software engineering, established in Vienna, Austria·Active in Romania since 2007, with office in central Bucharest (Bd. Iancu de Hunedoara 54B)·Delivering End to End IT Consulting Services - From Team Augmentation and Dedicated Teams to Custom Software Development ·We deliver scalable enterprise systems, intelligent automation frameworks, and digital transformation platforms·Cross-industry experience by sustaining global players in BSFI (Banking, financial services and insurance), Telecom,Retail & E-commerce, Energy and Utilities, Automotive, Manufacturing, Logitics, High Tech·Global Presence: Switzerland, Germany, Austria, Sweden, Hungary, Slovakia, Serbia, Romania, and Indonesia·International team of 500+ software engineers·Strategic partnerships: Microsoft Cloud Certified Partner, Tricentis Solutions Partner in Test Automation and Test Management, Creatio Exclusive Partner, Doxee Implementation Partner·Powered by cutting-edge technologies: AI, Data & Analytics, Cloud, DevOps, IoT, and Test Automation.·Project beneficiaries ranging from large-scale enterprises to startups·Stable growth and revenue increase year over year, a resilient organisation in volatile IT market conditions·Quality-first mindset, culture of innovation, and long-term client partnerships·Global and local reach – trusted by key industry players in Europe and the US

Responsibilities:

• Establish and maintain automated frontend testing.
• Build API and integration test coverage for routers and database flows.
• Design and implement E2E tests with Playwright for critical user flows.
• Create stable mocking and fixture strategies (MSW, pytest fixtures, predefined test data).
• Configure quality gates in CI for linting, unit/integration/E2E tests, code coverage, and reporting.
• Extend coverage into non-test UI and workflow areas and prevent regressions.
• Build an LLM evaluation discipline with golden datasets and measurable quality gates.
• Track reliability of model outputs, detect drift, and condition releases on quality/stability thresholds.
• Improve test maintainability, eliminate flakiness, and optimize runtimes.

Qualifications:

3+ years in QA automation on production systems.
• Strong Python testing skills with pytest.
• Strong frontend testing skills.
• Experience building and maintaining E2E suites with Playwright/Selenium.
• Experience in API testing (REST, schema validation, authentication/error scenarios).
• Experience with SQL/PostgreSQL testing and test data management.
• Experience with CI/CD pipelines (GitHub Actions, Azure Pipelines or Jenkins).
• Practical understanding of testing non-deterministic outputs of LLM models.
• A plus
• Experience in performance and benchmark testing.
• Experience in WebSocket testing.
• Knowledge of security and dependency scanning.
• Experience in legal-tech, fintech or other regulated domains.
• Familiarity with LLM quality metrics (schema validity, hallucination tracking, consistency).
• Tech Stack
• Backend Testing: pytest, pytest-asyncio, coverage.py
• E2E: Playwright
• CI/CD: GitHub Actions
• Data: PostgreSQL, pgvector
• Application Stack Tested: FastAPI, React, TypeScript, Keycloak, Azure OpenAI

What We Offer

·Premium medical package·Lunch Tickets & Pluxee Card·Bookster subscription·13th salary/yearly bonuses·Enterprise job security with a startup mentality (diverse & engaging environment, international exposure, flat hierarchy) under the stability of a secure multinational·A supportive culture (we value ownership, autonomy, and healthy work-life balance) with great colleagues, team events and activities·Flexible working program and openness to remote work·Collaborative mindset – employees shape their own benefits, tools, team events and internal practices·Diverse opportunities in Software Development with international exposure·Flexibility to choose projects aligned with your career path and technical goals·Access to leading learning platforms, courses, and certifications (Pluralsight, Udemy, Microsoft, Google Cloud)·Career growth & learning – mentorship programs, certifications, professional development opportunities, and above-market salary

*We are an equal opportunity employer and value diversity. All employment decisions are made without regard to age, gender, disability, race, ethnicity, religion, sexual orientation, or any other protected characteristic. We encourage applicants from all backgrounds to apply.*

Originally posted on Himalayas