Resume Score
CV/Résumé Score
  • Expertini Resume Scoring: See how well your CV/Résumé matches this job: (792) QA Automation Engineer.
Poland Jobs Expertini

Urgent! (792) QA Automation Engineer Vacancy | Altoros

(792) QA Automation Engineer



Job description

Altoros - an established provider of software development services is looking for a QA Automation Engineer.

Requirements

It's a part-time position.

  • Own the test strategy across FE, BE, and LLM/agent workflows; define the test pyramid and coverage goals.
  • Build and maintain automation for:
    • UI/E2E flows (critical paths, multi‑step agentic scenarios).
    • API/contract testing (REST/GraphQL), schema/compatibility checks.
    • Data & integration tests across services and external partners.
  • LLM Quality & Evals
    • Design golden datasets and rubrics for LLM output evaluation (pass/fail thresholds, human‑in‑the‑loop review).
    • Set up regression/eval harnesses for prompts, tools, and agents; track drift and hallucination rates.
    • Implement guardrails and adversarial/red‑team tests for safety, privacy, bias, and toxicity.
  • Non‑functional testing: baseline and monitor performance, reliability, and resilience for key user journeys.
  • CI/CD ownership: integrate tests into pipelines, gate releases, reduce flakiness, and surface quality KPIs (e.g., failure rate, MTTR, coverage).
  • Test data & environments: manage fixtures, synthetic data, and stable seeds for deterministic runs.
  • Quality operations: triage defects, drive root‑cause analysis, and keep crisp, proactive communication with PM, Design, and Engineering.
  • Documentation: maintain clear test plans, playbooks, and release criteria.

Nice to have:

    • Experience with agent frameworks, tool calling, retrieval/RAG, or tracing.
    • Familiarity with evaluation/observability tools for LLM apps (e.g., prompt testing frameworks, tracing dashboards).
    • Performance testing (e.g., k6/JMeter) and basic security/safety testing practices.

Join Altoros Team!


Required Skill Profession

Engineers



Your Complete Job Search Toolkit

✨ Smart • Intelligent • Private • Secure

Start Using Our Tools

Join thousands of professionals who've advanced their careers with our platform

Rate or Report This Job
If you feel this job is inaccurate or spam kindly report to us using below form.
Please Note: This is NOT a job application form.


    Unlock Your 792 QA Potential: Insight & Career Growth Guide


Advance your career or build your team with Expertini's smart job platform. Connecting professionals and employers Poland.