QA Engineer (AI products)

About this role

Ascendix Technologies is an AI and Real Estate Technology partner headquartered in Dallas, Texas, with offices in Poland, Portugal, and Ukraine. We specialize in AI solutions, Salesforce, and custom software development, helping businesses streamline their operations through innovative technology. We're looking for an experienced QA Engineer to join our Product Department and take ownership of quality assurance for our Salesforce-related products, starting with the Ascendix AI Agent.

In this role, you'll work with a small, collaborative team to ensure the reliability of both traditional software functionality and AI-driven features. You'll combine manual testing, test automation, and LLM evaluation techniques to validate AI-generated responses, identify potential issues, and continuously improve product quality. If you enjoy exploring AI technologies, thinking critically about complex scenarios, and taking initiative in shaping QA processes, we'd love to hear from you.

What We're Looking For Requirements : 5+ years of experience in Software Quality Assurance; Hands-on experience testing AI-powered applications with non-deterministic outcomes, such as LLM-based products, AI agents, or chatbots; Practical experience with LLM evaluation techniques, including test datasets, scoring rubrics, LLM-as-judge approaches, and regression tracking; Experience in test automation and maintaining automated test suites; Solid API testing skills using Postman or similar tools; Strong analytical and critical thinking skills, with the ability to evaluate not only whether an AI-generated response is incorrect, but also why; Ownership mindset, proactive approach to problem-solving, and willingness to improve QA processes; Good communication and collaboration skills, with the ability to work effectively in a small, distributed team; Upper-Intermediate English (B2+) or higher, both written and spoken.

Nice to Have: Experience with Playwright (TypeScript or JavaScript); Salesforce testing experience, including Lightning, managed packages, and permission sets; Familiarity with LLM evaluation tools such as Promptfoo, DeepEval, Ragas, or Langfuse; Experience using AI-assisted development tools such as Claude Code, Cursor, or similar; Basic prompt engineering skills; Experience working with CRM systems or real estate data.