SDET (AI Platform & Quality Engineering)
Congregate Technologies
40 LPA
Location: Hyderabad
Posted: December 20, 2025
Posted By: System Administrator
Job Description
Job Description – SDET (AI Platform & Quality Engineering)
Position Overview
The SDET – AI Platform ensures quality, reliability, performance, and safety of generative AI capabilities powering the InvoiceCloud platform. This role builds automated test frameworks, semantic validation tools, and continuous monitoring to support enterprise-grade AI delivery at scale. The SDET partners with Product, AI Engineering, Data Science, Platform, and Security teams to enable measurable, observable, and responsible AI outcomes.
Success in this position means improving AI correctness, reducing release risk, and accelerating developer velocity through automation, continuous validation, and shift-left testability.
Success Profile
Results Driven
Owns test strategy and automation for LLM, RAG, and AI-powered features.
Defines KPIs for accuracy, performance, safety, and observability.
Builds regression suites, benchmarking tools, and model evaluation workflows.
Takes Ownership
Ensures data governance, privacy, and responsible AI compliance.
Drives CI/CD quality automation, drift monitoring, and issue resolution.
Establishes disciplined validation routines and production readiness.
Innovative
Implements automation for prompt testing, semantic scoring, and safety checks.
Uses AI frameworks (Azure OpenAI, LangChain, Semantic Kernel, vector databases) to build reusable quality tooling.
Partners with engineering to improve testability, telemetry, and quality insights.
Customer Centric
Validates AI behaviors that improve payer and CSR experiences.
Measures business impact through accuracy, call deflection, and handle time improvement.
Advocates for safe, transparent, and trustworthy AI outcomes.
Requirements
5+ years in test automation or SDET roles in SaaS or distributed systems.
Hands-on experience validating AI/ML, NLP, or analytics-driven applications.
Strong skills in Python (preferred) and CI/CD automation.
Familiarity with Azure OpenAI, LangChain/Semantic Kernel, or vector search is a plus.
Knowledge of responsible AI practices, privacy, RBAC, and security testing.
Excellent communication and collaboration across engineering, product, and quality teams.
Position Overview
The SDET – AI Platform ensures quality, reliability, performance, and safety of generative AI capabilities powering the InvoiceCloud platform. This role builds automated test frameworks, semantic validation tools, and continuous monitoring to support enterprise-grade AI delivery at scale. The SDET partners with Product, AI Engineering, Data Science, Platform, and Security teams to enable measurable, observable, and responsible AI outcomes.
Success in this position means improving AI correctness, reducing release risk, and accelerating developer velocity through automation, continuous validation, and shift-left testability.
Success Profile
Results Driven
Owns test strategy and automation for LLM, RAG, and AI-powered features.
Defines KPIs for accuracy, performance, safety, and observability.
Builds regression suites, benchmarking tools, and model evaluation workflows.
Takes Ownership
Ensures data governance, privacy, and responsible AI compliance.
Drives CI/CD quality automation, drift monitoring, and issue resolution.
Establishes disciplined validation routines and production readiness.
Innovative
Implements automation for prompt testing, semantic scoring, and safety checks.
Uses AI frameworks (Azure OpenAI, LangChain, Semantic Kernel, vector databases) to build reusable quality tooling.
Partners with engineering to improve testability, telemetry, and quality insights.
Customer Centric
Validates AI behaviors that improve payer and CSR experiences.
Measures business impact through accuracy, call deflection, and handle time improvement.
Advocates for safe, transparent, and trustworthy AI outcomes.
Requirements
5+ years in test automation or SDET roles in SaaS or distributed systems.
Hands-on experience validating AI/ML, NLP, or analytics-driven applications.
Strong skills in Python (preferred) and CI/CD automation.
Familiarity with Azure OpenAI, LangChain/Semantic Kernel, or vector search is a plus.
Knowledge of responsible AI practices, privacy, RBAC, and security testing.
Excellent communication and collaboration across engineering, product, and quality teams.
Application Stats
Total Applications: 0
Posted: Dec 20, 2025