Test Engineering

Key Responsibilities

Quality Engineering Leadership

• Serve as a senior member of the engineering organization responsible for establishing

and promoting quality engineering best practices.

• Define quality standards, testing strategies, and automation frameworks across product

teams.

• Drive shift-left testing practices throughout the software development lifecycle.
• Participate in architecture, design, and requirements reviews to identify quality risks early.
• Mentor QA engineers and developers on testing and quality engineering practices.
• Advocate for continuous improvement and quality-first development culture.

Test Automation

• Design, develop, and maintain robust automated test frameworks and test suites.
• Implement automated testing across:
• Functional Testing
• API Testing
• Ul Testing
• Integration Testing
• Regression Testing
• Performance Testing
• Security Testing
• Integrate automated testing into CI/CD pipelines.
• Improve automation coverage and reduce manual testing effort.
• Analyze test failures and drive root-cause resolution.

Enterprise Application Testing

• Validate complex business workflows and enterprise application functionality.
• Develop comprehensive test plans, test cases, and test scenarios.
• Ensure requirements are testable and traceable throughout the development lifecycle.
• Perform exploratory, system, integration, and end-to-end testing.
• Verify software meets functional and non-functional requirements.

Cloud-Native Quality Assurance

• Test cloud-native applications running within Microsoft Azure.
• Validate reliability, scalability, resiliency, and fault-tolerance requirements.
• Verify integrations across distributed systems, APIs, messaging platforms, and databases.
• Ensure applications meet enterprise security, compliance, and operational standards.
• Participate in release validation and production-readiness assessments.

Al & Intelligent Application Testing

• Support testing of Al-powered product capabilities.
• Validate outputs from Generative Al and Large Language Model (LLM) integrations.
• Develop test strategies for:
• Al Chatbots
• Al Assistants
• Al Agents
• Retrieval-Augmented Generation (RAG) Solutions
• Intelligent Search Experiences
• Evaluate Al output quality, consistency, accuracy, and reliability.
• Support Responsible Al practices including fairness, transparency, and governance.
• Partner with Al engineers to establish Al evaluation methodologies and testing

Frameworks.

DevOps & Continuous Testing

• Integrate quality gates into CI/CD pipelines.
• Develop automated validation processes for software releases.
• Support infrastructure validation and deployment testing.
• Monitor quality metrics and test coverage.
• Contribute to DevSecOps and continuous delivery initiatives.

Required Qualifications

Education

• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or

a related field.

• Equivalent professional experience will be considered.

Experience

• 7+ years of software quality assurance experience.
• 5+ years of hands-on automated testing experience.
• Experience supporting enterprise-scale software products.
• Experience working within Agile and Scrum delivery environments.
• Experience collaborating directly with development teams throughout the SDLC.

Required Technical Skills

Test Automation

Expertise in one or more of:

• Playwright
• Selenium
• Cypress
• Puppeteer

Experience with:

• Test automation architecture
• Automated regression testing
• CI/CD-based test execution
• Automated reporting and dashboards

API Testing

Experience with:

• REST APIs
• Postman
• Swagger/OpenAPI
• Automated API validation
• Contract testing
• Integration testing

Programming & Scripting

Hands-on experience with:

• C#
• .NET
• Python
• JavaScript / TypeScript
• PowerShell

Ability to develop maintainable automation frameworks and supporting utilities.

Performance & Security Testing

Experience with:

• Load testing tools
• Performance test design
• API performance validation
• Security testing fundamentals
• Vulnerability assessment processes

Microsoft Azure Experience

Working knowledge of:

• Azure App Services
• Azure Functions
• Azure Kubernetes Service (AKS)
• Azure SQL Database
• Azure Cosmos DB
• Azure Storage
• Azure API Management
• Azure DevOps
• Azure Monitor
• Application Insights
• Azure Entra ID

Ability to test applications operating in cloud-native Azure environments.

DevOps & CI/CD Experience

Experience with:

• Azure DevOps Pipelines
• GitHub Actions
• Automated build and deployment pipelines
• Test execution within CI/CD workflows
• Quality gates and release validation processes

Al Knowledge

Working knowledge of:

• Generative Al concepts
• Large Language Models (LLMs)
• Prompt engineering fundamentals
• Al-assisted software development
• Al quality evaluation techniques
• Al Agents and agentic workflows
• Retrieval-Augmented Generation (RAG)
• Azure OpenAl Service
• Azure Al Search
• Responsible Al principles

Understanding of the unique testing challenges associated with Al-generated outputs,

probabilistic systems, hallucinations, grounding, and Al governance.

Preferred Qualifications

• ISTQB Advanced Certification
• Certified Software Test Engineer (CSTE)
• Azure Fundamentals (AZ-900)
• Azure Developer Associate (AZ-204)
• Experience testing Al-enabled business applications.
• Experience testing distributed microservices architectures.
• Experience with containerized applications and Kubernetes.
• Experience implementing quality engineering practices in cloud-native environments.

Leadership Competencies

• Quality-first mindset
• Strong analytical and problem-solving skills
• Technical leadership and mentoring
• Attention to detail
• Risk assessment and mitigation
• Continuous improvement orientation
• Collaboration and teamwork
• Strong written and verbal communication
• Customer-focused thinking

Success Measures

• Increased automated test coverage
• Reduced production defects and escaped issues
• Improved release quality and deployment confidence
• Faster testing cycles and feedback loops
• Increased reliability and performance of Azure-hosted applications
• Successful validation of Al-powered capabilities
• Strong collaboration across engineering, product, and operations teams
• Continuous improvement of overall software quality metrics

Ideal Candidate Profile

The ideal Senior Quality Assurance Engineer combines strong software engineering and test

automation expertise with a passion for delivering exceptional product quality. They are

comfortable testing complex Azure-based enterprise applications, building scalable

automation frameworks, and helping teams confidently adopt Al-powered capabilities while

maintaining rigorous standards for reliability, security, performance, and user experience.

REMOTE

NOTE The ideal Senior Quality Assurance Engineer combines strong software engineering and test

automation expertise with a passion for delivering exceptional product quality. They are

comfortable testing complex Azure-based enterprise applications, building scalable

automation frameworks, and helping teams confidently adopt Al-powered capabilities while

maintaining rigorous standards for reliability, security, performance, and user experience.