AI Application Test Engineer

Prophecy Technologies6 months ago
San Francisco, CA, United States
Hybrid
Full-time
Junior Level (1-3 years)

Job Description

Role Overview:

The AI Application Test Engineer will be responsible for validating AI-enabled web and voice bot applications through comprehensive manual and functional testing. This role requires strong ownership of testing activities, close collaboration with cross-functional teams, and clear communication with stakeholders in an Agile delivery environment.

Key Responsibilities:

  • Perform hands-on testing of AI-enabled web and voice bot applications.
  • Develop and maintain all QA artifacts, including:
    • Test Plans
    • Test Scenarios and Test Cases
    • Test Data Preparation
    • Test Execution Results and Defect Reports
  • Validate conversational flows, intents, entities, and responses for AI applications.
  • Coordinate testing activities with onsite and offshore teams, including knowledge transfer and handover.
  • Participate in Agile ceremonies including daily stand-ups, sprint planning, reviews, and retrospectives.
  • Support production validation and post-release testing activities.
  • Prepare and share daily, weekly, and monthly QA status reports.
  • Communicate effectively with business stakeholders and leadership teams (Director and Senior Director levels).

Required Skills & Experience:

  • Hands-on experience testing AI-based applications, including chatbots or voice assistants.
  • Strong experience in manual testing of web applications and APIs.
  • Solid understanding of Agile/Scrum methodologies.
  • Experience working with distributed (onsite/offshore) teams.
  • Strong analytical, troubleshooting, and documentation skills.
  • Excellent verbal and written communication skills.

Preferred Skills:

  • Experience testing conversational AI platforms (chatbots, IVR, NLP-based systems).
  • Exposure to test automation or AI testing tools is a plus.
  • Familiarity with CI/CD pipelines and DevOps testing practices.

Behavioral Competencies:

  • Strong attention to detail and commitment to quality.
  • Ability to work independently in fast-paced environments.
  • Proactive collaborator with strong stakeholder management skills.

Required Skills

Voice Assistants Testing
Agile Methodologies
Manual Testing
Web Applications Testing
Documentation
Collaboration
Troubleshooting
AI Applications Testing
Chatbots Testing
API Testing
Communication
Analytical Skills