US Tech - AI Evaluation Engineer (QA) Manager

Pwc4 months ago
Pittsburgh, PA, United States
Hybrid
Full-time
Junior Level (1-3 years)

Job Description

Position Overview

At PwC, we are seeking a Manager in Data Science and Machine Learning Engineering who will leverage advanced analytics and machine learning techniques to transform large datasets into actionable insights. In this role, you will lead teams delivering governed Generative AI solutions, drive innovation in AI technology, and play a pivotal role in mentoring and inspiring your team. You will be responsible for designing testing strategies, establishing governance controls, and ensuring quality while upholding PwC’s values and professional standards.

Key Responsibilities

  • Foster a collaborative environment to enhance team performance.
  • Uphold professional standards and PwC values in every deliverable.
  • Lead teams delivering governed Generative AI solutions, including designing testing strategies and evaluation frameworks.
  • Supervise team members, mentor effectively, and support continuous professional development.
  • Ensure successful planning, budgeting, execution, and completion of client projects.

Required Qualifications

  • Bachelor’s Degree (or equivalent specialized training and/or progressive work experience)
  • At least 6 years of experience in AI/ML engineering, data engineering, or software engineering

Preferred Qualifications

  • Master’s Degree preferred
  • Proven experience leading AI solution teams
  • Understanding of LLMs and agent architectures
  • Experience with Microsoft Power Platform
  • Prior consulting or professional services experience
  • Experience designing and overseeing automated testing frameworks for AI solutions

Benefits & Perks

  • Compensation: Salary range $73,500 - $212,280 (for Washington state: $73,500 - $244,000) plus an annual discretionary bonus.
  • Benefits: Medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more.
  • Travel: Up to 20% travel requirements.

Required Skills

Generative AI Solutions
Data Engineering
Automated Testing
Project Ownership
Predictive Modeling
Testing Strategies
Data Visualization
Team Management
Mentoring & Coaching
Software Engineering
AI Governance
Microsoft Power Platform
AI/ML Engineering
Evaluation Frameworks
CI/CD Pipelines
Statistical Analysis