AI Product Evaluation 101

Don't get fooled! Whether you're building AI products or buying them, this course will help you make better decisions with practical tools for evaluating performance and testing claims — whether they're a vendor's claims or your own.Don't get fooled! Whether you're building AI products or buying them, this course will help you make better decisions with practical tools for evaluating performance and testing claims — whether they're a vendor's claims or your own.
20% off
for groups of 3 or more
Ask us about group discounts and bundles!
$300 off
per seat for groups of 2 +
Ask us about group discounts and bundles!
$150 off
per seat for groups of 3 +
Ask us about group discounts and bundles!
$300 off
per seat for groups of 2 +
Ask us about group discounts and bundles!
$300 off
per seat for groups of 2+
Ask us about group discounts and bundles!
$200 off
per seat for groups of 2 +
Ask us about group discounts and bundles!
$200 off
per seat for groups of 3 +
Ask us about group discounts and bundles!
$300 off
per seat for groups of 2 +
Ask us about group discounts and bundles!

Cut through the noise

Join us for three live sessions where we'll cover evaluation tools and methods, and how to apply them for immediate improvements in your buying and build decisions. Demonstrations, expert guest speakers, and hands-on activities will help you avoid failed AI projects and create lasting value from successful AI applications.
No items found.
No items found.
No items found.

Things You'll Get From This Course

Clarity

Gain first-principles understanding of the concepts in AI evaluation
1

Methods & Tools

Learn the pros and cons of common evaluation methods and tools
2

Practical Experience

Be able to say "I have direct experience evaluating AI products" for specific needs
3

Confident Decision-making

Deliver compelling arguments for your AI vendor selections or AI roadmap decisions
4

Meet Your Instructor, Andrew Hines

Andrew Hines is the founder of Canvas Medical, where he has spent the past decade building modern electronic medical record and developer platforms used by leading healthcare organizations across all specialties and care models. His work focuses on safely accelerating AI adoption in care delivery and advancing rigorous, scalable methods for evaluating AI-powered tools for that purpose. 

Andrew holds degrees in Mathematical Statistics and Business Administration from San Francisco State University and a master’s in Management Science and Engineering from Stanford University. He brings a unique perspective at the intersection of technology, healthcare, and product evaluation, making complex AI capabilities safe and useful in practice.

Register For This CourseGet on the Waitlist
Next Cohort Starts
10/28 - 10/30

No items found.
Register For This CourseSignup Re-Opening Soon
Next Cohort Starts
10/28 - 10/30

Course Syllabus & Schedule

Module 1

Day 1

Impact and Core Concepts

10/28, 12-130 PM EST

We'll cover what goes into various types of evaluations and why they matter. You'll hear stories on how they're used today and the impact they have, and how they should be used in the future. We'll walk through live examples step by step, and you can do one yourself, too.

Module 2

Day 2

Tools and Methods

10/29, 12-130 PM EST

We'll apply the concepts we just learned using various methods and tools, and discuss strengths and limitations. We'll steer into predictable failure modes, hear stories about hard-won best practices, and you can get your hands dirty again with more of the eval pipeline.

Module 3

Day 3

Evaluate, Improve, Repeat

10/30, 12-130 PM EST

We don't do evaluations for their own sake! We'll walk through how to interpret evaluation results and plow them into product improvements over and over, creating a Continuous Calibration / Continuous Development loop useful to builders and buyers alike.

Module 4

Day 4

No items found.

Module 5

Day 5

No items found.

Module 6

Day 6

No items found.

Module 7

Day 7

No items found.

Module 8

Day 8

No items found.

Module 9

Day 9

No items found.

Module 10

Day 10

No items found.

Frequently Asked Questions

Who is this course for?

If you’re buying, selling, or building AI in healthcare, this is for you. Product managers, clinicians, engineers, buyers, investors — basically anyone tired of getting dazzled by a slick demo and then burned later.

Do I need to know how to code?

Strictly speaking, no — you can follow along without writing a line of code. But let’s be honest: if you’re in healthcare tech in 2025 and you can’t at least open a notebook or run a script, you’re handicapping yourself. Some software comfort will help you get more from the hands-on bits.

What will I actually walk away with?

A working set of tools, mental models, and battle scars (borrowed from ours) to evaluate AI products without falling for hype. You’ll know which methods to use, how to spot garbage claims, and how to make confident decisions when vendors or your own team are pitching “AI magic.”

Three live, online sessions packed with demos, stories, and interactive exercises. We’ll also bring in guest experts who’ve shipped and tested AI in the wild. Miss a session? Recordings will be available, but the real fun is live.

How much time should I plan to commit?

Each session is about 90 minutes, with optional exercises between. Think 5–6 hours total — less time than a bad Netflix binge, and infinitely more useful to your career.

Will this make me an AI expert overnight?

Nope. But you’ll be way ahead of 90% of people throwing “AI strategy” into their slide decks. You’ll leave with practical experience and frameworks that help you cut through the noise and avoid expensive mistakes.

Register For This CourseGet on the Waitlist
Next Cohort Starts
10/28 - 10/30