LLM Evaluations for Product Managers
portes grátis
LLM Evaluations for Product Managers
A practical guide to measuring, improving, and delivering value with LLMs
Corcoran, James
Packt Publishing Limited
04/2026
Mole
Inglês
9781806694075
Pré-lançamento - envio 15 a 20 dias após a sua edição
Descrição não disponível.
Table of Contents
The New Frontier: Why LLM Evaluation is Now a Core PM Skill
The PM's Evaluation Toolkit: Essential Concepts and Strategic Frameworks
Choosing Your Evaluation Strategy: Automated, Human-in-the-Loop, and Hybrid Approaches
Building Evaluation Datasets That Predict Real-World Success
Human-in-the-Loop Evaluation: When and How to Scale Human Judgment
Automated Evaluation at Scale: LLM-as-a-Judge and Beyond
Evaluation Infrastructure: Building vs. Buying for Product Success
Rapid Product Discovery: Lean Evaluation for Fast Iteration
Measuring Product-Model Fit: When Your LLM Delivers User Value
Evaluation-Driven Feature Prioritization and Roadmap Planning
Safety and Responsible AI: Evaluation for Trust and Compliance
Evaluating Complex Systems: RAG, Agents, and Multi-Turn Experiences
Model Evolution and A/B Testing: Managing LLM Transitions
Building Evaluation-Driven Product Teams and Culture
Scaling Evaluation Practices: From Team to Organization
Communicating Evaluation Results: From Data to Strategic Decisions
Future-Proofing Your AI Products: Adaptive Evaluation for Emerging Technologies
The New Frontier: Why LLM Evaluation is Now a Core PM Skill
The PM's Evaluation Toolkit: Essential Concepts and Strategic Frameworks
Choosing Your Evaluation Strategy: Automated, Human-in-the-Loop, and Hybrid Approaches
Building Evaluation Datasets That Predict Real-World Success
Human-in-the-Loop Evaluation: When and How to Scale Human Judgment
Automated Evaluation at Scale: LLM-as-a-Judge and Beyond
Evaluation Infrastructure: Building vs. Buying for Product Success
Rapid Product Discovery: Lean Evaluation for Fast Iteration
Measuring Product-Model Fit: When Your LLM Delivers User Value
Evaluation-Driven Feature Prioritization and Roadmap Planning
Safety and Responsible AI: Evaluation for Trust and Compliance
Evaluating Complex Systems: RAG, Agents, and Multi-Turn Experiences
Model Evolution and A/B Testing: Managing LLM Transitions
Building Evaluation-Driven Product Teams and Culture
Scaling Evaluation Practices: From Team to Organization
Communicating Evaluation Results: From Data to Strategic Decisions
Future-Proofing Your AI Products: Adaptive Evaluation for Emerging Technologies
Este título pertence ao(s) assunto(s) indicados(s). Para ver outros títulos clique no assunto desejado.
Table of Contents
The New Frontier: Why LLM Evaluation is Now a Core PM Skill
The PM's Evaluation Toolkit: Essential Concepts and Strategic Frameworks
Choosing Your Evaluation Strategy: Automated, Human-in-the-Loop, and Hybrid Approaches
Building Evaluation Datasets That Predict Real-World Success
Human-in-the-Loop Evaluation: When and How to Scale Human Judgment
Automated Evaluation at Scale: LLM-as-a-Judge and Beyond
Evaluation Infrastructure: Building vs. Buying for Product Success
Rapid Product Discovery: Lean Evaluation for Fast Iteration
Measuring Product-Model Fit: When Your LLM Delivers User Value
Evaluation-Driven Feature Prioritization and Roadmap Planning
Safety and Responsible AI: Evaluation for Trust and Compliance
Evaluating Complex Systems: RAG, Agents, and Multi-Turn Experiences
Model Evolution and A/B Testing: Managing LLM Transitions
Building Evaluation-Driven Product Teams and Culture
Scaling Evaluation Practices: From Team to Organization
Communicating Evaluation Results: From Data to Strategic Decisions
Future-Proofing Your AI Products: Adaptive Evaluation for Emerging Technologies
The New Frontier: Why LLM Evaluation is Now a Core PM Skill
The PM's Evaluation Toolkit: Essential Concepts and Strategic Frameworks
Choosing Your Evaluation Strategy: Automated, Human-in-the-Loop, and Hybrid Approaches
Building Evaluation Datasets That Predict Real-World Success
Human-in-the-Loop Evaluation: When and How to Scale Human Judgment
Automated Evaluation at Scale: LLM-as-a-Judge and Beyond
Evaluation Infrastructure: Building vs. Buying for Product Success
Rapid Product Discovery: Lean Evaluation for Fast Iteration
Measuring Product-Model Fit: When Your LLM Delivers User Value
Evaluation-Driven Feature Prioritization and Roadmap Planning
Safety and Responsible AI: Evaluation for Trust and Compliance
Evaluating Complex Systems: RAG, Agents, and Multi-Turn Experiences
Model Evolution and A/B Testing: Managing LLM Transitions
Building Evaluation-Driven Product Teams and Culture
Scaling Evaluation Practices: From Team to Organization
Communicating Evaluation Results: From Data to Strategic Decisions
Future-Proofing Your AI Products: Adaptive Evaluation for Emerging Technologies
Este título pertence ao(s) assunto(s) indicados(s). Para ver outros títulos clique no assunto desejado.
