Prompt Engineering, Evaluation, & Refinement
(Edition II)
A $4.4 Trillion Business
Why Prompt Engineering Skills Are Essential Today
Course and Instructor Description
Prompting Foundations and Advanced Strategies
Session 1. Prompting Foundations and Advanced Strategies
1.1 Definition and Purpose
1.2 Core Principles for effective Prompt Engineering
1.3 Standard Prompt Structure
1.4 System, User & Assistant Prompts
1.5 Useful Parameters
1.6 Prompt Engineering: Advanced Strategies
Prompt Creation, Evaluation, Iteration and Refinement Process
Session 2. Prompt Creation, Evaluation, Iteration and Refinement Process
2.1 Prompt Creation Process
2.2 Prompt Refinement Process
2.3 What can we do to improve the results?
2.4 Prompt Evaluation (intro)
2.4 Prompt Evaluation Elements
2.5 Prompt Evaluation: Building the right test sample
2.2 Prompt Refinement Process
2.3 What can we do to improve the results?
2.4 Prompt Evaluation (intro)
2.4 Prompt Evaluation Elements
2.5 Prompt Evaluation: Building the right test sample
Prompt Evaluation
Session 3. Prompt Evaluation
3.1 How to Evaluate Prompts Effectively
3.2 Evaluation Pipeline
3.3 Recommendation
3.4 LLM as a Judge
3.5 Metrics for Classification Models (MTQE)
3.6 Risk Balance
3.7 Human Evaluation
3.8 Key Ideas & Recommendations
Meet
Andrés Romero
Andrés is a proficient language technology expert with over a decade of experience in the Localization Industry.
Throughout his career, he has held diverse roles, such as CAT Tool Specialist, Localization Engineer and Operations Technology Coordinator, where he led a team of localization engineers.
Throughout his career, he has held diverse roles, such as CAT Tool Specialist, Localization Engineer and Operations Technology Coordinator, where he led a team of localization engineers.
Currently at Acolad, Andrés focuses on machine translation evaluation and engine training. He is also deeply involved in prompt engineering and Generative AI, proposing AI-driven driven solutions to deliver tailored, customer-centric solutions and to tackle challenges in Production.
Andrés is passionate about automating and optimizing processes to enhance productivity and efficiency, improving quality and integrating innovation into localization workflows.
Andrés Romero - Course Creator & Host



