This post is a part of the AB-731: AI Transformation Leader Exam Prep Hub.
This topic falls under these sections:
Identify the business value of generative AI solutions (35–40%)
--> Identify the foundational concepts of generative AI
--> Describe the differences between AI models, including fine-tuned and pretrained models
Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 4 practice tests with 30 questions each available from the hub's main page below the exam topics section.
Introduction
Generative AI solutions are powered by AI models that have been trained to recognize patterns, understand language, generate content, and perform a wide variety of tasks. As organizations evaluate AI opportunities, business leaders must understand the different types of AI models available and when each type is appropriate.
One of the most important concepts for the AB-731: AI Transformation Leader exam is understanding the difference between pretrained models and fine-tuned models, as well as how these models fit into broader AI solution strategies.
While technical teams may handle model development and deployment, business leaders must understand the business implications of model selection, including cost, flexibility, performance, governance, and time-to-value.
What Is an AI Model?
An AI model is a system that has learned patterns from data and can use those patterns to perform tasks.
Depending on the model, tasks may include:
- Generating text
- Answering questions
- Creating images
- Writing code
- Classifying data
- Making predictions
- Translating languages
- Summarizing documents
An AI model can be thought of as the “engine” that powers an AI application.
For example:
- Microsoft Copilot uses large AI models to generate responses.
- Chatbots use AI models to understand and answer questions.
- Image generators use AI models to create pictures from prompts.
Understanding Model Training
AI models learn through a training process.
During training, models analyze large volumes of data and identify patterns, relationships, and structures.
For example, a language model may be trained using:
- Books
- Articles
- Websites
- Technical documentation
- Publicly available text
After training, the model can generate new content based on what it learned.
The amount of data, computing power, and time required for training can be enormous, especially for modern generative AI systems.
What Is a Pretrained Model?
A pretrained model is an AI model that has already been trained on a large dataset before being made available for use.
Organizations can immediately begin using the model without conducting their own large-scale training.
Characteristics of Pretrained Models
- Already trained by the provider
- Ready for immediate use
- Supports many general-purpose tasks
- Requires little or no additional training
- Provides rapid deployment
Examples
Many large language models (LLMs) used in enterprise AI solutions are pretrained models.
These models can typically:
- Answer questions
- Summarize documents
- Generate content
- Translate languages
- Create code
without requiring additional training.
Benefits of Pretrained Models
Faster Time-to-Value
Organizations can begin using the model immediately.
There is no need to spend months collecting and training data.
Example
A company deploys Microsoft Copilot to help employees draft emails and summarize meetings.
The organization benefits from AI capabilities immediately because the underlying model is already trained.
Lower Initial Cost
Training large models from scratch is expensive.
Pretrained models eliminate much of the cost associated with:
- Data collection
- Model training
- Infrastructure
- AI expertise
Broad Capabilities
Pretrained models often support many tasks.
Examples include:
- Content creation
- Summarization
- Question answering
- Translation
- Coding assistance
A single model may address multiple business needs.
Reduced Complexity
Organizations can focus on adoption and business value rather than model development.
Limitations of Pretrained Models
Although pretrained models provide significant advantages, they are not perfect.
Limited Organizational Knowledge
The model may not understand:
- Internal policies
- Company procedures
- Proprietary information
- Industry-specific terminology
Generic Responses
Responses may be accurate but lack business-specific context.
Specialized Requirements
Highly regulated or specialized industries may require more tailored behavior.
What Is a Fine-Tuned Model?
A fine-tuned model begins as a pretrained model and then receives additional training using a smaller, targeted dataset.
The goal is to improve performance for a specific task, industry, business process, or domain.
Fine-tuning allows organizations to customize model behavior while leveraging the knowledge already learned during pretraining.
How Fine-Tuning Works
The process generally follows these steps:
Step 1
Start with a pretrained model.
Step 2
Provide additional training data relevant to the desired task.
Step 3
Adjust model parameters based on the specialized data.
Step 4
Deploy the customized model.
Instead of learning everything from scratch, the model builds upon existing knowledge.
Benefits of Fine-Tuned Models
Improved Domain Expertise
Fine-tuned models can better understand:
- Industry terminology
- Business-specific language
- Specialized workflows
Example
A healthcare organization fine-tunes a model using medical documentation and clinical terminology.
The resulting model performs better within healthcare scenarios.
More Consistent Responses
Fine-tuning can help guide the model toward preferred response styles and behaviors.
Example
A company wants all AI-generated customer communications to follow specific branding guidelines.
Fine-tuning can improve consistency.
Better Performance for Specific Tasks
A fine-tuned model often outperforms a general-purpose model when performing specialized tasks.
Examples include:
- Legal document analysis
- Insurance claims processing
- Financial reporting
- Industry-specific customer support
Limitations of Fine-Tuned Models
Additional Cost
Fine-tuning requires:
- Training resources
- Data preparation
- Model management
This increases costs compared to simply using a pretrained model.
Data Requirements
Organizations need high-quality training data.
Poor-quality data can reduce model effectiveness.
Ongoing Maintenance
Fine-tuned models may require updates as:
- Business processes evolve
- Regulations change
- New data becomes available
Increased Complexity
Custom models introduce additional governance, testing, and management requirements.
Pretrained vs. Fine-Tuned Models
| Characteristic | Pretrained Model | Fine-Tuned Model |
|---|---|---|
| Training | Already trained by provider | Additional organization-specific training |
| Time to deploy | Fast | Longer |
| Cost | Lower | Higher |
| Customization | Limited | High |
| Domain expertise | General | Specialized |
| Maintenance | Minimal | Greater |
| Flexibility | Broad tasks | Optimized for specific tasks |
Foundation Models
Many generative AI solutions are built on foundation models.
A foundation model is a large AI model trained on enormous amounts of data and capable of supporting many downstream tasks.
Characteristics include:
- Large-scale training
- Broad capabilities
- Adaptability
- General-purpose use
Foundation models often serve as the starting point for fine-tuning.
Large Language Models (LLMs)
A Large Language Model (LLM) is a type of foundation model focused on language-related tasks.
Examples of LLM capabilities include:
- Writing content
- Summarizing information
- Translation
- Question answering
- Conversational interactions
Many Microsoft AI solutions rely on large language models.
Fine-Tuning vs. Retrieval-Augmented Generation (RAG)
Business leaders should understand that fine-tuning is not always required.
Many organizations use Retrieval-Augmented Generation (RAG) instead.
RAG Approach
Rather than retraining the model, RAG:
- Retrieves relevant organizational information.
- Provides that information to the model.
- Generates responses using the retrieved data.
Benefits
- Lower cost
- Faster implementation
- Easier maintenance
- Access to current information
Example
An employee asks a question about company policies.
The AI retrieves the latest policy documents and uses them to generate an answer.
The model itself does not need retraining.
For many enterprise scenarios, RAG may be preferable to fine-tuning.
Choosing Between Pretrained and Fine-Tuned Models
Business leaders should evaluate:
Business Requirements
Does the organization need:
- General-purpose assistance?
- Specialized expertise?
Available Data
Is high-quality domain-specific data available?
Cost Constraints
Can the organization justify customization costs?
Speed of Deployment
How quickly is value needed?
Governance Requirements
What regulatory and compliance considerations apply?
Business Scenarios
Scenario 1: Employee Productivity
Need:
- Email drafting
- Meeting summaries
- Document creation
Best Choice:
Pretrained model
Reason:
General-purpose capabilities are sufficient.
Scenario 2: Industry-Specific Support Assistant
Need:
- Specialized terminology
- Consistent industry guidance
Best Choice:
Fine-tuned model or RAG-enhanced solution
Reason:
Domain-specific expertise is important.
Scenario 3: Enterprise Knowledge Search
Need:
- Access to current internal documents
Best Choice:
RAG solution with a pretrained model
Reason:
Information changes frequently and retraining would be inefficient.
Exam Tips
For the AB-731 exam, remember:
- A pretrained model has already been trained and is ready for use.
- Fine-tuning adds additional training to customize a pretrained model.
- Pretrained models provide faster deployment and lower costs.
- Fine-tuned models provide greater specialization and domain expertise.
- Foundation models serve as the basis for many generative AI solutions.
- Large Language Models (LLMs) are foundation models focused on language tasks.
- Fine-tuning is not always necessary; RAG is often a practical alternative.
- Business leaders should balance cost, customization, governance, and business value when selecting a model strategy.
Practice Exam Questions
Question 1
A company wants to deploy an AI solution as quickly as possible to help employees draft emails and summarize meetings. Which model approach is most appropriate?
A. Fine-tuned model
B. Pretrained model
C. Custom model trained from scratch
D. Specialized classification model
Answer: B
Explanation: Pretrained models are already trained and can be deployed quickly for general productivity tasks without requiring additional customization.
Question 2
What is the primary purpose of fine-tuning an AI model?
A. Reduce model size
B. Remove training data
C. Improve performance for a specific domain or task
D. Eliminate the need for governance
Answer: C
Explanation: Fine-tuning customizes a pretrained model to perform better within a particular industry, business process, or specialized use case.
Question 3
Which statement best describes a pretrained model?
A. It has already been trained and is ready for use.
B. It requires organization-specific training before deployment.
C. It only supports one task.
D. It contains proprietary company data by default.
Answer: A
Explanation: Pretrained models are trained by the provider and can be used immediately for a variety of general-purpose tasks.
Question 4
A financial services company wants an AI solution that consistently uses industry-specific terminology and follows internal communication standards. Which approach is most likely to help?
A. Disable model training
B. Use only spreadsheets
C. Remove all business data
D. Fine-tune the model
Answer: D
Explanation: Fine-tuning can improve consistency and domain-specific performance by training the model on specialized organizational data.
Question 5
Which characteristic is typically associated with pretrained models?
A. Higher customization
B. Greater maintenance requirements
C. Lower implementation complexity
D. Longer deployment timelines
Answer: C
Explanation: Pretrained models generally require less customization and management, making them easier to implement.
Question 6
What is a foundation model?
A. A database platform for AI applications
B. A large AI model trained on extensive data that supports many tasks
C. A reporting tool used for business intelligence
D. A model that only performs image recognition
Answer: B
Explanation: Foundation models are large-scale models that can support a wide range of downstream AI tasks and applications.
Question 7
Which challenge is most commonly associated with fine-tuned models?
A. Lack of specialization
B. Inability to generate content
C. Additional cost and maintenance requirements
D. Inability to process text
Answer: C
Explanation: Fine-tuning requires additional training, testing, governance, and ongoing management, increasing complexity and cost.
Question 8
An organization needs AI responses based on frequently changing internal policy documents. Which approach may be preferable to fine-tuning?
A. Manual document review only
B. Model retraining every day
C. Predictive analytics
D. Retrieval-Augmented Generation (RAG)
Answer: D
Explanation: RAG retrieves current information at runtime, allowing AI systems to use the latest content without retraining the model.
Question 9
Which factor would most strongly support choosing a pretrained model instead of a fine-tuned model?
A. Need for highly specialized industry knowledge
B. Requirement for maximum customization
C. Desire for rapid deployment and lower cost
D. Availability of extensive proprietary training data
Answer: C
Explanation: Pretrained models are often selected when organizations want quick implementation and lower costs.
Question 10
How does a fine-tuned model typically originate?
A. It is built entirely without training data.
B. It starts as a pretrained model and receives additional targeted training.
C. It is created using only business rules.
D. It is generated automatically by a database.
Answer: B
Explanation: Fine-tuning builds upon an existing pretrained model, allowing it to develop greater expertise in a specific domain or task.
Go to the AB-731 Exam Prep Hub main page
The Data Community 