Category: Artificial Intelligence (AI)

Choose an appropriate model for each task, including large language models (LLMs), small language models, multimodal models, and Foundry Tools (AI-103 Exam Prep)

This post is a part of the AI-103: Develop AI Apps and Agents on Azure Exam Prep Hub. 
This topic falls under these sections:
Plan and manage an Azure AI solution (25–30%)
--> Choose the appropriate Foundry services for generative AI and agents
--> Choose an appropriate model for each task, including large language models (LLMs), small language models, multimodal models, and Foundry Tools


Note that there are 10 practice questions (with answers and explanations) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

One of the most important skills for the AI-103: Develop AI Apps and Agents on Azure certification exam is understanding how to choose the correct AI model and supporting Azure AI Foundry tools for a given business or technical scenario.

Modern AI development is no longer about simply selecting “an AI model.” Instead, developers must evaluate:

  • The type of task being performed
  • Cost constraints
  • Latency requirements
  • Accuracy expectations
  • Reasoning complexity
  • Context window needs
  • Multimodal capabilities
  • Deployment environment
  • Security and governance requirements
  • Agent orchestration requirements

Azure AI Foundry provides access to multiple categories of models and tools that help developers build generative AI applications and AI agents efficiently.

For the AI-103 exam, you should understand:

  • When to use Large Language Models (LLMs)
  • When Small Language Models (SLMs) are preferable
  • When multimodal models are required
  • How Azure AI Foundry tools support model selection and orchestration
  • Tradeoffs between performance, cost, speed, and capability
  • Common real-world scenarios for each model category

Azure AI Foundry Overview

Azure AI Foundry is Microsoft’s unified platform for building, evaluating, deploying, and managing AI applications and agents.

Azure AI Foundry provides:

  • Access to foundation models
  • Agent development capabilities
  • Prompt engineering tools
  • Evaluation tools
  • Safety and content filtering
  • Retrieval-augmented generation (RAG) support
  • Fine-tuning capabilities
  • Monitoring and observability
  • Integration with Azure AI services

Azure AI Foundry enables developers to:

  • Compare multiple models
  • Test prompts
  • Evaluate outputs
  • Build AI agents
  • Connect enterprise data
  • Deploy scalable AI applications

For the AI-103 exam, understanding the relationship between model capabilities and Azure AI Foundry tools is extremely important.


Understanding Model Categories

The exam focuses heavily on selecting the correct model type for specific tasks.

The major categories include:

  1. Large Language Models (LLMs)
  2. Small Language Models (SLMs)
  3. Multimodal Models
  4. Embedding Models
  5. Specialized Models

Each category serves different purposes.


Large Language Models (LLMs)

What Are Large Language Models?

Large Language Models are advanced AI models trained on massive datasets containing text, code, and other information.

LLMs are designed for:

  • Natural language understanding
  • Natural language generation
  • Complex reasoning
  • Summarization
  • Coding assistance
  • Question answering
  • Conversational AI
  • Agent workflows
  • Content creation

Examples include:

  • GPT-4 family models
  • GPT-4o models
  • GPT-4 Turbo
  • Phi large models
  • Other frontier foundation models available in Azure AI Foundry

Characteristics of LLMs

Strengths

LLMs are excellent at:

Complex Reasoning

Examples:

  • Multi-step problem solving
  • Data interpretation
  • Logical analysis
  • Decision support

Advanced Content Generation

Examples:

  • Marketing content
  • Technical documentation
  • Email drafting
  • Knowledge-base generation

Conversational Experiences

Examples:

  • AI chatbots
  • AI copilots
  • Virtual assistants
  • Interactive tutoring systems

Agentic Workflows

LLMs are commonly used as the “reasoning engine” behind AI agents.

They can:

  • Plan tasks
  • Determine next actions
  • Call tools
  • Use memory
  • Chain workflows
  • Interact with APIs

Limitations of LLMs

Although powerful, LLMs have tradeoffs.

Higher Cost

LLMs generally:

  • Require more compute
  • Cost more per token
  • Increase infrastructure expenses

Increased Latency

Larger models may:

  • Respond more slowly
  • Increase application response times
  • Affect real-time user experiences

Resource Requirements

LLMs require:

  • More GPU resources
  • More memory
  • Larger deployments

Overkill for Simple Tasks

Using GPT-4-level reasoning for basic classification or short summarization tasks may be unnecessary and expensive.


When to Use LLMs

Choose an LLM when tasks require:

  • Advanced reasoning
  • Long-context understanding
  • High-quality content generation
  • Complex conversational behavior
  • Tool calling and agent orchestration
  • Coding assistance
  • Sophisticated summarization
  • Enterprise copilots

Example LLM Scenarios

Scenario 1: Enterprise AI Copilot

A company wants an AI assistant that:

  • Reads internal documentation
  • Answers employee questions
  • Generates summaries
  • Explains policies
  • Uses tools and APIs

Best choice:

  • Large Language Model with RAG integration

Reason:

  • Requires reasoning and conversational understanding.

Scenario 2: AI Coding Assistant

A development team needs:

  • Code generation
  • Debugging suggestions
  • Refactoring support
  • Documentation generation

Best choice:

  • Advanced LLM

Reason:

  • Coding tasks require complex contextual reasoning.

Small Language Models (SLMs)

What Are Small Language Models?

Small Language Models are more lightweight AI models optimized for:

  • Faster responses
  • Lower costs
  • Lower resource consumption
  • Edge deployments
  • Narrower tasks

Examples include:

  • Smaller Phi models
  • Compact transformer-based models
  • Task-specific lightweight models

Characteristics of SLMs

Strengths

Lower Cost

SLMs:

  • Consume fewer resources
  • Cost less to run
  • Reduce token usage costs

Faster Inference

SLMs typically:

  • Respond more quickly
  • Improve responsiveness
  • Support near real-time interactions

Edge and Mobile Suitability

SLMs may run:

  • On edge devices
  • On mobile hardware
  • In constrained environments

Efficient for Narrow Tasks

SLMs work well for:

  • Classification
  • Basic summarization
  • Intent detection
  • Simple chat interactions
  • Lightweight automation

Limitations of SLMs

Reduced Reasoning Ability

Compared to LLMs, SLMs may struggle with:

  • Complex logic
  • Long context handling
  • Multi-step reasoning
  • Sophisticated conversations

Lower Output Quality

Outputs may:

  • Be less nuanced
  • Contain reduced detail
  • Provide weaker contextual understanding

When to Use SLMs

Choose an SLM when:

  • Speed is critical
  • Cost optimization matters
  • Tasks are relatively simple
  • Edge deployment is needed
  • High throughput is required
  • Lightweight AI experiences are sufficient

Example SLM Scenarios

Scenario 1: Customer Intent Classification

An application classifies support tickets into categories such as:

  • Billing
  • Technical support
  • Returns
  • Sales

Best choice:

  • Small Language Model

Reason:

  • Classification is relatively simple and does not require advanced reasoning.

Scenario 2: Edge Device Assistant

A manufacturing company deploys an AI assistant on factory equipment with limited compute.

Best choice:

  • Small Language Model

Reason:

  • Edge environments benefit from lightweight models.

Multimodal Models

What Are Multimodal Models?

Multimodal models can process multiple data types simultaneously.

Examples include:

  • Text
  • Images
  • Audio
  • Video
  • Documents

These models combine information across modalities to produce richer outputs.


Capabilities of Multimodal Models

Multimodal models can:

  • Analyze images and answer questions about them
  • Generate captions from images
  • Extract information from documents
  • Process speech and text together
  • Understand charts and diagrams
  • Support visual reasoning

Common Multimodal Tasks

Image Understanding

Examples:

  • Object detection
  • Scene analysis
  • Image captioning
  • Visual question answering

Document Intelligence

Examples:

  • Invoice extraction
  • Receipt processing
  • Form analysis
  • OCR workflows

Audio + Text Experiences

Examples:

  • Voice assistants
  • Meeting summarization
  • Speech transcription
  • Audio analysis

When to Use Multimodal Models

Choose multimodal models when applications involve:

  • Images and text together
  • Document processing
  • Speech interactions
  • Visual understanding
  • Cross-modal reasoning

Example Multimodal Scenarios

Scenario 1: Invoice Processing

A company needs to:

  • Read invoices
  • Extract totals
  • Identify vendors
  • Validate line items

Best choice:

  • Multimodal document processing model

Reason:

  • The solution must interpret both layout and text.

Scenario 2: Retail Image Assistant

Users upload photos of products and ask questions about them.

Best choice:

  • Multimodal model

Reason:

  • Requires simultaneous image and text understanding.

Embedding Models

What Are Embedding Models?

Embedding models convert text or other content into vector representations.

These vectors capture semantic meaning.

Embedding models are essential for:

  • Semantic search
  • Retrieval-Augmented Generation (RAG)
  • Similarity matching
  • Recommendation systems
  • Knowledge retrieval

Retrieval-Augmented Generation (RAG)

RAG combines:

  • Embedding models
  • Vector databases
  • LLMs

Workflow:

  1. Convert documents into embeddings
  2. Store embeddings in a vector index
  3. Convert user query into embeddings
  4. Retrieve relevant content
  5. Send retrieved data to the LLM

RAG improves:

  • Accuracy
  • Freshness of information
  • Enterprise grounding
  • Hallucination reduction

Specialized Models

Some tasks are better handled by specialized AI models instead of general-purpose LLMs.

Examples:

  • Translation models
  • Speech models
  • OCR models
  • Vision models
  • Classification models

Why Specialized Models Matter

Specialized models may provide:

  • Better accuracy
  • Lower cost
  • Faster performance
  • Simpler deployment

Example:

Using a dedicated OCR service is often more efficient than asking an LLM to read text from images.


Model Selection Factors

The AI-103 exam heavily tests your ability to select the correct model based on requirements.


Factor 1: Task Complexity

Use LLMs For:

  • Advanced reasoning
  • Multi-step workflows
  • Complex conversations

Use SLMs For:

  • Simple classification
  • Lightweight interactions
  • Fast automation

Factor 2: Cost

LLMs

  • Higher operational cost
  • More expensive inference

SLMs

  • Lower operational cost
  • Better for high-volume workloads

Factor 3: Latency

Low-Latency Requirements

Prefer:

  • SLMs
  • Lightweight models

Complex Processing

Prefer:

  • LLMs

Even if response time increases.


Factor 4: Context Window

Some tasks require processing:

  • Long documents
  • Large conversations
  • Extensive histories

Choose models with larger context windows for:

  • Legal analysis
  • Knowledge assistants
  • Long-form summarization

Factor 5: Multimodal Requirements

If the application involves:

  • Images
  • Audio
  • Video
  • Documents

Choose multimodal-capable models.


Factor 6: Deployment Environment

Cloud-Hosted Applications

May use:

  • Large frontier models
  • GPU-intensive deployments

Edge or Mobile Deployments

Prefer:

  • Small models
  • Quantized models
  • Lightweight inference

Azure AI Foundry Tools

Azure AI Foundry includes numerous tools that support model selection and AI application development.


Model Catalog

The Model Catalog allows developers to:

  • Browse available models
  • Compare capabilities
  • Review benchmarks
  • Deploy models
  • Evaluate pricing

The catalog includes:

  • Microsoft-hosted models
  • Open-source models
  • Partner models
  • Frontier models

Prompt Flow

Prompt Flow helps developers:

  • Build AI workflows
  • Chain prompts together
  • Integrate tools
  • Evaluate prompts
  • Test model behavior

Prompt Flow is useful for:

  • Agent orchestration
  • RAG pipelines
  • Multi-step AI workflows

AI Agent Development Tools

Azure AI Foundry supports AI agents that can:

  • Use tools
  • Access data
  • Maintain memory
  • Perform actions
  • Execute workflows

Agent frameworks may include:

  • Tool calling
  • Function calling
  • Retrieval integration
  • Multi-agent orchestration

Evaluation Tools

Evaluation tools help developers assess:

  • Accuracy
  • Groundedness
  • Safety
  • Relevance
  • Latency
  • Cost

Evaluation is critical because model quality varies by task.


Content Safety Tools

Azure AI Foundry includes safety features such as:

  • Content filtering
  • Harm detection
  • Prompt injection detection
  • Responsible AI controls

These tools help ensure safe AI deployments.


Fine-Tuning Tools

Fine-tuning allows developers to customize models using:

  • Domain-specific data
  • Proprietary terminology
  • Specialized workflows

Fine-tuning may improve:

  • Accuracy
  • Consistency
  • Industry-specific responses

However, fine-tuning also:

  • Increases cost
  • Requires data preparation
  • Adds operational complexity

Choosing Between Prompt Engineering, RAG, and Fine-Tuning

This is a very important AI-103 exam topic.


Prompt Engineering

Use when:

  • You need quick customization
  • Tasks are general-purpose
  • No private data integration is needed

Advantages:

  • Fast
  • Cheap
  • Easy to maintain

RAG

Use when:

  • You need current or proprietary data
  • You want grounding in enterprise content
  • You need dynamic knowledge retrieval

Advantages:

  • Reduces hallucinations
  • Keeps knowledge current
  • Avoids retraining

Fine-Tuning

Use when:

  • Consistent specialized outputs are required
  • Domain language is highly unique
  • Behavioral customization is necessary

Advantages:

  • Tailored responses
  • Better domain alignment

Real-World Model Selection Examples

Example 1: FAQ Chatbot

Requirements:

  • Low cost
  • Fast responses
  • Basic conversational support

Best Choice:

  • Small Language Model + RAG

Example 2: Legal Document Assistant

Requirements:

  • Long-context understanding
  • Detailed summarization
  • Advanced reasoning

Best Choice:

  • Large Language Model with large context window

Example 3: Mobile AI App

Requirements:

  • Offline capability
  • Fast performance
  • Low resource usage

Best Choice:

  • Small Language Model

Example 4: Image-Based Customer Support

Requirements:

  • Analyze uploaded photos
  • Understand text and images
  • Generate responses

Best Choice:

  • Multimodal model

Key AI-103 Exam Tips

Understand Tradeoffs

You should know:

  • Bigger models are not always better
  • Simpler tasks may not require advanced LLMs
  • Cost and latency matter
  • Specialized models may outperform general models

Know Common Pairings

LLM + RAG

Used for:

  • Enterprise chatbots
  • Knowledge assistants
  • AI copilots

Embeddings + Vector Search

Used for:

  • Semantic search
  • Knowledge retrieval
  • Similarity matching

Multimodal Models

Used for:

  • Vision AI
  • Document processing
  • Audio interactions

Learn the Azure AI Foundry Ecosystem

Know the purpose of:

  • Model Catalog
  • Prompt Flow
  • Evaluation tools
  • Agent tools
  • Safety systems
  • Fine-tuning workflows

Summary

Selecting the correct AI model is one of the most important responsibilities for an Azure AI developer.

For the AI-103 exam, you should understand:

  • The differences between LLMs and SLMs
  • When multimodal models are required
  • How embedding models support RAG
  • When specialized models outperform general-purpose models
  • The tradeoffs between cost, speed, and reasoning capability
  • How Azure AI Foundry tools support AI development and orchestration

In real-world AI systems, choosing the correct model can dramatically improve:

  • Performance
  • User experience
  • Scalability
  • Operational cost
  • Reliability
  • Maintainability

A strong understanding of model selection is essential for designing effective Azure AI applications and AI agents.


Practice Exam Questions

Question 1

A company is building an enterprise AI assistant that must answer complex employee questions using internal documentation and perform multi-step reasoning. Which model type is MOST appropriate?

A. Small Language Model (SLM)
B. Embedding model only
C. Large Language Model (LLM)
D. OCR model

Answer

C. Large Language Model (LLM)

Explanation

Complex reasoning and conversational understanding are best handled by LLMs.


Question 2

Which model type is generally BEST for low-cost, low-latency classification tasks?

A. Large multimodal model
B. Small Language Model (SLM)
C. GPT-4-class reasoning model
D. Vision foundation model

Answer

B. Small Language Model (SLM)

Explanation

SLMs are optimized for lightweight and cost-efficient tasks.


Question 3

A solution must process uploaded invoices and extract totals, vendor names, and line items. Which model type is MOST appropriate?

A. Embedding model
B. Small Language Model
C. Multimodal model
D. Translation model

Answer

C. Multimodal model

Explanation

Invoice extraction requires understanding both layout and text.


Question 4

What is the primary purpose of embedding models?

A. Image generation
B. Semantic vector representation
C. Audio transcription
D. Tool orchestration

Answer

B. Semantic vector representation

Explanation

Embedding models convert content into vectors for semantic search and retrieval.


Question 5

Which Azure AI Foundry tool helps developers chain prompts, integrate tools, and build AI workflows?

A. Azure Monitor
B. Prompt Flow
C. Azure Policy
D. Azure Functions

Answer

B. Prompt Flow

Explanation

Prompt Flow is designed for workflow orchestration and prompt pipelines.


Question 6

A mobile AI application must operate with minimal compute resources and very fast response times. Which model type is MOST appropriate?

A. Large Language Model
B. Small Language Model
C. Large multimodal model
D. High-context reasoning model

Answer

B. Small Language Model

Explanation

SLMs are optimized for lightweight and edge deployments.


Question 7

Which approach is BEST when an AI chatbot must use current enterprise data without retraining the model?

A. Fine-tuning only
B. Prompt engineering only
C. Retrieval-Augmented Generation (RAG)
D. Quantization

Answer

C. Retrieval-Augmented Generation (RAG)

Explanation

RAG retrieves current information dynamically without retraining.


Question 8

Which factor MOST strongly indicates that a multimodal model is required?

A. Need for vector embeddings
B. Need for faster response times
C. Need to process images and text together
D. Need for lower cost

Answer

C. Need to process images and text together

Explanation

Multimodal models handle multiple input modalities simultaneously.


Question 9

What is a major tradeoff of using larger language models?

A. Reduced reasoning capability
B. Lower context windows
C. Increased operational cost
D. Inability to support agents

Answer

C. Increased operational cost

Explanation

Larger models typically require more compute resources and cost more.


Question 10

Which Azure AI Foundry capability helps evaluate model quality, safety, and groundedness?

A. Azure Load Balancer
B. Evaluation tools
C. Azure Backup
D. Traffic Manager

Answer

B. Evaluation tools

Explanation

Evaluation tools assess output quality, safety, and performance metrics.


Go to the AI-103 Exam Prep Hub main page

Exam Prep Hub for AI-901: Azure AI Fundamentals

Welcome to the AI-901: Azure AI Fundamentals Exam Prep Hub!

Welcome to the one-stop hub with information for preparing for the AI-901: Azure AI Fundamentals certification exam. The content for this exam helps you to demonstrate that “you have conceptual knowledge of AI solutions in Azure and the foundational technical skills to work with them”. You will also need “knowledge of Python coding syntax and programming techniques, and you should be familiar with Azure resources”.
Upon successful completion of the exam, you earn the Microsoft Certified: Azure AI Fundamentals certification.

This hub provides information directly here (topic-by-topic as outlined in the official study guide), links to a number of external resources, tips for preparing for the exam, practice tests, and section questions to help you prepare. Bookmark this page and use it as a guide to ensure that you are fully covering all relevant topics for the AI-901 exam and making use of as many of the resources available as possible.


Audience profile (from Microsoft’s site)



As a candidate for this Microsoft Certification, you’re at the beginning of your career in AI solution development. These Microsoft certifications offer opportunities to demonstrate your understanding of machine learning, AI concepts, and Azure services, whether you are starting your career or advancing your skills in AI solution development. Both certifications are designed for candidates from technical and non-technical backgrounds—prior experience in data science or software engineering is not required, though familiarity with basic cloud concepts and client-server applications will be helpful.
For the AI-901, you should have foundational knowledge of AI workloads and understand the basic principles of AI and machine learning. And also, you should have foundational technical skills for working with AI solutions in Azure, conceptual knowledge of Azure-based AI solutions, and familiarity with Python coding syntax and programming techniques, as well as Azure resources.
You may be eligible for ACE college credit if you pass this certification. See ACE college credit for certification exams for details.


Skills at a glance (as specified in the official study guide)

  • Identify AI concepts and responsibilities (40–45%)
  • Implement AI solutions by using Microsoft Foundry (55–60%)

Topic-by-Topic Exam Content

[click a topic link to access the content and practice questions for that topic]

Identify AI concepts and capabilities (40–45%)

Describe principles of responsible AI

Identify AI model components and configurations

Identify AI workloads

Implement AI solutions by using Microsoft Foundry (55–60%)

Implement generative AI apps and agents by using Foundry

Implement AI solutions for text and speech by using Foundry

Implement AI solutions with computer vision and image-generation capabilities by using Foundry

Implement AI solutions for information extraction by using Foundry


AI-901 Practice Exams


Important AI-901 Resources


Good luck to you on your data journey!

Extract information from images by using Content Understanding (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement AI solutions for information extraction by using Foundry
--> Extract information from images by using Content Understanding


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Modern AI systems can analyze images and extract meaningful information automatically. Organizations use image analysis solutions for automation, accessibility, security, healthcare, retail, and business intelligence.

For the AI-901 certification exam, candidates should understand the foundational concepts behind extracting information from images by using Azure Content Understanding and Microsoft Foundry tools.

This topic falls under the “Implement AI solutions for information extraction by using Foundry” section of the AI-901 exam objectives.


What Is Image Information Extraction?

Image information extraction is the process of analyzing images to identify and retrieve useful information.

AI systems can detect:

  • Text
  • Objects
  • Faces
  • Colors
  • Products
  • Landmarks
  • Visual patterns

What Is Azure Content Understanding?

Azure Content Understanding enables AI systems to interpret and analyze content such as:

  • Images
  • Documents
  • Audio
  • Video

Capabilities include:

  • OCR
  • Object detection
  • Classification
  • Caption generation
  • Metadata extraction

Azure AI Foundry

Azure AI Foundry provides tools for building, testing, and managing AI-powered applications.

Developers can:

  • Access AI models
  • Analyze images
  • Build lightweight applications
  • Test AI workflows

Common Image Extraction Techniques


Optical Character Recognition (OCR)

OCR extracts text from images.


Example

Image

Photo of a street sign

OCR Output

“Main Street”


Object Detection

Object detection identifies objects and their locations within images.


Example

Detected Objects

  • Car
  • Bicycle
  • Traffic light
  • Person

Image Classification

Image classification determines the overall category of an image.


Example

Image

Photo of a cat

Classification

“Cat”


Facial Analysis

AI systems can analyze facial characteristics.

Capabilities may include:

  • Face detection
  • Emotion analysis
  • Age estimation

Responsible AI considerations are especially important for facial-analysis systems.


Image Captioning

Image captioning generates natural-language descriptions of images.


Example

Image

A dog running on a beach

Caption

“A brown dog running along a sandy beach.”


Metadata Extraction

AI systems can extract metadata and contextual information from images.

Examples include:

  • Time
  • Location
  • Camera details
  • Image dimensions

Barcode and QR Code Detection

AI systems can identify and decode:

  • Barcodes
  • QR codes

Example

Retail applications may scan product barcodes for inventory management.


APIs and Endpoints

Applications communicate with Azure AI services using:

  • APIs
  • Endpoints

Images are submitted programmatically for analysis.


Authentication

Applications must securely authenticate before accessing AI services.

Common methods include:

  • API keys
  • Azure credentials
  • Managed identities

Lightweight Application Workflow

A typical workflow includes:

  1. User uploads image
  2. Application sends image to AI service
  3. AI analyzes image
  4. Results are returned
  5. Application displays extracted information

Example High-Level Pseudocode

image = upload_image()
results = analyze_image(image)
display_results(results)

For AI-901, understanding the workflow is more important than memorizing exact syntax.


Common Real-World Scenarios


Scenario 1: Receipt Scanner

Goal

Extract purchase details from receipt images.

Features

  • OCR
  • Table extraction
  • Total amount detection

Scenario 2: Accessibility Assistant

Goal

Describe images for visually impaired users.

Features

  • Image captioning
  • OCR
  • Object detection

Scenario 3: Retail Inventory

Goal

Identify products from shelf images.

Features

  • Barcode scanning
  • Object detection
  • Classification

Scenario 4: Traffic Monitoring

Goal

Analyze roadway images.

Features

  • Vehicle detection
  • Traffic analysis
  • License plate reading

Responsible AI Considerations

Image-analysis applications should follow Responsible AI principles.

Key considerations include:

  • Privacy
  • Fairness
  • Transparency
  • Inclusiveness
  • Accountability
  • Security

Privacy Concerns

Images may contain:

  • Faces
  • Personal information
  • License plates
  • Sensitive documents

Organizations should protect image data appropriately.


Fairness and Bias

Vision systems may perform differently across:

  • Lighting conditions
  • Skin tones
  • Environmental conditions
  • Camera quality

Testing and evaluation are important.


Transparency

Users should understand:

  • AI is analyzing images
  • AI-generated outputs may contain errors
  • Images may be processed in the cloud

Accuracy Limitations

Image extraction systems may struggle with:

  • Blurry images
  • Poor lighting
  • Obstructed objects
  • Low-resolution images

Hallucinations and Errors

AI systems may occasionally:

  • Misidentify objects
  • Generate incorrect captions
  • Extract inaccurate text

Applications should validate important outputs.


Error Handling

Applications should handle:

  • Unsupported image formats
  • Corrupted files
  • Authentication failures
  • Network interruptions
  • Rate limits

Advantages of Image Extraction AI

Benefits include:

  • Faster processing
  • Automation
  • Scalability
  • Accessibility improvements
  • Reduced manual work

Limitations of Image Extraction AI

Challenges include:

  • Accuracy limitations
  • Bias
  • Privacy concerns
  • Environmental variability
  • Ethical considerations

Multimodal AI

Some modern AI systems combine:

  • Vision
  • Text
  • Speech
  • Generative AI

These systems can:

  • Analyze images
  • Answer visual questions
  • Generate descriptions
  • Create new content

High-Level Architecture

A simplified architecture often includes:

  1. User uploads image
  2. Application sends image to Azure AI service
  3. AI processes image
  4. Structured results are returned
  5. Application displays information

Important AI-901 Exam Tips

For the exam, remember these key points:

  • OCR extracts text from images.
  • Object detection identifies objects and locations.
  • Image classification categorizes images.
  • Image captioning generates natural-language descriptions.
  • APIs and endpoints connect applications to AI services.
  • Authentication secures access to AI resources.
  • Responsible AI principles apply to image-analysis systems.
  • Poor image quality can reduce accuracy.
  • Hallucinations are inaccurate AI-generated outputs.
  • Azure AI Foundry supports AI application development.

Quick Knowledge Check

Question 1

What does OCR do?

Answer

Extracts machine-readable text from images.


Question 2

What is object detection?

Answer

Identifying and locating objects within an image.


Question 3

Why is authentication important?

Answer

It secures access to Azure AI services.


Question 4

What can reduce image-analysis accuracy?

Answer

Poor lighting, blur, and low-resolution images.


Practice Exam Questions

Exam: AI-901

Topic: Extract Information from Images by Using Content Understanding


Question 1

What is the PRIMARY purpose of image information extraction?

A. To analyze images and retrieve useful information
B. To increase internet bandwidth
C. To manage operating systems
D. To improve printer performance


Correct Answer

A. To analyze images and retrieve useful information


Explanation

Image information extraction uses AI to identify and retrieve meaningful data from images, such as text, objects, and visual patterns.


Why the Other Answers Are Incorrect

B. To increase internet bandwidth

Image analysis does not affect networking speed.

C. To manage operating systems

This is unrelated to computer vision.

D. To improve printer performance

Printers are unrelated to AI image extraction.


Question 2

What does OCR stand for?

A. Optical Character Recognition
B. Open Content Routing
C. Object Classification Reporting
D. Operational Cloud Rendering


Correct Answer

A. Optical Character Recognition


Explanation

OCR extracts machine-readable text from images and scanned documents.


Why the Other Answers Are Incorrect

B. Open Content Routing

This is not the meaning of OCR.

C. Object Classification Reporting

This is unrelated to text extraction.

D. Operational Cloud Rendering

This is not an OCR term.


Question 3

Which computer vision capability identifies multiple objects and their locations within an image?

A. Object detection
B. Speech synthesis
C. Text summarization
D. Audio transcription


Correct Answer

A. Object detection


Explanation

Object detection identifies objects and determines where they appear within an image.


Why the Other Answers Are Incorrect

B. Speech synthesis

This converts text into speech.

C. Text summarization

This is a text-analysis task.

D. Audio transcription

This converts speech into text.


Question 4

What is image classification?

A. Categorizing an image based on its contents
B. Compressing image file sizes
C. Encrypting image data
D. Converting images into spreadsheets


Correct Answer

A. Categorizing an image based on its contents


Explanation

Image classification determines the overall category or subject represented in an image.


Why the Other Answers Are Incorrect

B. Compressing image file sizes

Compression is unrelated to classification.

C. Encrypting image data

Encryption is unrelated to image categorization.

D. Converting images into spreadsheets

This is unrelated to computer vision.


Question 5

What does image captioning do?

A. Generates natural-language descriptions of images
B. Repairs corrupted image files
C. Converts speech into text
D. Improves internet speeds


Correct Answer

A. Generates natural-language descriptions of images


Explanation

Image captioning creates descriptive text that explains the contents of an image.


Why the Other Answers Are Incorrect

B. Repairs corrupted image files

This is unrelated to caption generation.

C. Converts speech into text

This is speech recognition.

D. Improves internet speeds

This is unrelated to AI image analysis.


Question 6

How do lightweight image-analysis applications typically communicate with Azure AI services?

A. Through APIs and endpoints
B. Through printer drivers
C. Through monitor settings
D. Through USB-only connections


Correct Answer

A. Through APIs and endpoints


Explanation

Applications send images to cloud AI services through APIs and service endpoints.


Why the Other Answers Are Incorrect

B. Through printer drivers

Printers are unrelated to AI communication.

C. Through monitor settings

This is unrelated to cloud AI services.

D. Through USB-only connections

Cloud services use network communication.


Question 7

Why is authentication important when using Azure AI services?

A. To secure access to AI resources
B. To improve image brightness
C. To reduce image resolution
D. To increase network speed


Correct Answer

A. To secure access to AI resources


Explanation

Authentication ensures that only authorized users and applications can access Azure AI services.


Why the Other Answers Are Incorrect

B. To improve image brightness

Authentication does not affect image quality.

C. To reduce image resolution

Authentication is unrelated to image resolution.

D. To increase network speed

Authentication does not improve internet performance.


Question 8

Which Responsible AI concern is especially important for image-analysis systems?

A. Protecting personal and sensitive visual information
B. Increasing printer speed
C. Improving spreadsheet formulas
D. Reducing monitor power usage


Correct Answer

A. Protecting personal and sensitive visual information


Explanation

Images may contain sensitive information such as faces, license plates, and documents that must be protected.


Why the Other Answers Are Incorrect

B. Increasing printer speed

This is unrelated to Responsible AI.

C. Improving spreadsheet formulas

This is unrelated to image analysis.

D. Reducing monitor power usage

This is unrelated to AI ethics.


Question 9

Which factor can reduce image-analysis accuracy?

A. Poor image quality
B. Spreadsheet formatting
C. Keyboard layout changes
D. Audio playback speed


Correct Answer

A. Poor image quality


Explanation

Blur, poor lighting, and low-resolution images can negatively affect AI analysis accuracy.


Why the Other Answers Are Incorrect

B. Spreadsheet formatting

This does not affect image AI systems.

C. Keyboard layout changes

This is unrelated to computer vision.

D. Audio playback speed

This is unrelated to image processing.


Question 10

What are hallucinations in AI image-analysis systems?

A. Incorrect or fabricated AI-generated outputs
B. Hardware installation failures
C. Network outages
D. Audio recording problems


Correct Answer

A. Incorrect or fabricated AI-generated outputs


Explanation

Hallucinations occur when AI systems generate inaccurate captions, object identifications, or extracted information.


Why the Other Answers Are Incorrect

B. Hardware installation failures

This is unrelated to AI-generated outputs.

C. Network outages

This is a connectivity issue.

D. Audio recording problems

This is unrelated to image-analysis systems.


Final Thoughts

Extracting information from images by using Content Understanding is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand foundational concepts such as OCR, object detection, image classification, APIs, authentication, Responsible AI principles, and lightweight image-analysis workflows.

Azure AI services and Azure AI Foundry provide powerful tools for building scalable AI applications capable of understanding and extracting valuable information from visual content.


Go to the AI-901 Exam Prep Hub main page

Extract information from documents and forms by using Azure Content Understanding in Foundry Tools (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement AI solutions for information extraction by using Foundry
--> Extract information from documents and forms by using Azure Content Understanding in Foundry Tools


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Organizations process enormous amounts of documents every day, including invoices, receipts, forms, contracts, and identification documents. AI-powered information extraction solutions help automate the process of reading, understanding, and organizing document data.

For the AI-901 certification exam, candidates should understand the foundational concepts behind extracting information from documents and forms by using Azure Content Understanding and Microsoft Foundry tools.

This topic falls under the “Implement AI solutions for information extraction by using Foundry” section of the AI-901 exam objectives.


What Is Information Extraction?

Information extraction is the process of identifying and retrieving useful data from documents, images, forms, audio, or other content.

Examples include extracting:

  • Names
  • Dates
  • Invoice totals
  • Addresses
  • Phone numbers
  • Product information

What Is Azure Content Understanding?

Azure Content Understanding helps AI systems analyze and interpret structured and unstructured documents.

Capabilities include:

  • Text extraction
  • Form recognition
  • Document analysis
  • Information classification
  • Key-value pair extraction

Azure AI Foundry

Azure AI Foundry provides tools for building, testing, and managing AI-powered applications.

Developers can:

  • Configure AI services
  • Process documents
  • Test extraction workflows
  • Build lightweight AI applications

Structured vs. Unstructured Documents


Structured Documents

Structured documents follow a consistent layout.

Examples include:

  • Tax forms
  • Invoices
  • Receipts
  • Application forms

Unstructured Documents

Unstructured documents have less predictable layouts.

Examples include:

  • Emails
  • Letters
  • Articles
  • Contracts

Optical Character Recognition (OCR)

OCR converts text within images or scanned documents into machine-readable text.


Example

Input

Scanned receipt image

OCR Output

  • Store name
  • Date
  • Total amount

Form Recognition

Form recognition identifies fields and values within forms.


Example

Form

Insurance application

Extracted Data

  • Customer name
  • Policy number
  • Address
  • Claim amount

Key-Value Pair Extraction

AI systems can identify relationships between labels and values.


Example

KeyValue
Invoice NumberINV-1045
Total$250.00
Due Date05/30/2026

Table Extraction

AI can identify and extract tables from documents.


Example

A receipt table may contain:

  • Item names
  • Quantities
  • Prices

Classification

Document classification identifies the type of document being processed.


Example

The system determines whether a file is:

  • Invoice
  • Contract
  • Receipt
  • Resume

Named Entity Recognition (NER)

NER identifies important entities within text.

Entities may include:

  • People
  • Organizations
  • Locations
  • Dates

Example

Text

“John Smith works for Contoso in Seattle.”

Extracted Entities

  • John Smith (Person)
  • Contoso (Organization)
  • Seattle (Location)

APIs and Endpoints

Applications communicate with Azure AI services through:

  • APIs
  • Endpoints

Documents are submitted for analysis programmatically.


Authentication

Applications must securely authenticate before accessing Azure AI services.

Common authentication methods include:

  • API keys
  • Azure credentials
  • Managed identities

Lightweight Application Workflow

A typical workflow includes:

  1. User uploads document
  2. Application sends file to AI service
  3. AI extracts information
  4. Results are returned
  5. Application displays or stores extracted data

Example Workflow

Input

Scanned invoice

AI Processing

  • OCR
  • Key-value extraction
  • Table analysis

Output

Structured invoice data


Example High-Level Pseudocode

document = upload_document()
results = analyze_document(document)
display_results(results)

For AI-901, understanding the workflow is more important than memorizing exact syntax.


Common Real-World Scenarios


Scenario 1: Invoice Processing

Goal

Automate invoice data extraction.

Features

  • OCR
  • Table extraction
  • Total amount detection

Scenario 2: Receipt Scanning

Goal

Extract purchase information from receipts.

Features

  • Text extraction
  • Merchant identification
  • Expense categorization

Scenario 3: Resume Processing

Goal

Extract candidate information from resumes.

Features

  • Name extraction
  • Skill identification
  • Contact information detection

Scenario 4: Healthcare Forms

Goal

Digitize patient records.

Features

  • Form recognition
  • Key-value extraction
  • Classification

Responsible AI Considerations

Document-processing applications should follow Responsible AI principles.

Key considerations include:

  • Privacy
  • Security
  • Fairness
  • Transparency
  • Accountability
  • Inclusiveness

Privacy Concerns

Documents may contain:

  • Personal information
  • Financial data
  • Medical information
  • Legal records

Organizations should protect sensitive data appropriately.


Security Considerations

Applications should secure:

  • Uploaded files
  • Stored documents
  • API credentials
  • Extracted data

Transparency

Users should understand:

  • AI is analyzing documents
  • Extracted data may contain errors
  • Human review may still be needed

Accuracy Limitations

AI extraction systems may struggle with:

  • Poor scan quality
  • Handwritten text
  • Complex layouts
  • Damaged documents

Hallucinations and Errors

AI systems may occasionally:

  • Extract incorrect values
  • Miss fields
  • Misclassify documents

Applications should validate important information.


Error Handling

Applications should handle:

  • Unsupported file formats
  • Corrupted documents
  • Authentication failures
  • Network interruptions
  • Rate limits

Advantages of Information Extraction AI

Benefits include:

  • Faster document processing
  • Reduced manual entry
  • Improved scalability
  • Increased automation
  • Better searchability

Limitations of Information Extraction AI

Challenges include:

  • Variable document quality
  • Handwriting recognition difficulties
  • Inconsistent layouts
  • Privacy concerns
  • Extraction inaccuracies

Generative AI and Information Extraction

Some modern systems combine:

  • OCR
  • Document intelligence
  • Generative AI

This enables:

  • Summarization
  • Question answering
  • Conversational document analysis

High-Level Architecture

A simplified architecture often includes:

  1. User uploads document
  2. Application sends document to Azure AI service
  3. AI analyzes content
  4. Structured data is returned
  5. Application displays or stores results

Important AI-901 Exam Tips

For the exam, remember these key points:

  • OCR extracts text from documents and images.
  • Form recognition identifies fields and values.
  • Key-value extraction identifies label-value relationships.
  • Table extraction retrieves structured table data.
  • Classification identifies document types.
  • APIs and endpoints connect applications to Azure AI services.
  • Authentication secures access to AI resources.
  • Responsible AI principles apply to document-processing systems.
  • Poor document quality can reduce extraction accuracy.
  • AI-generated outputs may still require validation.

Quick Knowledge Check

Question 1

What does OCR do?

Answer

Extracts machine-readable text from images or scanned documents.


Question 2

What is form recognition?

Answer

Identifying and extracting fields and values from forms.


Question 3

Why is authentication important?

Answer

It secures access to Azure AI services and protects resources.


Question 4

What can reduce extraction accuracy?

Answer

Poor scan quality, handwriting, and inconsistent document layouts.


Practice Exam Questions

Exam: AI-901

Topic: Extract Information from Documents and Forms by Using Azure Content Understanding in Foundry Tools


Question 1

What is the PRIMARY purpose of information extraction AI solutions?

A. To retrieve useful data from documents and content
B. To increase internet bandwidth
C. To replace operating systems
D. To improve monitor resolution


Correct Answer

A. To retrieve useful data from documents and content


Explanation

Information extraction AI systems identify and retrieve meaningful information such as names, dates, totals, and addresses from documents and forms.


Why the Other Answers Are Incorrect

B. To increase internet bandwidth

Information extraction does not affect network speed.

C. To replace operating systems

AI document processing does not replace operating systems.

D. To improve monitor resolution

This is unrelated to AI information extraction.


Question 2

What does OCR stand for?

A. Optical Character Recognition
B. Open Content Retrieval
C. Object Classification Routing
D. Operational Compute Reporting


Correct Answer

A. Optical Character Recognition


Explanation

OCR converts printed or handwritten text within images and scanned documents into machine-readable text.


Why the Other Answers Are Incorrect

B. Open Content Retrieval

This is not the meaning of OCR.

C. Object Classification Routing

This is unrelated to document analysis.

D. Operational Compute Reporting

This is not an OCR term.


Question 3

Which AI capability identifies fields and values within forms?

A. Form recognition
B. Speech synthesis
C. Image compression
D. Network monitoring


Correct Answer

A. Form recognition


Explanation

Form recognition extracts structured information such as names, dates, totals, and addresses from forms and documents.


Why the Other Answers Are Incorrect

B. Speech synthesis

This converts text into speech.

C. Image compression

This reduces file size and is unrelated to field extraction.

D. Network monitoring

This is unrelated to document AI.


Question 4

Which Azure platform provides tools for building and managing AI-powered applications?

A. Azure AI Foundry
B. Microsoft Paint
C. Windows Task Manager
D. Azure DNS


Correct Answer

A. Azure AI Foundry


Explanation

Azure AI Foundry provides tools for deploying, testing, and managing AI applications and services.


Why the Other Answers Are Incorrect

B. Microsoft Paint

Paint is a graphics editor.

C. Windows Task Manager

This is a system monitoring tool.

D. Azure DNS

This is a networking service.


Question 5

What is key-value pair extraction?

A. Identifying labels and their associated values in documents
B. Encrypting document files
C. Compressing image sizes
D. Converting audio into text


Correct Answer

A. Identifying labels and their associated values in documents


Explanation

Key-value extraction identifies relationships such as:

  • Invoice Number → INV-1045
  • Total → $250.00

Why the Other Answers Are Incorrect

B. Encrypting document files

Encryption is unrelated to data extraction.

C. Compressing image sizes

Compression is unrelated to document intelligence.

D. Converting audio into text

This is speech recognition.


Question 6

What is the purpose of document classification?

A. To identify the type of document being processed
B. To increase network performance
C. To generate music files
D. To repair damaged documents physically


Correct Answer

A. To identify the type of document being processed


Explanation

Document classification determines whether a file is an invoice, contract, receipt, resume, or another document type.


Why the Other Answers Are Incorrect

B. To increase network performance

Classification does not improve networking.

C. To generate music files

This is unrelated to document AI.

D. To repair damaged documents physically

AI classification does not physically repair documents.


Question 7

How do lightweight document-processing applications typically communicate with Azure AI services?

A. Through APIs and endpoints
B. Through USB-only connections
C. Through monitor calibration tools
D. Through printer drivers


Correct Answer

A. Through APIs and endpoints


Explanation

Applications send documents to Azure AI services using APIs and endpoints and receive structured analysis results.


Why the Other Answers Are Incorrect

B. Through USB-only connections

Cloud services use network communication.

C. Through monitor calibration tools

This is unrelated to AI services.

D. Through printer drivers

Printers are unrelated to cloud AI communication.


Question 8

Which factor can reduce the accuracy of document extraction systems?

A. Poor document quality
B. Spreadsheet color themes
C. Keyboard layout changes
D. Audio playback speed


Correct Answer

A. Poor document quality


Explanation

Blurry scans, damaged pages, handwriting, and poor lighting can negatively affect extraction accuracy.


Why the Other Answers Are Incorrect

B. Spreadsheet color themes

This does not affect document extraction AI.

C. Keyboard layout changes

This is unrelated to AI document analysis.

D. Audio playback speed

This is unrelated to document processing.


Question 9

Why is authentication important when using Azure AI services?

A. To secure access to AI resources
B. To improve image resolution
C. To increase internet speed
D. To compress document files


Correct Answer

A. To secure access to AI resources


Explanation

Authentication ensures that only authorized users and applications can access AI services.


Why the Other Answers Are Incorrect

B. To improve image resolution

Authentication does not affect image quality.

C. To increase internet speed

Authentication does not improve networking.

D. To compress document files

Authentication is unrelated to file compression.


Question 10

Which Responsible AI concern is especially important when processing documents?

A. Protecting sensitive personal information
B. Increasing monitor brightness
C. Improving printer speed
D. Reducing spreadsheet file size


Correct Answer

A. Protecting sensitive personal information


Explanation

Documents may contain financial, medical, legal, or personal information that must be protected appropriately.


Why the Other Answers Are Incorrect

B. Increasing monitor brightness

This is unrelated to Responsible AI.

C. Improving printer speed

This is unrelated to document intelligence.

D. Reducing spreadsheet file size

This is unrelated to AI ethics or privacy.


Final Thoughts

Extracting information from documents and forms using Azure Content Understanding and Foundry tools is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand foundational concepts such as OCR, form recognition, document analysis, APIs, authentication, Responsible AI principles, and lightweight document-processing workflows.

Azure AI services and Azure AI Foundry provide powerful tools for automating information extraction and improving efficiency across business, healthcare, finance, and administrative scenarios.


Go to the AI-901 Exam Prep Hub main page

Interpret visual input in prompts by using a deployed multimodal model (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement AI solutions with computer vision and image-generation capabilities by using Foundry
--> Interpret visual input in prompts by using a deployed multimodal model


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Modern AI systems are increasingly capable of understanding not only text and speech, but also visual information such as images and videos. Multimodal AI models combine multiple forms of input to generate intelligent responses and insights.

For the AI-901 certification exam, candidates should understand the foundational concepts behind interpreting visual input in prompts by using deployed multimodal models through Microsoft Azure AI Foundry and related Azure AI services.

This topic falls under the “Implement AI solutions with computer vision and image-generation capabilities by using Foundry” section of the AI-901 exam objectives.


What Is a Multimodal Model?

A multimodal model is an AI model capable of processing multiple types of input and output.

These modalities may include:

  • Text
  • Images
  • Speech/audio
  • Video

Multimodal models can combine information across different input types to generate responses.


What Is Visual Input?

Visual input refers to image or video data provided to an AI system.

Examples include:

  • Photographs
  • Screenshots
  • Documents
  • Charts
  • Diagrams
  • Videos

Example Visual Prompt

A user uploads a photo and asks:

“What objects are visible in this image?”

The AI analyzes the visual content and generates a response.


Computer Vision

Computer vision is the field of AI focused on enabling systems to interpret and understand visual information.

Computer vision tasks include:

  • Image classification
  • Object detection
  • Facial analysis
  • Optical character recognition (OCR)
  • Image captioning

Azure AI Vision

Azure AI Vision provides computer vision capabilities in Azure.

Features include:

  • Image analysis
  • OCR
  • Object detection
  • Image captioning
  • Face-related analysis

Azure AI Foundry

Azure AI Foundry provides tools for building and managing multimodal AI applications.

Developers can:

  • Deploy AI models
  • Test prompts
  • Analyze images
  • Build AI-powered apps

Deployed Models

A deployed model is an AI model made available for real-time use through a cloud endpoint.

Applications communicate with deployed models using APIs.


Visual Prompt Workflow

A common workflow includes:

  1. User uploads image
  2. Application sends image to multimodal model
  3. Model analyzes visual content
  4. Model generates response
  5. Application displays results

Example Workflow

User Uploads Image

A photo of a dog playing in a park

User Prompt

“Describe this image.”

AI Response

“A brown dog is running through a grassy park.”


Image Classification

Image classification identifies the primary category of an image.


Example

Image

Picture of a cat

Classification

“Cat”


Object Detection

Object detection identifies and locates multiple objects within an image.


Example

Image

Street scene

Detected Objects

  • Car
  • Bicycle
  • Traffic light
  • Pedestrian

Optical Character Recognition (OCR)

OCR extracts text from images or scanned documents.


Example

Image

Photo of a receipt

Extracted Text

  • Store name
  • Total amount
  • Date

Image Captioning

Image captioning generates natural-language descriptions of images.


Example

Image

A child flying a kite

Caption

“A child flying a colorful kite in a field.”


Visual Question Answering

Some multimodal models can answer questions about images.


Example

Prompt

“How many people are in the image?”

The model analyzes the image and generates an answer.


Combining Text and Images

Multimodal systems often combine:

  • Text prompts
  • Visual input

This improves contextual understanding.


Example

Image

A restaurant menu

Prompt

“Which item appears to be vegetarian?”

The AI analyzes both the image and the prompt together.


APIs and Endpoints

Applications communicate with deployed multimodal models through:

  • APIs
  • Endpoints

These allow images and prompts to be submitted programmatically.


Authentication

Applications must securely authenticate before accessing Azure AI services.

Common methods include:

  • API keys
  • Azure credentials
  • Managed identities

User Interface Components

A lightweight visual AI application may include:

  • Image upload area
  • Prompt input box
  • Results display
  • Image preview

Real-Time Processing

Many multimodal applications support near real-time image analysis.

This enables interactive user experiences.


Common Real-World Scenarios


Scenario 1: Accessibility Assistant

Goal

Describe visual content for visually impaired users.

Features

  • Image captioning
  • OCR
  • Voice output

Scenario 2: Retail Product Recognition

Goal

Identify products from images.

Features

  • Object detection
  • Classification
  • Product lookup

Scenario 3: Document Processing

Goal

Extract information from scanned forms.

Features

  • OCR
  • Text extraction
  • Data analysis

Scenario 4: Content Moderation

Goal

Identify harmful or unsafe visual content.

Features

  • Image analysis
  • Safety filtering
  • Automated moderation

Responsible AI Considerations

Visual AI applications should follow Responsible AI principles.

Key considerations include:

  • Privacy
  • Fairness
  • Transparency
  • Inclusiveness
  • Accountability
  • Security

Privacy Concerns

Images may contain:

  • Personal information
  • Faces
  • Sensitive documents

Organizations should protect user data appropriately.


Bias and Fairness

Computer vision systems may perform unevenly across:

  • Skin tones
  • Age groups
  • Lighting conditions
  • Demographics

Organizations should evaluate models carefully for fairness.


Transparency

Users should understand:

  • AI is analyzing images
  • AI-generated descriptions may contain errors
  • Images may be stored or processed in the cloud

Hallucinations

Multimodal AI systems may generate inaccurate visual descriptions.

These incorrect outputs are called hallucinations.

Applications should not assume all AI-generated outputs are accurate.


Error Handling

Applications should handle:

  • Unsupported image formats
  • Low-quality images
  • Network failures
  • Authentication errors
  • Rate limits

Image Quality Challenges

Poor image quality can reduce accuracy.

Examples include:

  • Blurry images
  • Poor lighting
  • Occluded objects
  • Low resolution

Advantages of Visual AI Applications

Benefits include:

  • Automation
  • Faster analysis
  • Accessibility improvements
  • Improved user experiences
  • Scalable image processing

Limitations of Visual AI Applications

Challenges include:

  • Recognition inaccuracies
  • Bias
  • Privacy concerns
  • Hallucinations
  • Sensitivity to image quality

High-Level Workflow

A simplified workflow includes:

  1. Upload image
  2. Send image and prompt to model
  3. Analyze visual content
  4. Generate response
  5. Display results

Example High-Level Pseudocode

image = upload_image()
prompt = get_prompt()
response = analyze_image(image, prompt)
display_response(response)

For AI-901, understanding the workflow is more important than memorizing exact syntax.


Important AI-901 Exam Tips

For the exam, remember these key points:

  • Multimodal models process multiple data types.
  • Visual input includes images and video.
  • Azure AI Vision supports computer vision workloads.
  • OCR extracts text from images.
  • Image captioning generates descriptions of images.
  • Object detection identifies multiple objects in images.
  • APIs and endpoints connect applications to AI services.
  • Authentication secures AI access.
  • Responsible AI principles apply to computer vision systems.
  • Hallucinations are inaccurate AI-generated outputs.

Quick Knowledge Check

Question 1

What is OCR used for?

Answer

Extracting text from images or scanned documents.


Question 2

What does image captioning do?

Answer

Generates natural-language descriptions of images.


Question 3

Why are multimodal models useful?

Answer

They can process multiple types of input such as text and images together.


Question 4

Why is fairness important in computer vision?

Answer

To reduce biased or uneven performance across different groups of people.


Practice Exam Questions

Question 1

What is a multimodal AI model?

A. A model that processes only text
B. A model capable of processing multiple types of input such as text and images
C. A model used only for networking
D. A model designed exclusively for spreadsheets


Correct Answer

B. A model capable of processing multiple types of input such as text and images


Explanation

Multimodal models can process and combine different forms of input, including text, images, audio, and video.


Why the Other Answers Are Incorrect

A. A model that processes only text

That describes a text-only model.

C. A model used only for networking

Networking is unrelated to multimodal AI.

D. A model designed exclusively for spreadsheets

This is unrelated to AI modalities.


Question 2

Which Azure service provides computer vision capabilities such as image analysis and OCR?

A. Azure AI Vision
B. Azure Backup
C. Azure Virtual Desktop
D. Azure Monitor


Correct Answer

A. Azure AI Vision


Explanation

Azure AI Vision provides computer vision features including OCR, object detection, and image captioning.


Why the Other Answers Are Incorrect

B. Azure Backup

This is a backup service.

C. Azure Virtual Desktop

This provides desktop virtualization.

D. Azure Monitor

This is used for monitoring and diagnostics.


Question 3

What does OCR stand for?

A. Optical Character Recognition
B. Operational Cloud Routing
C. Object Classification Registry
D. Open Compute Rendering


Correct Answer

A. Optical Character Recognition


Explanation

OCR extracts text from images or scanned documents.


Why the Other Answers Are Incorrect

B. Operational Cloud Routing

This is not an AI vision term.

C. Object Classification Registry

This is not the meaning of OCR.

D. Open Compute Rendering

This is unrelated to text extraction.


Question 4

What is the PRIMARY purpose of object detection?

A. To identify and locate objects within an image
B. To translate speech into text
C. To summarize long documents
D. To improve internet speed


Correct Answer

A. To identify and locate objects within an image


Explanation

Object detection identifies multiple objects and their positions within an image.


Why the Other Answers Are Incorrect

B. To translate speech into text

This is a speech recognition task.

C. To summarize long documents

This is a text analysis task.

D. To improve internet speed

Object detection does not affect networking.


Question 5

What does image captioning do?

A. Generates natural-language descriptions of images
B. Converts text into audio
C. Detects malware in files
D. Compresses images automatically


Correct Answer

A. Generates natural-language descriptions of images


Explanation

Image captioning uses AI to describe visual content in natural language.


Why the Other Answers Are Incorrect

B. Converts text into audio

This is speech synthesis.

C. Detects malware in files

This is unrelated to computer vision.

D. Compresses images automatically

Captioning does not perform compression.


Question 6

How do applications typically communicate with deployed multimodal models?

A. Through APIs and endpoints
B. Through USB-only connections
C. Through monitor drivers
D. Through spreadsheet templates


Correct Answer

A. Through APIs and endpoints


Explanation

Applications use APIs and endpoints to send prompts and images to AI services.


Why the Other Answers Are Incorrect

B. Through USB-only connections

Cloud AI services use network communication.

C. Through monitor drivers

These are unrelated to AI communication.

D. Through spreadsheet templates

This is unrelated to AI integration.


Question 7

Why is authentication important when accessing Azure AI services?

A. To secure access to AI resources
B. To increase image resolution
C. To improve keyboard performance
D. To reduce monitor brightness


Correct Answer

A. To secure access to AI resources


Explanation

Authentication ensures that only authorized users and applications can access Azure AI services.


Why the Other Answers Are Incorrect

B. To increase image resolution

Authentication does not affect image quality.

C. To improve keyboard performance

This is unrelated to AI services.

D. To reduce monitor brightness

Authentication does not control display settings.


Question 8

Which Responsible AI concern is especially important when analyzing images?

A. Protecting personal and sensitive visual information
B. Increasing video frame rates
C. Improving printer output quality
D. Accelerating spreadsheet calculations


Correct Answer

A. Protecting personal and sensitive visual information


Explanation

Images may contain faces, documents, or other sensitive information that must be protected.


Why the Other Answers Are Incorrect

B. Increasing video frame rates

This is unrelated to Responsible AI.

C. Improving printer output quality

Printers are unrelated to computer vision ethics.

D. Accelerating spreadsheet calculations

This is unrelated to image analysis.


Question 9

What are hallucinations in multimodal AI systems?

A. Incorrect or fabricated AI-generated outputs
B. Hardware installation failures
C. Internet connectivity issues
D. Audio recording problems


Correct Answer

A. Incorrect or fabricated AI-generated outputs


Explanation

Hallucinations occur when AI generates inaccurate or invented descriptions or answers.


Why the Other Answers Are Incorrect

B. Hardware installation failures

This is unrelated to AI-generated content.

C. Internet connectivity issues

This is a networking problem.

D. Audio recording problems

This relates to audio hardware or software.


Question 10

Which factor can negatively affect computer vision accuracy?

A. Poor image quality
B. Spreadsheet formatting
C. Screen brightness settings
D. Keyboard layout


Correct Answer

A. Poor image quality


Explanation

Blurry images, poor lighting, and low resolution can reduce computer vision accuracy.


Why the Other Answers Are Incorrect

B. Spreadsheet formatting

This does not affect image analysis.

C. Screen brightness settings

This does not directly affect AI image processing.

D. Keyboard layout

Keyboard settings are unrelated to computer vision.


Final Thoughts

Interpreting visual input using deployed multimodal models is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the foundational concepts behind computer vision and multimodal AI applications, including image analysis, OCR, object detection, image captioning, APIs, authentication, and Responsible AI principles.

Azure AI Vision and Azure AI Foundry provide powerful tools for building intelligent applications capable of understanding and responding to visual information in real-world scenarios.


Go to the AI-901 Exam Prep Hub main page

Build a lightweight application that includes text analysis (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement AI solutions for text and speech by using Foundry
--> Build a lightweight application that includes text analysis


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Text analysis is one of the most common AI workloads used in modern applications. Organizations use AI-powered text analysis to extract meaning, identify sentiment, detect entities, summarize content, and automate language-related tasks.

For the AI-901 certification exam, candidates should understand the foundational concepts behind building lightweight applications that use text analysis services through Microsoft Azure AI Foundry and Azure AI services.

This topic falls under the “Implement AI solutions for text and speech by using Foundry” section of the AI-901 exam objectives.


What Is Text Analysis?

Text analysis is the process of using AI to extract meaning and insights from written language.

AI systems analyze text to identify:

  • Sentiment
  • Key phrases
  • Named entities
  • Language
  • Topics
  • Summaries

Examples of Text Analysis Applications

Organizations use text analysis in:

  • Customer feedback systems
  • Chatbots
  • Social media monitoring
  • Document analysis
  • Customer support automation
  • Content moderation

What Is a Lightweight Application?

A lightweight application is a simple application focused on core functionality.

Characteristics include:

  • Minimal interface
  • Reduced complexity
  • Fast deployment
  • Lower resource usage

Common Lightweight Text Analysis Applications

Examples include:

  • Sentiment analysis web apps
  • Customer review analyzers
  • Document summarization tools
  • Language detection apps
  • Keyword extraction utilities

Azure AI Foundry

Azure AI Foundry provides tools for creating and managing AI-powered applications.

Developers can:

  • Access AI services
  • Build applications
  • Test models
  • Configure AI workflows

Azure AI Language Services

Azure AI Language provides text analysis capabilities.

These services support:

  • Sentiment analysis
  • Entity recognition
  • Key phrase extraction
  • Summarization
  • Language detection

Basic Text Analysis Workflow

A typical workflow includes:

  1. User submits text
  2. Application sends text to AI service
  3. AI service analyzes text
  4. Service returns results
  5. Application displays insights

Example Workflow

User Input

“The customer service was excellent, but shipping was slow.”

AI Analysis

  • Positive sentiment: customer service
  • Negative sentiment: shipping delay

APIs and Endpoints

Applications communicate with AI services through APIs and endpoints.

The application sends requests containing text and receives analysis results.


Authentication

Applications must authenticate securely before accessing AI services.

Common methods include:

  • API keys
  • Azure credentials
  • Managed identities

Sentiment Analysis

Sentiment analysis identifies emotional tone in text.

Common sentiment categories:

  • Positive
  • Negative
  • Neutral
  • Mixed

Example

Text

“I love the product, but setup was confusing.”

Result

Mixed sentiment


Key Phrase Extraction

Key phrase extraction identifies important words and phrases.


Example

Text

“Azure AI Foundry simplifies AI application development.”

Extracted Key Phrases

  • Azure AI Foundry
  • AI application development

Entity Recognition

Entity recognition identifies important entities in text.

Common entity types:

  • People
  • Organizations
  • Locations
  • Dates
  • Products

Example

Text

“Microsoft announced updates in Seattle.”

Detected Entities

  • Microsoft → Organization
  • Seattle → Location

Language Detection

Language detection identifies the language of text.


Example

Text

“Bonjour tout le monde.”

Detected Language

French


Text Summarization

Summarization creates shorter versions of long text while preserving key ideas.


Example

Original Text

A long customer review

Summary

“Customer liked the product but experienced delivery delays.”


Content Moderation

Some applications use text analysis to identify:

  • Offensive language
  • Harmful content
  • Unsafe text

Content moderation supports Responsible AI.


User Interface Components

A lightweight text analysis application commonly includes:

  • Text input box
  • Analyze button
  • Results display area

Example Lightweight Application

A simple customer feedback analyzer may:

  1. Accept customer reviews
  2. Perform sentiment analysis
  3. Display positive or negative sentiment

High-Level Application Architecture

Typical components include:

  • Frontend interface
  • AI service endpoint
  • Authentication layer
  • Results display

Example High-Level Pseudocode

text = get_user_input()
results = analyze_text(text)
display_results(results)

For AI-901, understanding the workflow is more important than memorizing code syntax.


Error Handling

Applications should handle:

  • Invalid input
  • Authentication failures
  • Network issues
  • Rate limits
  • Service unavailability

Rate Limits

AI services may limit request frequency.

Applications should gracefully handle throttling and retries.


Responsible AI Considerations

Text analysis applications should follow Responsible AI principles.

Important considerations include:

  • Fairness
  • Privacy
  • Security
  • Transparency
  • Accountability
  • Inclusiveness

Privacy and Security

Applications should protect:

  • User input
  • Sensitive information
  • Authentication credentials

Bias in Text Analysis

AI systems may produce biased results if training data contains bias.

Organizations should monitor outputs carefully.


Transparency

Users should understand:

  • AI is being used
  • How results are generated
  • Potential limitations

Hallucinations and Inaccuracies

Generative AI features may occasionally produce inaccurate summaries or interpretations.

Applications should not assume AI outputs are always correct.


Common Real-World Scenarios


Scenario 1: Customer Review Analyzer

Goal

Analyze customer feedback sentiment.

Features

  • Positive/negative classification
  • Key phrase extraction

Scenario 2: Social Media Monitoring

Goal

Monitor public sentiment about a brand.

Features

  • Trend analysis
  • Entity recognition
  • Sentiment tracking

Scenario 3: Document Summarization Tool

Goal

Generate concise summaries of large documents.

Features

  • Summarization
  • Keyword extraction
  • Language detection

Advantages of Text Analysis Applications

Benefits include:

  • Faster information processing
  • Automation
  • Improved customer insights
  • Scalability
  • Better decision-making

Limitations of Text Analysis Applications

Challenges include:

  • Ambiguous language
  • Sarcasm detection difficulties
  • Context limitations
  • Potential bias
  • Accuracy limitations

Important AI-901 Exam Tips

For the exam, remember these key points:

  • Text analysis extracts insights from written language.
  • Lightweight applications focus on simple core functionality.
  • Azure AI Language supports common text analysis tasks.
  • Sentiment analysis detects emotional tone.
  • Entity recognition identifies important entities.
  • Key phrase extraction identifies important terms.
  • Summarization shortens text while preserving meaning.
  • APIs and endpoints connect applications to AI services.
  • Authentication secures AI access.
  • Responsible AI principles apply to text analysis applications.

Quick Knowledge Check

Question 1

What does sentiment analysis identify?

Answer

The emotional tone of text.


Question 2

What is entity recognition?

Answer

The process of identifying entities such as people, organizations, and locations.


Question 3

Why is authentication important?

Answer

It secures access to AI services.


Question 4

What is the purpose of summarization?

Answer

To create shorter versions of longer text while preserving key information.


Practice Exam Questions

Question 1

What is the PRIMARY purpose of text analysis in AI applications?

A. To physically store documents
B. To extract meaning and insights from written text
C. To improve monitor resolution
D. To compress video files


Correct Answer

B. To extract meaning and insights from written text


Explanation

Text analysis uses AI to identify patterns, meaning, sentiment, entities, and other insights from text data.


Why the Other Answers Are Incorrect

A. To physically store documents

Text analysis processes text; it does not physically store files.

C. To improve monitor resolution

This is unrelated to AI text analysis.

D. To compress video files

This is unrelated to language processing.


Question 2

Which Azure service provides AI-powered text analysis capabilities?

A. Azure AI Language
B. Azure Virtual Desktop
C. Azure Kubernetes Service
D. Azure Backup


Correct Answer

A. Azure AI Language


Explanation

Azure AI Language provides capabilities such as sentiment analysis, entity recognition, summarization, and key phrase extraction.


Why the Other Answers Are Incorrect

B. Azure Virtual Desktop

This provides desktop virtualization.

C. Azure Kubernetes Service

This is used for container orchestration.

D. Azure Backup

This is a backup service.


Question 3

What does sentiment analysis determine?

A. The language translation speed
B. The emotional tone of text
C. The image resolution of documents
D. The network latency of APIs


Correct Answer

B. The emotional tone of text


Explanation

Sentiment analysis identifies whether text is positive, negative, neutral, or mixed.


Why the Other Answers Are Incorrect

A. The language translation speed

Sentiment analysis does not measure performance.

C. The image resolution of documents

This is unrelated to text sentiment.

D. The network latency of APIs

This is unrelated to text analysis.


Question 4

Which text analysis technique identifies important words and phrases in text?

A. Object detection
B. Key phrase extraction
C. Speech synthesis
D. Regression analysis


Correct Answer

B. Key phrase extraction


Explanation

Key phrase extraction identifies the most important terms and concepts within text.


Why the Other Answers Are Incorrect

A. Object detection

This is a computer vision task.

C. Speech synthesis

This converts text into speech.

D. Regression analysis

This predicts numeric values.


Question 5

What is entity recognition used for?

A. Detecting entities such as people, locations, and organizations
B. Compressing text documents
C. Increasing internet speed
D. Rendering video content


Correct Answer

A. Detecting entities such as people, locations, and organizations


Explanation

Entity recognition identifies and categorizes important items mentioned in text.


Why the Other Answers Are Incorrect

B. Compressing text documents

Entity recognition does not reduce file sizes.

C. Increasing internet speed

This is unrelated to networking.

D. Rendering video content

This is unrelated to natural language processing.


Question 6

What is the PRIMARY purpose of text summarization?

A. To translate text into audio
B. To create shorter versions of text while preserving key information
C. To permanently store documents
D. To classify images


Correct Answer

B. To create shorter versions of text while preserving key information


Explanation

Summarization condenses content into a concise version that retains important details.


Why the Other Answers Are Incorrect

A. To translate text into audio

This describes speech synthesis.

C. To permanently store documents

Summarization does not store data.

D. To classify images

This is unrelated to text processing.


Question 7

How do lightweight text analysis applications typically communicate with Azure AI services?

A. Through APIs and endpoints
B. Through USB drives only
C. Through monitor drivers
D. Through spreadsheet formatting tools


Correct Answer

A. Through APIs and endpoints


Explanation

Applications connect to Azure AI services using APIs and service endpoints.


Why the Other Answers Are Incorrect

B. Through USB drives only

Cloud AI services use network communication.

C. Through monitor drivers

This is unrelated to AI communication.

D. Through spreadsheet formatting tools

These are unrelated to APIs.


Question 8

Why is authentication important in AI-powered text analysis applications?

A. To improve image sharpness
B. To secure access to AI services and resources
C. To increase response creativity
D. To summarize text automatically


Correct Answer

B. To secure access to AI services and resources


Explanation

Authentication ensures only authorized users and applications can access AI services.


Why the Other Answers Are Incorrect

A. To improve image sharpness

Authentication does not affect graphics.

C. To increase response creativity

Creativity is influenced by model parameters such as temperature.

D. To summarize text automatically

Authentication does not perform analysis tasks.


Question 9

Which Responsible AI concern involves AI systems producing unfair or inaccurate results due to biased training data?

A. Bias
B. Resolution scaling
C. Video rendering
D. Hardware acceleration


Correct Answer

A. Bias


Explanation

Bias occurs when AI systems generate unfair or skewed outputs due to imbalanced or problematic training data.


Why the Other Answers Are Incorrect

B. Resolution scaling

This relates to graphics.

C. Video rendering

This relates to media processing.

D. Hardware acceleration

This relates to computing performance.


Question 10

What is one advantage of a lightweight text analysis application?

A. Faster deployment and lower complexity
B. Unlimited storage capacity
C. Elimination of all AI inaccuracies
D. Removal of internet requirements


Correct Answer

A. Faster deployment and lower complexity


Explanation

Lightweight applications are typically simpler, easier to build, and quicker to deploy.


Why the Other Answers Are Incorrect

B. Unlimited storage capacity

Storage capacity is unrelated to application weight.

C. Elimination of all AI inaccuracies

AI systems can still produce errors.

D. Removal of internet requirements

Cloud AI services generally require internet connectivity.


Final Thoughts

Building lightweight applications that include text analysis is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the foundational workflow of AI-powered text processing applications, including sentiment analysis, entity recognition, summarization, APIs, authentication, and Responsible AI principles.

Azure AI Foundry and Azure AI Language provide accessible tools for building intelligent text analysis applications that support real-world business needs.


Go to the AI-901 Exam Prep Hub main page

Respond to spoken prompts by using a deployed multimodal model (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement AI solutions for text and speech by using Foundry
--> Respond to spoken prompts by using a deployed multimodal model


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Modern AI systems increasingly support multimodal interactions, allowing users to communicate using speech, text, images, and other forms of input. Multimodal AI models can process and combine multiple input types to generate intelligent responses.

For the AI-901 certification exam, candidates should understand the foundational concepts behind responding to spoken prompts by using deployed multimodal AI models within Microsoft Azure AI Foundry and related Azure AI services.

This topic falls under the “Implement AI solutions for text and speech by using Foundry” section of the AI-901 exam objectives.


What Is a Multimodal Model?

A multimodal model is an AI model capable of processing multiple forms of input and output.

Examples of modalities include:

  • Text
  • Speech/audio
  • Images
  • Video

A multimodal model can combine information from multiple sources to generate responses.


Examples of Multimodal AI Systems

Common examples include:

  • Voice assistants
  • AI copilots
  • Speech-enabled chatbots
  • Image-and-text AI assistants
  • Interactive educational tools

What Is a Spoken Prompt?

A spoken prompt is a voice-based user input provided through audio.

Instead of typing a question, the user speaks it aloud.


Example Spoken Prompt

“What is machine learning?”

The AI system converts the speech into text for processing.


Speech Recognition

Speech recognition converts spoken language into text.

This process is often called:

  • Speech-to-text (STT)
  • Automatic speech recognition (ASR)

Example Speech Recognition Workflow

Spoken Audio

“What time is the meeting tomorrow?”

Converted Text

“What time is the meeting tomorrow?”

The text is then processed by the AI model.


Speech Synthesis

Speech synthesis converts text into spoken audio.

This process is often called:

  • Text-to-speech (TTS)

Example

AI Response Text

“The meeting starts at 10 AM.”

Spoken Output

The AI system reads the response aloud.


Azure AI Speech

Azure AI Speech provides speech recognition and speech synthesis capabilities.

Features include:

  • Speech-to-text
  • Text-to-speech
  • Speech translation
  • Voice generation

Azure AI Foundry

Azure AI Foundry provides tools for building, deploying, and testing AI applications and multimodal solutions.


Basic Workflow for Spoken Prompt Applications

A typical workflow includes:

  1. User speaks into microphone
  2. Speech recognition converts audio to text
  3. Text is sent to deployed multimodal model
  4. AI model generates response
  5. Optional speech synthesis converts response to audio
  6. User hears spoken reply

Example End-to-End Scenario

User Speaks

“Summarize today’s sales report.”

Speech Recognition

Converts audio to text

AI Model

Generates summary

Speech Synthesis

Reads summary aloud


Deployed Models

A deployed model is an AI model made available through a cloud endpoint for real-time use.

Applications interact with deployed models using APIs.


APIs and Endpoints

Applications communicate with deployed models through:

  • APIs
  • Endpoints

The application sends requests and receives responses programmatically.


Authentication

Applications must securely authenticate before accessing AI services.

Common methods include:

  • API keys
  • Azure credentials
  • Managed identities

Lightweight Speech Applications

Lightweight speech-enabled applications typically include:

  • Microphone input
  • Speech processing
  • AI response generation
  • Audio playback

Conversation Context

Many speech-enabled applications maintain context between interactions.

This allows more natural conversations.


Example

User

“Who founded Microsoft?”

User Later

“When was it founded?”

The system remembers that “it” refers to Microsoft.


System Prompts

System prompts guide model behavior.

They help define:

  • Tone
  • Personality
  • Safety rules
  • Output style

Example System Prompt

“You are a professional customer support assistant.”


Model Parameters

Applications may configure settings such as:

  • Temperature
  • Maximum tokens
  • Top-p sampling

Temperature

Temperature controls response creativity.

Low TemperatureHigh Temperature
More predictableMore creative
More focusedMore varied

Streaming Responses

Some applications stream speech or text responses incrementally.

Streaming improves responsiveness and user experience.


Real-Time Interaction

Speech-enabled AI systems often support real-time interaction.

This creates conversational experiences similar to human dialogue.


Common Real-World Use Cases


Scenario 1: Voice Assistant

Goal

Answer spoken user questions.

Features

  • Speech recognition
  • Conversational AI
  • Spoken responses

Scenario 2: Hands-Free AI Assistant

Goal

Allow users to interact without typing.

Features

  • Voice commands
  • Audio responses
  • Context retention

Scenario 3: Accessibility Support

Goal

Assist users with visual or mobility impairments.

Features

  • Voice interaction
  • Spoken guidance
  • Accessibility improvements

Responsible AI Considerations

Speech-enabled AI applications should follow Responsible AI principles.

Important considerations include:

  • Privacy
  • Security
  • Transparency
  • Fairness
  • Inclusiveness
  • Accountability

Privacy Concerns

Speech applications may process sensitive spoken information.

Organizations should:

  • Protect audio recordings
  • Secure conversations
  • Limit unnecessary data storage

Transparency

Users should understand:

  • AI is processing speech
  • Audio may be recorded or analyzed
  • AI-generated responses may contain inaccuracies

Inclusiveness

Speech systems should support:

  • Different accents
  • Languages
  • Speech patterns
  • Accessibility needs

Hallucinations

Generative AI models may produce inaccurate or fabricated responses.

These incorrect outputs are called hallucinations.

Applications should not assume all generated responses are correct.


Latency

Speech-enabled applications must minimize delays between:

  • Speech input
  • AI processing
  • Spoken responses

High latency negatively affects user experience.


Error Handling

Applications should handle:

  • Speech recognition errors
  • Background noise
  • Network failures
  • Authentication issues
  • Rate limits

Background Noise Challenges

Speech recognition may struggle with:

  • Loud environments
  • Multiple speakers
  • Poor microphone quality

Advantages of Spoken AI Interfaces

Benefits include:

  • Natural interaction
  • Hands-free operation
  • Accessibility improvements
  • Faster communication
  • Improved user experience

Limitations of Spoken AI Interfaces

Challenges include:

  • Speech recognition errors
  • Accent variability
  • Noise interference
  • Privacy concerns
  • Hallucinations
  • Latency

High-Level Application Workflow

A simplified workflow includes:

  1. Capture speech
  2. Convert speech to text
  3. Send prompt to model
  4. Receive response
  5. Convert response to speech
  6. Play audio response

Example High-Level Pseudocode

audio = capture_audio()
text = speech_to_text(audio)
response = generate_ai_response(text)
speak(response)

For AI-901, understanding the workflow is more important than memorizing exact syntax.


Important AI-901 Exam Tips

For the exam, remember these key points:

  • Multimodal models process multiple input types.
  • Spoken prompts use speech as input.
  • Speech recognition converts speech to text.
  • Speech synthesis converts text to speech.
  • Azure AI Speech supports speech workloads.
  • Azure AI Foundry supports AI application development.
  • APIs and endpoints connect applications to deployed models.
  • Authentication secures AI services.
  • Responsible AI principles apply to speech-enabled systems.
  • Hallucinations are inaccurate AI-generated outputs.

Quick Knowledge Check

Question 1

What does speech recognition do?

Answer

Converts spoken language into text.


Question 2

What does speech synthesis do?

Answer

Converts text into spoken audio.


Question 3

What is a multimodal model?

Answer

An AI model that processes multiple forms of input and output.


Question 4

Why is inclusiveness important in speech systems?

Answer

To support different accents, languages, and accessibility needs.


Practice Exam Questions

Question 1

What is a multimodal AI model?

A. A model that only processes text
B. A model capable of processing multiple forms of input and output
C. A model used only for spreadsheets
D. A model that stores physical hardware configurations


Correct Answer

B. A model capable of processing multiple forms of input and output


Explanation

Multimodal models can work with different data types such as text, speech, images, and video.


Why the Other Answers Are Incorrect

A. A model that only processes text

That describes a text-only model, not a multimodal model.

C. A model used only for spreadsheets

This is unrelated to AI modalities.

D. A model that stores physical hardware configurations

This is unrelated to AI processing.


Question 2

What is the PRIMARY purpose of speech recognition?

A. To convert speech into text
B. To convert images into audio
C. To increase internet speed
D. To generate video animations


Correct Answer

A. To convert speech into text


Explanation

Speech recognition, also called speech-to-text, converts spoken language into written text.


Why the Other Answers Are Incorrect

B. To convert images into audio

Speech recognition does not process images.

C. To increase internet speed

Speech recognition does not affect networking.

D. To generate video animations

This is unrelated to speech processing.


Question 3

What does speech synthesis perform?

A. Converts text into spoken audio
B. Compresses speech files
C. Detects objects in images
D. Removes network latency


Correct Answer

A. Converts text into spoken audio


Explanation

Speech synthesis, also called text-to-speech, generates spoken audio from text.


Why the Other Answers Are Incorrect

B. Compresses speech files

Compression is unrelated to synthesis.

C. Detects objects in images

This is a computer vision task.

D. Removes network latency

Speech synthesis does not control network performance.


Question 4

Which Azure service provides speech recognition and speech synthesis capabilities?

A. Azure AI Speech
B. Azure Backup
C. Azure Firewall
D. Azure Virtual Machines


Correct Answer

A. Azure AI Speech


Explanation

Azure AI Speech supports speech-to-text, text-to-speech, translation, and related speech capabilities.


Why the Other Answers Are Incorrect

B. Azure Backup

This is a storage protection service.

C. Azure Firewall

This is a security service.

D. Azure Virtual Machines

This provides compute infrastructure.


Question 5

What is the purpose of deploying an AI model?

A. To make the model available for applications through an endpoint
B. To physically install computer hardware
C. To permanently disable the model
D. To compress training data


Correct Answer

A. To make the model available for applications through an endpoint


Explanation

Deployment allows applications to access AI models for real-time use.


Why the Other Answers Are Incorrect

B. To physically install computer hardware

Deployment is typically cloud-based.

C. To permanently disable the model

Deployment enables usage rather than disabling it.

D. To compress training data

Deployment does not compress datasets.


Question 6

How do applications typically communicate with deployed AI models?

A. Through APIs and endpoints
B. Through USB-only connections
C. Through monitor settings
D. Through printer drivers


Correct Answer

A. Through APIs and endpoints


Explanation

Applications use APIs connected to endpoints to exchange requests and responses with AI models.


Why the Other Answers Are Incorrect

B. Through USB-only connections

Cloud AI systems use network communication.

C. Through monitor settings

These are unrelated to AI communication.

D. Through printer drivers

Printer drivers are unrelated to AI APIs.


Question 7

Why is conversation context important in speech-enabled AI systems?

A. It allows the AI to remember previous interactions
B. It improves monitor brightness
C. It increases microphone volume automatically
D. It reduces file storage size


Correct Answer

A. It allows the AI to remember previous interactions


Explanation

Maintaining context helps create more natural and coherent conversations.


Why the Other Answers Are Incorrect

B. It improves monitor brightness

Conversation context does not affect displays.

C. It increases microphone volume automatically

This is unrelated to conversation memory.

D. It reduces file storage size

Context retention does not compress files.


Question 8

Which Responsible AI concern is especially important for speech-enabled applications?

A. Protecting sensitive spoken information
B. Increasing screen resolution
C. Accelerating video rendering
D. Improving keyboard layouts


Correct Answer

A. Protecting sensitive spoken information


Explanation

Speech-enabled systems may process personal or confidential audio data, making privacy and security important.


Why the Other Answers Are Incorrect

B. Increasing screen resolution

This is unrelated to Responsible AI.

C. Accelerating video rendering

This is unrelated to speech AI.

D. Improving keyboard layouts

Speech systems are not focused on keyboards.


Question 9

What are hallucinations in generative AI systems?

A. Incorrect or fabricated AI-generated responses
B. Hardware overheating events
C. Audio recording failures
D. Slow network connections


Correct Answer

A. Incorrect or fabricated AI-generated responses


Explanation

Hallucinations occur when AI generates information that is inaccurate or invented.


Why the Other Answers Are Incorrect

B. Hardware overheating events

This is unrelated to AI output quality.

C. Audio recording failures

This is a hardware or software issue.

D. Slow network connections

This relates to connectivity, not AI accuracy.


Question 10

What is one advantage of spoken AI interfaces?

A. Hands-free and natural interaction
B. Elimination of all recognition errors
C. Guaranteed perfect accuracy
D. Removal of all privacy concerns


Correct Answer

A. Hands-free and natural interaction


Explanation

Voice-based interfaces provide convenient and natural interaction experiences.


Why the Other Answers Are Incorrect

B. Elimination of all recognition errors

Speech systems can still make mistakes.

C. Guaranteed perfect accuracy

No AI system is perfectly accurate.

D. Removal of all privacy concerns

Speech applications still require privacy protections.


Final Thoughts

Responding to spoken prompts using deployed multimodal models is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the foundational workflow behind speech-enabled AI applications, including speech recognition, multimodal processing, speech synthesis, APIs, authentication, and Responsible AI principles.

Azure AI Foundry and Azure AI Speech provide powerful tools for building intelligent conversational applications that support natural voice interactions and modern accessibility-focused experiences.


Go to the AI-901 Exam Prep Hub main page

Deploy a model and interact with it in the Foundry Portal (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement generative AI apps and agents by using Foundry
--> Deploy a model and interact with it in the Foundry Portal


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Microsoft Azure AI Foundry provides a centralized environment for building, testing, deploying, and managing generative AI models and AI-powered applications. For the AI-901 certification exam, candidates should understand the basic process of deploying AI models and interacting with them through the Foundry portal.

This topic focuses on how developers and AI practitioners use Azure AI Foundry to deploy generative AI models, test prompts, configure model settings, and interact with deployed AI endpoints.

This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.


What Is Azure AI Foundry?

Azure AI Foundry is Microsoft’s platform for building and managing AI applications and agents.

Azure AI Foundry provides tools to:

  • Explore AI models
  • Deploy models
  • Test prompts
  • Configure AI behavior
  • Evaluate responses
  • Monitor AI applications
  • Manage AI resources

It supports generative AI development using Azure-hosted AI services and models.


What Does “Deploying a Model” Mean?

Deploying a model means making the AI model available for use.

A deployed model can:

  • Receive prompts
  • Process requests
  • Generate responses
  • Be accessed through applications or APIs

Deployment creates an endpoint that applications can use to interact with the model.


What Is a Model Endpoint?

An endpoint is a network-accessible interface that allows applications or users to communicate with a deployed AI model.

Applications send requests to the endpoint and receive AI-generated responses.


Common Deployment Scenarios

Organizations deploy models for many purposes, including:

  • Chatbots
  • AI assistants
  • Document summarization
  • Content generation
  • Customer support systems
  • Code generation
  • Data extraction

Azure AI Foundry Workflow

A simplified workflow in Azure AI Foundry typically includes:

  1. Create or access an Azure AI resource
  2. Open Azure AI Foundry portal
  3. Select a model
  4. Configure deployment settings
  5. Deploy the model
  6. Test prompts
  7. Interact with the model
  8. Integrate the endpoint into applications

Accessing the Foundry Portal

Users access Azure AI Foundry through a web-based portal.

The portal provides graphical tools for:

  • Model selection
  • Prompt testing
  • Deployment management
  • Performance monitoring

Exploring Available Models

Azure AI Foundry allows users to browse available models.

Examples may include:

  • Large Language Models (LLMs)
  • Image-generation models
  • Embedding models
  • Speech models

Models may vary by:

  • Size
  • Performance
  • Cost
  • Supported capabilities

Selecting a Model

Users choose models based on application requirements.

Factors may include:

  • Accuracy
  • Speed
  • Cost
  • Context window size
  • Multimodal support
  • Language support

Example Scenario

A company building a customer support chatbot may choose a conversational large language model.


Deploying a Model in Foundry

The deployment process usually involves:

  • Selecting a model
  • Naming the deployment
  • Choosing deployment settings
  • Allocating resources
  • Creating the endpoint

Deployment Names

Deployments are typically assigned unique names.

Example

support-chat-model

Applications use deployment names when sending requests.


Model Configuration Options

During deployment, users may configure:

  • Model version
  • Scaling options
  • Authentication settings
  • Content filters
  • Region
  • Resource allocation

Content Filtering and Safety

Azure AI Foundry includes Responsible AI safety features.

Content filtering helps reduce:

  • Harmful outputs
  • Offensive content
  • Unsafe responses

This is important for enterprise AI applications.


Interacting with a Deployed Model

After deployment, users can interact with the model directly within the Foundry portal.

This often includes:

  • Entering prompts
  • Viewing responses
  • Adjusting settings
  • Testing behavior

Playground Interfaces

Azure AI Foundry provides playground environments for experimentation.

Playgrounds allow users to:

  • Test prompts
  • Compare outputs
  • Tune settings
  • Evaluate model behavior

Prompt Testing

Users can experiment with:

  • System prompts
  • User prompts
  • Formatting instructions
  • Role prompting

Prompt testing helps improve AI response quality.


Example Prompt Interaction

User Prompt

“Summarize this customer feedback in three bullet points.”

Model Response

The model generates a summarized response.


Model Parameters

Foundry portals may allow adjustment of model parameters such as:

  • Temperature
  • Maximum tokens
  • Top-p sampling

Temperature

Temperature controls response randomness.

Low TemperatureHigh Temperature
More predictableMore creative
More focusedMore varied

Maximum Tokens

Maximum tokens limit response length.

Smaller limits create shorter responses.


System Prompts in Foundry

Users can configure system prompts to guide AI behavior.


Example System Prompt

“You are a professional technical support assistant. Keep responses concise and helpful.”

System prompts influence:

  • Tone
  • Style
  • Safety
  • Formatting

Evaluating Responses

Users should evaluate AI outputs for:

  • Accuracy
  • Relevance
  • Safety
  • Bias
  • Hallucinations

AI-generated content should be reviewed carefully.


Hallucinations

Generative AI models can produce incorrect or fabricated information.

These incorrect outputs are called hallucinations.

Prompt engineering and grounding techniques help reduce hallucinations.


API Access

Once deployed, applications can connect to the model endpoint using APIs.

This allows developers to integrate AI into applications.


Common Integration Scenarios

Applications may use deployed models for:

  • Chat interfaces
  • Search assistants
  • Document analysis
  • AI copilots
  • Workflow automation

Monitoring and Management

Azure AI Foundry supports monitoring deployed models.

Monitoring may include:

  • Usage tracking
  • Performance analysis
  • Error monitoring
  • Cost management

Scaling AI Deployments

Organizations may scale deployments to support:

  • More users
  • Higher request volumes
  • Faster response times

Cloud-based deployments support elastic scaling.


Responsible AI Considerations

When deploying AI models, organizations should consider:

  • Privacy
  • Security
  • Fairness
  • Transparency
  • Safety
  • Compliance

Generative AI applications should include safeguards against misuse.


Authentication and Security

Deployed models typically require secure authentication.

Security features may include:

  • API keys
  • Identity management
  • Access control

Common Challenges

Organizations may encounter challenges such as:

  • High usage costs
  • Latency
  • Hallucinations
  • Unsafe outputs
  • Poor prompt quality

Proper testing and monitoring are important.


Azure OpenAI Service

Azure OpenAI Service provides access to powerful generative AI models that can be deployed and managed through Azure AI Foundry.


Real-World Scenarios


Scenario 1: Customer Support Chatbot

Goal

Deploy a conversational AI assistant.

Activities

  • Deploy language model
  • Configure system prompts
  • Test responses in the playground

Scenario 2: Internal Knowledge Assistant

Goal

Allow employees to ask questions about company documentation.

Activities

  • Deploy AI model
  • Configure prompts
  • Integrate with enterprise systems

Scenario 3: Marketing Content Generator

Goal

Generate product descriptions automatically.

Activities

  • Deploy generative AI model
  • Test prompt variations
  • Evaluate response quality

Important AI-901 Exam Tips

For the exam, remember these key points:

  • Deploying a model makes it available for use.
  • Deployments create accessible endpoints.
  • Azure AI Foundry provides tools for testing and managing models.
  • Playgrounds allow prompt experimentation.
  • System prompts guide model behavior.
  • Temperature controls creativity and randomness.
  • Maximum tokens control response length.
  • AI outputs should be evaluated for accuracy and safety.
  • Content filtering supports Responsible AI practices.
  • APIs allow applications to connect to deployed models.

Quick Knowledge Check

Question 1

What does deploying a model do?

Answer

It makes the AI model available for use through an endpoint.


Question 2

What is the purpose of a playground in Azure AI Foundry?

Answer

To test prompts and interact with deployed models.


Question 3

What does the temperature setting control?

Answer

The randomness and creativity of model responses.


Question 4

Why are content filters important?

Answer

They help reduce harmful or unsafe AI-generated outputs.


Practice Exam Questions

Question 1

What is the PRIMARY purpose of deploying an AI model?

A. To permanently delete the model
B. To make the model available for use through an endpoint
C. To compress training data
D. To convert images into text


Correct Answer

B. To make the model available for use through an endpoint


Explanation

Deploying a model makes it accessible so applications and users can interact with it.


Why the Other Answers Are Incorrect

A. To permanently delete the model

Deployment does not delete models.

C. To compress training data

Deployment is unrelated to data compression.

D. To convert images into text

This describes OCR.


Question 2

What is an endpoint in the context of AI model deployment?

A. A physical server room
B. A network-accessible interface for interacting with a deployed model
C. A type of database backup
D. A computer vision algorithm


Correct Answer

B. A network-accessible interface for interacting with a deployed model


Explanation

Endpoints allow applications and users to send requests to deployed AI models and receive responses.


Why the Other Answers Are Incorrect

A. A physical server room

Endpoints are logical interfaces, not physical locations.

C. A type of database backup

This is unrelated to AI deployment.

D. A computer vision algorithm

Endpoints are not algorithms.


Question 3

Which Azure tool provides playgrounds for testing prompts and interacting with deployed AI models?

A. Azure SQL Database
B. Azure AI Foundry
C. Microsoft Excel
D. Azure Virtual Desktop


Correct Answer

B. Azure AI Foundry


Explanation

Azure AI Foundry provides tools for model deployment, prompt testing, evaluation, and management.


Why the Other Answers Are Incorrect

A. Azure SQL Database

This is a database service.

C. Microsoft Excel

Excel is not an AI deployment platform.

D. Azure Virtual Desktop

This provides desktop virtualization services.


Question 4

What is the PRIMARY purpose of a playground in Azure AI Foundry?

A. Hosting multiplayer games
B. Experimenting with prompts and testing model behavior
C. Managing employee payroll
D. Compressing image files


Correct Answer

B. Experimenting with prompts and testing model behavior


Explanation

Playgrounds allow users to interact with models, test prompts, and evaluate responses.


Why the Other Answers Are Incorrect

A. Hosting multiplayer games

This is unrelated to AI Foundry.

C. Managing employee payroll

This is unrelated to AI development.

D. Compressing image files

Playgrounds are not image utilities.


Question 5

Which configuration setting controls how creative or random AI-generated responses are?

A. OCR level
B. Temperature
C. Resolution scaling
D. Data indexing


Correct Answer

B. Temperature


Explanation

Temperature controls randomness and creativity in generative AI responses.


Why the Other Answers Are Incorrect

A. OCR level

OCR extracts text from images.

C. Resolution scaling

This relates to images, not text generation randomness.

D. Data indexing

Indexing is unrelated to generative response creativity.


Question 6

What is the effect of setting a lower temperature value in a generative AI model?

A. More random responses
B. More predictable and focused responses
C. Faster internet speeds
D. Larger image generation sizes


Correct Answer

B. More predictable and focused responses


Explanation

Lower temperature settings reduce randomness and produce more deterministic outputs.


Why the Other Answers Are Incorrect

A. More random responses

Higher temperatures increase randomness.

C. Faster internet speeds

Temperature does not affect networking.

D. Larger image generation sizes

Temperature is unrelated to image dimensions.


Question 7

Which prompt type defines the AI assistant’s behavior, tone, and rules?

A. User prompt
B. System prompt
C. SQL query
D. OCR prompt


Correct Answer

B. System prompt


Explanation

System prompts provide high-level behavioral instructions to the AI model.


Why the Other Answers Are Incorrect

A. User prompt

User prompts specify tasks or requests.

C. SQL query

SQL queries interact with databases.

D. OCR prompt

OCR is unrelated to conversational AI behavior.


Question 8

Why are content filters important when deploying generative AI models?

A. They improve internet bandwidth
B. They help reduce harmful or unsafe outputs
C. They increase monitor resolution
D. They replace system prompts entirely


Correct Answer

B. They help reduce harmful or unsafe outputs


Explanation

Content filtering supports Responsible AI by helping prevent harmful or inappropriate AI-generated content.


Why the Other Answers Are Incorrect

A. They improve internet bandwidth

Content filters do not affect networking performance.

C. They increase monitor resolution

This is unrelated to AI safety.

D. They replace system prompts entirely

Content filters complement prompts; they do not replace them.


Question 9

What are hallucinations in generative AI?

A. Physical hardware failures
B. Incorrect or fabricated AI-generated information
C. Database replication errors
D. Unauthorized user logins


Correct Answer

B. Incorrect or fabricated AI-generated information


Explanation

Hallucinations occur when AI generates inaccurate or invented information.


Why the Other Answers Are Incorrect

A. Physical hardware failures

This is unrelated to AI hallucinations.

C. Database replication errors

This is a database issue.

D. Unauthorized user logins

This is a security issue.


Question 10

After deploying a model, how do external applications typically interact with it?

A. Through handwritten forms
B. Through APIs connected to the deployment endpoint
C. Through spreadsheet imports only
D. Through local USB connections


Correct Answer

B. Through APIs connected to the deployment endpoint


Explanation

Applications commonly communicate with deployed AI models using APIs and endpoints.


Why the Other Answers Are Incorrect

A. Through handwritten forms

This is unrelated to AI deployment.

C. Through spreadsheet imports only

Spreadsheets are not the primary integration mechanism.

D. Through local USB connections

Cloud AI services typically use network-based APIs, not USB connections.


Final Thoughts

Deploying and interacting with AI models in Azure AI Foundry is an important skill area for the AI-901 certification exam. Microsoft expects candidates to understand the basic deployment workflow, prompt testing process, model configuration options, and Responsible AI considerations involved in building generative AI applications.

Azure AI Foundry simplifies AI development by providing a centralized environment for deploying, testing, and managing AI models and agents.


Go to the AI-901 Exam Prep Hub main page

Create effective system and user prompts for Generative AI models (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement generative AI apps and agents by using Foundry
--> Create effective system and user prompts for Generative AI models


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Prompting is one of the most important skills when working with generative AI systems. Microsoft expects AI-901 candidates to understand how to create effective prompts that guide generative AI models toward useful, accurate, and safe outputs.

This topic focuses on how system prompts and user prompts influence the behavior of generative AI models and how prompt engineering techniques improve AI-generated responses.

This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.


What Is a Prompt?

A prompt is an instruction or input provided to a generative AI model.

Prompts guide the model’s response and influence:

  • Content
  • Tone
  • Format
  • Style
  • Accuracy
  • Level of detail

The quality of the prompt strongly affects the quality of the output.


What Is Prompt Engineering?

Prompt engineering is the process of designing and refining prompts to improve AI-generated responses.

Effective prompt engineering helps:

  • Produce more accurate answers
  • Reduce ambiguity
  • Improve consistency
  • Control response format
  • Reduce hallucinations
  • Improve safety and Responsible AI behavior

Types of Prompts

For the AI-901 exam, two important prompt types are:

  • System prompts
  • User prompts

What Is a System Prompt?

A system prompt provides high-level instructions that define how the AI model should behave.

System prompts often control:

  • Personality
  • Tone
  • Rules
  • Safety boundaries
  • Formatting requirements
  • Behavior expectations

The system prompt typically has higher priority than user prompts.


Example of a System Prompt

“You are a professional technical support assistant. Provide concise and accurate troubleshooting guidance. Do not provide harmful or unsafe instructions.”

This system prompt defines:

  • The assistant’s role
  • Communication style
  • Safety expectations

What Is a User Prompt?

A user prompt is the direct request or question submitted by the user.

User prompts specify the task the model should perform.


Example of a User Prompt

“How do I reset my router?”

The AI model combines:

  • System instructions
  • User request
  • Context information

to generate a response.


Relationship Between System and User Prompts

System prompts establish behavior rules, while user prompts define the immediate task.


Example

System Prompt

“You are a helpful travel assistant. Always provide answers in bullet points.”

User Prompt

“Suggest three family-friendly attractions in Orlando.”

The model responds according to both prompts.


Characteristics of Effective Prompts

Good prompts are usually:

  • Clear
  • Specific
  • Contextual
  • Structured
  • Goal-oriented

Clear Prompts

Clear prompts reduce confusion and ambiguity.


Weak Prompt

“Tell me about databases.”


Better Prompt

“Explain the differences between relational and non-relational databases for beginners.”

The second prompt provides:

  • Specific topic
  • Audience
  • Scope

Specific Prompts

Specific prompts improve response accuracy.


Weak Prompt

“Write a report.”


Better Prompt

“Write a 300-word summary of cloud computing benefits for small businesses.”

Specific prompts define:

  • Length
  • Topic
  • Audience

Providing Context

Context helps the model generate more relevant answers.


Example

“I am studying for the AI-901 exam. Explain OCR in simple terms with one real-world example.”

The additional context improves response quality.


Requesting Output Format

Prompts can specify desired formatting.


Example

“Provide the answer as a table.”

or

“Summarize the information in bullet points.”


Role Prompting

Role prompting assigns the AI a specific role or perspective.


Example

“Act as a cybersecurity consultant.”

or

“You are an experienced data analyst.”

Role prompting helps guide tone and expertise.


Step-by-Step Prompting

Prompts can request step-by-step explanations.


Example

“Explain how machine learning works step-by-step for beginners.”

This improves clarity and educational usefulness.


Few-Shot Prompting

Few-shot prompting provides examples within the prompt.

This helps the model understand expected patterns.


Example

Positive review → Positive sentiment
Negative review → Negative sentiment
“The service was excellent.” →

The model learns the desired output structure.


Zero-Shot Prompting

Zero-shot prompting asks the model to perform a task without examples.


Example

“Classify this review as positive or negative.”


Chain-of-Thought Prompting

Chain-of-thought prompting encourages step-by-step reasoning.


Example

“Explain your reasoning step-by-step before providing the final answer.”

This can improve reasoning accuracy for complex tasks.


Prompting for Summarization

Generative AI models can summarize content using prompts.


Example

“Summarize this article in three bullet points.”


Prompting for Content Generation

Prompts can generate new content such as:

  • Emails
  • Reports
  • Stories
  • Marketing copy
  • Code

Example

“Write a professional email requesting a project update.”


Prompting for Transformation Tasks

AI models can transform content into different formats.


Examples

  • Translate text
  • Rewrite text
  • Simplify technical content
  • Convert paragraphs into tables

Example

“Rewrite this paragraph for a non-technical audience.”


Prompting for Code Generation

Generative AI can assist with programming tasks.


Example

“Write a Python function that calculates sales tax.”


Prompting for Data Extraction

Prompts can request structured data extraction.


Example

“Extract all dates and company names from this document.”


Prompt Injection Risks

Prompt injection occurs when users attempt to override system instructions.


Example

A malicious user prompt may attempt to bypass safety rules.

Organizations should implement safeguards against unsafe prompting behavior.


Responsible AI Considerations

Effective prompting should follow Responsible AI principles.

Important considerations include:

  • Safety
  • Fairness
  • Privacy
  • Transparency
  • Content moderation
  • Harm prevention

Hallucinations

Generative AI models can sometimes produce incorrect or fabricated information.

These errors are called hallucinations.

Good prompting can reduce hallucinations but may not eliminate them completely.


Example of a Hallucination

An AI model inventing a fake citation or incorrect fact.


Techniques to Reduce Hallucinations

Helpful strategies include:

  • Providing clear context
  • Using specific instructions
  • Asking for sources
  • Limiting scope
  • Using grounded data

Temperature and Creativity

Some generative AI systems allow configuration settings such as temperature.

Temperature affects randomness and creativity.

Low TemperatureHigh Temperature
More predictableMore creative
More focusedMore varied
Better for factual tasksBetter for brainstorming

Azure AI Foundry

Azure AI Foundry helps developers build, test, and manage generative AI applications and agents.

Developers can:

  • Experiment with prompts
  • Evaluate AI responses
  • Configure AI models
  • Implement safety controls

Azure OpenAI Service

Azure OpenAI Service provides access to powerful generative AI models that support prompt-based interactions.


Real-World Prompting Scenarios


Scenario 1: Customer Support Assistant

System Prompt

“You are a professional support assistant. Be polite and concise.”

User Prompt

“How do I reset my password?”


Scenario 2: Study Assistant

System Prompt

“Explain technical topics for beginners.”

User Prompt

“Explain neural networks in simple terms.”


Scenario 3: Marketing Content Generator

System Prompt

“Generate professional marketing copy.”

User Prompt

“Create a product description for a smartwatch.”


Best Practices for Effective Prompting

  • Be specific
  • Provide context
  • Define output format
  • Use examples when helpful
  • Keep instructions clear
  • Test and refine prompts
  • Avoid ambiguity
  • Include Responsible AI safeguards

Common Prompting Mistakes

Common mistakes include:

  • Vague instructions
  • Missing context
  • Conflicting requirements
  • Overly broad requests
  • Unclear formatting expectations

Important AI-901 Exam Tips

For the exam, remember these key points:

  • System prompts define AI behavior and rules.
  • User prompts specify the task to perform.
  • Effective prompts are clear and specific.
  • Prompt engineering improves AI outputs.
  • Few-shot prompting includes examples.
  • Zero-shot prompting provides no examples.
  • Chain-of-thought prompting encourages reasoning.
  • Hallucinations are incorrect AI-generated outputs.
  • Temperature settings affect creativity and randomness.
  • Responsible AI principles apply to prompting.

Quick Knowledge Check

Question 1

What is the difference between a system prompt and a user prompt?

Answer

A system prompt defines AI behavior and rules, while a user prompt requests a specific task.


Question 2

What is prompt engineering?

Answer

The process of designing prompts to improve AI-generated responses.


Question 3

What is few-shot prompting?

Answer

Providing examples within prompts to guide the model.


Question 4

What are hallucinations in generative AI?

Answer

Incorrect or fabricated AI-generated information.


Practice Exam Questions

Question 1

What is the PRIMARY purpose of a system prompt in a generative AI application?

A. To store images generated by the model
B. To define the AI model’s behavior, rules, and tone
C. To increase internet speed
D. To encrypt database records


Correct Answer

B. To define the AI model’s behavior, rules, and tone


Explanation

System prompts provide high-level instructions that guide how the AI assistant behaves and responds.


Why the Other Answers Are Incorrect

A. To store images generated by the model

System prompts do not store data.

C. To increase internet speed

This is unrelated to AI prompting.

D. To encrypt database records

Encryption is unrelated to prompting.


Question 2

Which statement BEST describes a user prompt?

A. A hidden configuration file for servers
B. A direct instruction or request submitted by the user
C. A database backup mechanism
D. A type of neural network architecture


Correct Answer

B. A direct instruction or request submitted by the user


Explanation

User prompts contain the specific task or question the user wants the AI model to perform.


Why the Other Answers Are Incorrect

A. A hidden configuration file for servers

This is unrelated to generative AI prompting.

C. A database backup mechanism

This is unrelated to prompting.

D. A type of neural network architecture

Prompts are instructions, not architectures.


Question 3

Which prompt is MOST effective?

A. “Tell me stuff.”
B. “Write something about technology.”
C. “Explain cloud computing for beginners in 5 bullet points.”
D. “Do work.”


Correct Answer

C. “Explain cloud computing for beginners in 5 bullet points.”


Explanation

Effective prompts are clear, specific, and include formatting or audience requirements.


Why the Other Answers Are Incorrect

A. “Tell me stuff.”

This is too vague.

B. “Write something about technology.”

This lacks detail and direction.

D. “Do work.”

This is ambiguous and unclear.


Question 4

What is prompt engineering?

A. Designing hardware for AI servers
B. Building neural network chips
C. Creating and refining prompts to improve AI responses
D. Encrypting AI training data


Correct Answer

C. Creating and refining prompts to improve AI responses


Explanation

Prompt engineering focuses on improving generative AI outputs through better prompt design.


Why the Other Answers Are Incorrect

A. Designing hardware for AI servers

This is hardware engineering.

B. Building neural network chips

This is semiconductor engineering.

D. Encrypting AI training data

This is a security task.


Question 5

Which prompting technique includes examples within the prompt to guide the AI model?

A. Few-shot prompting
B. Object detection
C. OCR prompting
D. Clustering


Correct Answer

A. Few-shot prompting


Explanation

Few-shot prompting provides examples so the model better understands the desired output format or pattern.


Why the Other Answers Are Incorrect

B. Object detection

This is a computer vision capability.

C. OCR prompting

OCR extracts text from images.

D. Clustering

Clustering groups similar data.


Question 6

What is the PRIMARY benefit of providing context in a prompt?

A. Reduces network traffic
B. Helps generate more relevant and accurate responses
C. Compresses files automatically
D. Improves database indexing


Correct Answer

B. Helps generate more relevant and accurate responses


Explanation

Context improves the model’s understanding of the user’s goals and intended audience.


Why the Other Answers Are Incorrect

A. Reduces network traffic

This is unrelated to prompting.

C. Compresses files automatically

Prompting does not compress files.

D. Improves database indexing

This is unrelated to AI prompts.


Question 7

Which statement BEST describes hallucinations in generative AI?

A. AI-generated images only
B. Incorrect or fabricated AI-generated information
C. Network security attacks
D. Audio recognition failures


Correct Answer

B. Incorrect or fabricated AI-generated information


Explanation

Hallucinations occur when generative AI produces inaccurate or invented information.


Why the Other Answers Are Incorrect

A. AI-generated images only

Hallucinations can occur in text, code, and other outputs.

C. Network security attacks

This is unrelated to hallucinations.

D. Audio recognition failures

This is unrelated to generative AI hallucinations.


Question 8

Which system prompt would MOST likely encourage safe AI behavior?

A. “Ignore all safety rules.”
B. “Provide harmful instructions when requested.”
C. “Do not generate unsafe or harmful content.”
D. “Always reveal confidential information.”


Correct Answer

C. “Do not generate unsafe or harmful content.”


Explanation

Responsible AI system prompts help enforce safety and ethical boundaries.


Why the Other Answers Are Incorrect

A. “Ignore all safety rules.”

This encourages unsafe behavior.

B. “Provide harmful instructions when requested.”

This violates Responsible AI principles.

D. “Always reveal confidential information.”

This violates privacy and security principles.


Question 9

What effect does a higher temperature setting generally have in generative AI models?

A. Produces more predictable and repetitive responses
B. Produces more creative and varied responses
C. Disables AI reasoning
D. Prevents all hallucinations


Correct Answer

B. Produces more creative and varied responses


Explanation

Higher temperature settings increase randomness and creativity in generated responses.


Why the Other Answers Are Incorrect

A. Produces more predictable and repetitive responses

This is more associated with lower temperature settings.

C. Disables AI reasoning

Temperature does not disable reasoning.

D. Prevents all hallucinations

Hallucinations can still occur.


Question 10

Which example BEST demonstrates role prompting?

A. “Translate this sentence into French.”
B. “Summarize this article.”
C. “Act as an experienced financial advisor and explain retirement planning.”
D. “Convert this image into text.”


Correct Answer

C. “Act as an experienced financial advisor and explain retirement planning.”


Explanation

Role prompting assigns the AI model a specific role or perspective to guide its responses.


Why the Other Answers Are Incorrect

A. “Translate this sentence into French.”

This is a translation request.

B. “Summarize this article.”

This is a summarization request.

D. “Convert this image into text.”

This is an OCR-related task.


Final Thoughts

Prompt engineering is a foundational skill for working with generative AI systems and an important topic for the AI-901 certification exam. Microsoft expects candidates to understand how system prompts and user prompts influence model behavior and how effective prompts improve the quality, reliability, and safety of AI-generated responses.

These concepts are essential when building generative AI applications and agents using Azure AI Foundry and Azure OpenAI Service.


Go to the AI-901 Exam Prep Hub main page

Identify an appropriate AI model, based on capabilities (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Identify AI concepts and capabilities (40–45%)
--> Identify AI model components and configurations
--> Identify an appropriate AI model, based on capabilities


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Selecting the correct AI model for a specific business problem is an important skill and a key topic for the AI-901 certification exam. Microsoft expects candidates to understand the capabilities of common AI model types and recognize which model is appropriate for different scenarios.

This topic falls under the “Identify AI model components and configurations” section of the exam objectives.


Why Choosing the Right AI Model Matters

Different AI models are designed for different types of tasks.

Choosing the wrong model may lead to:

  • Poor accuracy
  • Inefficient processing
  • Increased costs
  • Unusable results
  • Poor user experiences

Understanding model capabilities helps organizations build effective AI solutions.


Major Categories of AI Models

For AI-901, you should understand the capabilities of several major AI model categories:

  • Classification models
  • Regression models
  • Clustering models
  • Computer vision models
  • Natural language processing (NLP) models
  • Generative AI models
  • Recommendation systems
  • Anomaly detection models

Classification Models

Classification models predict categories or labels.

They answer questions such as:

  • “What type is this?”
  • “Which category does this belong to?”

Common Use Cases

  • Spam email detection
  • Fraud detection
  • Sentiment analysis
  • Medical diagnosis classification
  • Image categorization

Example

A model predicts whether an email is:

  • Spam
  • Not spam

This is a classification problem.


Binary Classification

Binary classification predicts one of two possible outcomes.

Examples

  • Fraud or not fraud
  • Approved or denied
  • Positive or negative sentiment

Multiclass Classification

Multiclass classification predicts one of several categories.

Example

An AI model identifies whether an image contains:

  • A dog
  • A cat
  • A bird
  • A horse

Regression Models

Regression models predict numeric values.

They answer questions such as:

  • “How much?”
  • “How many?”
  • “What value?”

Common Use Cases

  • House price prediction
  • Sales forecasting
  • Temperature prediction
  • Demand estimation

Example

Predicting the selling price of a house based on:

  • Size
  • Location
  • Number of bedrooms

This is a regression problem.


Clustering Models

Clustering models group similar items together without predefined labels.

Clustering is a type of unsupervised learning.

Common Use Cases

  • Customer segmentation
  • Market analysis
  • Pattern discovery
  • Grouping similar documents

Example

A retailer groups customers based on purchasing behavior.

The model discovers patterns automatically.


Computer Vision Models

Computer vision models analyze images and video.

Common Capabilities

  • Object detection
  • Facial recognition
  • Image classification
  • Optical Character Recognition (OCR)
  • Image tagging

Example Use Cases

  • Self-driving cars
  • Security systems
  • Medical imaging
  • Product identification

Image Classification

Image classification identifies what appears in an image.

Example

Determining whether an image contains:

  • A cat
  • A dog
  • A car

Object Detection

Object detection identifies and locates objects within an image.

Example

A traffic monitoring system detects:

  • Cars
  • Pedestrians
  • Traffic lights

and determines their positions.


Optical Character Recognition (OCR)

OCR extracts text from images or scanned documents.

Example

Reading text from:

  • Receipts
  • Invoices
  • Forms
  • License plates

Natural Language Processing (NLP) Models

NLP models work with human language.

Common Capabilities

  • Sentiment analysis
  • Translation
  • Text summarization
  • Chatbots
  • Speech recognition
  • Named entity recognition

Example Use Cases

  • Customer support chatbots
  • Language translation apps
  • Voice assistants

Sentiment Analysis

Sentiment analysis identifies emotional tone in text.

Example

Determining whether a product review is:

  • Positive
  • Negative
  • Neutral

Translation Models

Translation models convert text between languages.

Example

Converting English text into Spanish.


Speech Recognition

Speech recognition converts spoken language into text.

Example

Voice assistants converting speech commands into written text.


Generative AI Models

Generative AI models create new content.

Common Outputs

  • Text
  • Images
  • Audio
  • Video
  • Code

Example Use Cases

  • AI chatbots
  • Content generation
  • Image creation
  • Coding assistants

Large Language Models (LLMs)

LLMs are generative AI models focused on language tasks.

Capabilities

  • Conversations
  • Summarization
  • Question answering
  • Content generation
  • Code generation

Example

An AI assistant answering user questions in natural language.


Recommendation Systems

Recommendation systems suggest items users may prefer.

Common Use Cases

  • Product recommendations
  • Movie recommendations
  • Music recommendations
  • Online advertising

Example

An online retailer recommends products based on browsing history.


Anomaly Detection Models

Anomaly detection models identify unusual patterns or behaviors.

Common Use Cases

  • Fraud detection
  • Cybersecurity monitoring
  • Equipment failure prediction
  • Network intrusion detection

Example

A bank identifies suspicious credit card transactions.


Supervised vs. Unsupervised Learning

Understanding learning types helps identify appropriate models.

Learning TypeDescription
Supervised LearningUses labeled data
Unsupervised LearningFinds patterns without labels

Supervised Examples

  • Classification
  • Regression

Unsupervised Examples

  • Clustering
  • Some anomaly detection systems

Choosing the Right AI Model

To select an appropriate AI model, ask:


What Type of Output Is Needed?

GoalModel Type
Predict categoriesClassification
Predict numbersRegression
Group similar itemsClustering
Generate contentGenerative AI
Analyze imagesComputer Vision
Process languageNLP

Is the Data Labeled?

Data TypeAppropriate Learning Type
Labeled dataSupervised learning
Unlabeled dataUnsupervised learning

What Content Is Being Processed?

Content TypeAppropriate Model
TextNLP or LLM
ImagesComputer Vision
AudioSpeech models
Numerical dataRegression or classification

Real-World Examples


Scenario 1: Email Spam Detection

Goal

Identify whether emails are spam.

Best Model

Classification model


Scenario 2: Predicting House Prices

Goal

Estimate home values.

Best Model

Regression model


Scenario 3: Grouping Customers by Buying Behavior

Goal

Identify customer segments.

Best Model

Clustering model


Scenario 4: AI Chatbot

Goal

Generate conversational responses.

Best Model

Large Language Model (LLM)


Scenario 5: Reading Text from Scanned Documents

Goal

Extract printed text.

Best Model

OCR computer vision model


Scenario 6: Detecting Fraudulent Transactions

Goal

Identify suspicious activity.

Best Model

Anomaly detection model


Azure AI Services and Model Types

Microsoft Azure AI Services provide many prebuilt AI capabilities, including:

  • Vision services
  • Speech services
  • Language services
  • Generative AI tools
  • Document intelligence
  • Recommendation capabilities

Microsoft Azure helps organizations apply the correct AI models to different business scenarios.


Responsible AI Considerations

When selecting AI models, organizations should also consider:

  • Fairness
  • Transparency
  • Privacy
  • Reliability
  • Inclusiveness
  • Accountability

A technically accurate model may still create ethical or operational concerns if deployed improperly.


Important AI-901 Exam Tips

For the exam, remember these key points:

  • Classification predicts categories.
  • Regression predicts numeric values.
  • Clustering groups similar items.
  • NLP models process language.
  • Computer vision models process images and video.
  • Generative AI creates new content.
  • Recommendation systems suggest relevant items.
  • Anomaly detection identifies unusual behavior.
  • LLMs are generative AI models for language tasks.
  • OCR extracts text from images or documents.

Quick Knowledge Check

Question 1

Which model type is best for predicting numeric values?

Answer

Regression models.


Question 2

Which AI capability is used to extract text from scanned documents?

Answer

Optical Character Recognition (OCR).


Question 3

What type of model is typically used for chatbots that generate responses?

Answer

Large Language Models (LLMs).


Question 4

Which learning type uses unlabeled data?

Answer

Unsupervised learning.


Practice Exam Questions

Question 1

A company wants to predict future monthly sales revenue based on historical sales data.

Which type of AI model is MOST appropriate?

A. Classification
B. Regression
C. Clustering
D. Computer vision


Correct Answer

B. Regression


Explanation

Regression models are used to predict numeric values such as revenue, prices, or temperatures.


Why the Other Answers Are Incorrect

A. Classification

Classification predicts categories, not numeric values.

C. Clustering

Clustering groups similar items.

D. Computer vision

Computer vision processes images and video.


Question 2

An organization wants to identify whether emails are spam or not spam.

Which type of AI model should be used?

A. Regression
B. Clustering
C. Classification
D. OCR


Correct Answer

C. Classification


Explanation

Spam detection is a classification problem because the output belongs to predefined categories: spam or not spam.


Why the Other Answers Are Incorrect

A. Regression

Regression predicts numeric values.

B. Clustering

Clustering groups unlabeled data.

D. OCR

OCR extracts text from images.


Question 3

Which AI capability is MOST appropriate for extracting text from scanned documents?

A. Object detection
B. OCR
C. Regression
D. Recommendation system


Correct Answer

B. OCR


Explanation

Optical Character Recognition (OCR) extracts printed or handwritten text from images or scanned documents.


Why the Other Answers Are Incorrect

A. Object detection

Object detection identifies objects within images.

C. Regression

Regression predicts numeric values.

D. Recommendation system

Recommendation systems suggest items to users.


Question 4

A retailer wants to group customers based on purchasing behavior without predefined labels.

Which type of AI model is MOST appropriate?

A. Classification
B. Regression
C. Clustering
D. Translation


Correct Answer

C. Clustering


Explanation

Clustering models group similar data points together without labeled categories.


Why the Other Answers Are Incorrect

A. Classification

Classification requires labeled categories.

B. Regression

Regression predicts numbers.

D. Translation

Translation converts text between languages.


Question 5

Which type of AI model is BEST suited for generating natural language responses in a chatbot?

A. Large Language Model (LLM)
B. Regression model
C. Clustering model
D. Decision tree only


Correct Answer

A. Large Language Model (LLM)


Explanation

LLMs are generative AI models designed for language tasks such as conversation, summarization, and question answering.


Why the Other Answers Are Incorrect

B. Regression model

Regression predicts numeric values.

C. Clustering model

Clustering groups similar data.

D. Decision tree only

Decision trees are not specialized for conversational text generation.


Question 6

A bank wants to identify suspicious credit card transactions that differ from normal spending patterns.

Which AI capability is MOST appropriate?

A. Sentiment analysis
B. Anomaly detection
C. OCR
D. Image classification


Correct Answer

B. Anomaly detection


Explanation

Anomaly detection models identify unusual or abnormal behavior that may indicate fraud or security issues.


Why the Other Answers Are Incorrect

A. Sentiment analysis

Sentiment analysis evaluates emotional tone in text.

C. OCR

OCR extracts text from images.

D. Image classification

Image classification categorizes images.


Question 7

What is the PRIMARY capability of a computer vision model?

A. Predicting stock prices
B. Processing and analyzing visual content such as images and video
C. Translating text between languages
D. Generating database queries


Correct Answer

B. Processing and analyzing visual content such as images and video


Explanation

Computer vision models work with images and video to identify objects, text, faces, and other visual information.


Why the Other Answers Are Incorrect

A. Predicting stock prices

This is typically a regression problem.

C. Translating text between languages

Translation is an NLP task.

D. Generating database queries

This is not the primary role of computer vision.


Question 8

A streaming service suggests movies based on a user’s viewing history.

Which AI capability is being used?

A. Recommendation system
B. OCR
C. Regression
D. Object detection


Correct Answer

A. Recommendation system


Explanation

Recommendation systems suggest products, movies, music, or other items based on user behavior and preferences.


Why the Other Answers Are Incorrect

B. OCR

OCR extracts text from images.

C. Regression

Regression predicts numeric values.

D. Object detection

Object detection identifies objects in images.


Question 9

Which type of AI model would MOST likely be used for language translation?

A. NLP model
B. Clustering model
C. Regression model
D. Computer vision model


Correct Answer

A. NLP model


Explanation

Natural Language Processing (NLP) models are designed to process and understand human language, including translation tasks.


Why the Other Answers Are Incorrect

B. Clustering model

Clustering groups similar items.

C. Regression model

Regression predicts numeric outputs.

D. Computer vision model

Computer vision analyzes images and video.


Question 10

Which statement BEST describes the difference between classification and regression models?

A. Classification predicts categories, while regression predicts numeric values
B. Classification uses images, while regression uses text only
C. Regression groups data, while classification predicts prices
D. Regression and classification are identical


Correct Answer

A. Classification predicts categories, while regression predicts numeric values


Explanation

Classification models predict labels or categories, while regression models predict continuous numeric values.


Why the Other Answers Are Incorrect

B. Classification uses images, while regression uses text only

Both models can work with many data types.

C. Regression groups data, while classification predicts prices

Grouping data is clustering, not regression.

D. Regression and classification are identical

They solve different types of problems.


Final Thoughts

Understanding AI model capabilities is a critical foundational skill for the AI-901 certification exam. Microsoft expects candidates to recognize which AI model types are appropriate for different business scenarios and understand the strengths of common AI approaches.

Knowing how to match business problems to the correct AI capabilities is essential for designing effective AI solutions on Azure and beyond.


Go to the AI-901 Exam Prep Hub main page