Welcome to the AI-901: Azure AI Fundamentals Exam Prep Hub!
Welcome to the one-stop hub with information for preparing for the AI-901: Azure AI Fundamentals certification exam. The content for this exam helps you to demonstrate that “you have conceptual knowledge of AI solutions in Azure and the foundational technical skills to work with them”. You will also need “knowledge of Python coding syntax and programming techniques, and you should be familiar with Azure resources”. Upon successful completion of the exam, you earn the Microsoft Certified: Azure AI Fundamentals certification.
This hub provides information directly here (topic-by-topic as outlined in the official study guide), links to a number of external resources, tips for preparing for the exam, practice tests, and section questions to help you prepare. Bookmark this page and use it as a guide to ensure that you are fully covering all relevant topics for the AI-901 exam and making use of as many of the resources available as possible.
Audience profile (from Microsoft’s site)
As a candidate for this Microsoft Certification, you’re at the beginning of your career in AI solution development. These Microsoft certifications offer opportunities to demonstrate your understanding of machine learning, AI concepts, and Azure services, whether you are starting your career or advancing your skills in AI solution development. Both certifications are designed for candidates from technical and non-technical backgrounds—prior experience in data science or software engineering is not required, though familiarity with basic cloud concepts and client-server applications will be helpful.
For the AI-901, you should have foundational knowledge of AI workloads and understand the basic principles of AI and machine learning. And also, you should have foundational technical skills for working with AI solutions in Azure, conceptual knowledge of Azure-based AI solutions, and familiarity with Python coding syntax and programming techniques, as well as Azure resources.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement AI solutions for information extraction by using Foundry --> Extract information from images by using Content Understanding
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Modern AI systems can analyze images and extract meaningful information automatically. Organizations use image analysis solutions for automation, accessibility, security, healthcare, retail, and business intelligence.
For the AI-901 certification exam, candidates should understand the foundational concepts behind extracting information from images by using Azure Content Understanding and Microsoft Foundry tools.
This topic falls under the “Implement AI solutions for information extraction by using Foundry” section of the AI-901 exam objectives.
What Is Image Information Extraction?
Image information extraction is the process of analyzing images to identify and retrieve useful information.
AI systems can detect:
Text
Objects
Faces
Colors
Products
Landmarks
Visual patterns
What Is Azure Content Understanding?
Azure Content Understanding enables AI systems to interpret and analyze content such as:
Images
Documents
Audio
Video
Capabilities include:
OCR
Object detection
Classification
Caption generation
Metadata extraction
Azure AI Foundry
Azure AI Foundry provides tools for building, testing, and managing AI-powered applications.
Developers can:
Access AI models
Analyze images
Build lightweight applications
Test AI workflows
Common Image Extraction Techniques
Optical Character Recognition (OCR)
OCR extracts text from images.
Example
Image
Photo of a street sign
OCR Output
“Main Street”
Object Detection
Object detection identifies objects and their locations within images.
Example
Detected Objects
Car
Bicycle
Traffic light
Person
Image Classification
Image classification determines the overall category of an image.
Example
Image
Photo of a cat
Classification
“Cat”
Facial Analysis
AI systems can analyze facial characteristics.
Capabilities may include:
Face detection
Emotion analysis
Age estimation
Responsible AI considerations are especially important for facial-analysis systems.
Image Captioning
Image captioning generates natural-language descriptions of images.
Example
Image
A dog running on a beach
Caption
“A brown dog running along a sandy beach.”
Metadata Extraction
AI systems can extract metadata and contextual information from images.
Examples include:
Time
Location
Camera details
Image dimensions
Barcode and QR Code Detection
AI systems can identify and decode:
Barcodes
QR codes
Example
Retail applications may scan product barcodes for inventory management.
APIs and Endpoints
Applications communicate with Azure AI services using:
APIs
Endpoints
Images are submitted programmatically for analysis.
Authentication
Applications must securely authenticate before accessing AI services.
Common methods include:
API keys
Azure credentials
Managed identities
Lightweight Application Workflow
A typical workflow includes:
User uploads image
Application sends image to AI service
AI analyzes image
Results are returned
Application displays extracted information
Example High-Level Pseudocode
image = upload_image()
results = analyze_image(image)
display_results(results)
For AI-901, understanding the workflow is more important than memorizing exact syntax.
Common Real-World Scenarios
Scenario 1: Receipt Scanner
Goal
Extract purchase details from receipt images.
Features
OCR
Table extraction
Total amount detection
Scenario 2: Accessibility Assistant
Goal
Describe images for visually impaired users.
Features
Image captioning
OCR
Object detection
Scenario 3: Retail Inventory
Goal
Identify products from shelf images.
Features
Barcode scanning
Object detection
Classification
Scenario 4: Traffic Monitoring
Goal
Analyze roadway images.
Features
Vehicle detection
Traffic analysis
License plate reading
Responsible AI Considerations
Image-analysis applications should follow Responsible AI principles.
Key considerations include:
Privacy
Fairness
Transparency
Inclusiveness
Accountability
Security
Privacy Concerns
Images may contain:
Faces
Personal information
License plates
Sensitive documents
Organizations should protect image data appropriately.
Fairness and Bias
Vision systems may perform differently across:
Lighting conditions
Skin tones
Environmental conditions
Camera quality
Testing and evaluation are important.
Transparency
Users should understand:
AI is analyzing images
AI-generated outputs may contain errors
Images may be processed in the cloud
Accuracy Limitations
Image extraction systems may struggle with:
Blurry images
Poor lighting
Obstructed objects
Low-resolution images
Hallucinations and Errors
AI systems may occasionally:
Misidentify objects
Generate incorrect captions
Extract inaccurate text
Applications should validate important outputs.
Error Handling
Applications should handle:
Unsupported image formats
Corrupted files
Authentication failures
Network interruptions
Rate limits
Advantages of Image Extraction AI
Benefits include:
Faster processing
Automation
Scalability
Accessibility improvements
Reduced manual work
Limitations of Image Extraction AI
Challenges include:
Accuracy limitations
Bias
Privacy concerns
Environmental variability
Ethical considerations
Multimodal AI
Some modern AI systems combine:
Vision
Text
Speech
Generative AI
These systems can:
Analyze images
Answer visual questions
Generate descriptions
Create new content
High-Level Architecture
A simplified architecture often includes:
User uploads image
Application sends image to Azure AI service
AI processes image
Structured results are returned
Application displays information
Important AI-901 Exam Tips
For the exam, remember these key points:
OCR extracts text from images.
Object detection identifies objects and locations.
APIs and endpoints connect applications to AI services.
Authentication secures access to AI resources.
Responsible AI principles apply to image-analysis systems.
Poor image quality can reduce accuracy.
Hallucinations are inaccurate AI-generated outputs.
Azure AI Foundry supports AI application development.
Quick Knowledge Check
Question 1
What does OCR do?
Answer
Extracts machine-readable text from images.
Question 2
What is object detection?
Answer
Identifying and locating objects within an image.
Question 3
Why is authentication important?
Answer
It secures access to Azure AI services.
Question 4
What can reduce image-analysis accuracy?
Answer
Poor lighting, blur, and low-resolution images.
Practice Exam Questions
Exam: AI-901
Topic: Extract Information from Images by Using Content Understanding
Question 1
What is the PRIMARY purpose of image information extraction?
A. To analyze images and retrieve useful information B. To increase internet bandwidth C. To manage operating systems D. To improve printer performance
Correct Answer
A. To analyze images and retrieve useful information
Explanation
Image information extraction uses AI to identify and retrieve meaningful data from images, such as text, objects, and visual patterns.
Why the Other Answers Are Incorrect
B. To increase internet bandwidth
Image analysis does not affect networking speed.
C. To manage operating systems
This is unrelated to computer vision.
D. To improve printer performance
Printers are unrelated to AI image extraction.
Question 2
What does OCR stand for?
A. Optical Character Recognition B. Open Content Routing C. Object Classification Reporting D. Operational Cloud Rendering
Correct Answer
A. Optical Character Recognition
Explanation
OCR extracts machine-readable text from images and scanned documents.
Why the Other Answers Are Incorrect
B. Open Content Routing
This is not the meaning of OCR.
C. Object Classification Reporting
This is unrelated to text extraction.
D. Operational Cloud Rendering
This is not an OCR term.
Question 3
Which computer vision capability identifies multiple objects and their locations within an image?
A. Object detection B. Speech synthesis C. Text summarization D. Audio transcription
Correct Answer
A. Object detection
Explanation
Object detection identifies objects and determines where they appear within an image.
Why the Other Answers Are Incorrect
B. Speech synthesis
This converts text into speech.
C. Text summarization
This is a text-analysis task.
D. Audio transcription
This converts speech into text.
Question 4
What is image classification?
A. Categorizing an image based on its contents B. Compressing image file sizes C. Encrypting image data D. Converting images into spreadsheets
Correct Answer
A. Categorizing an image based on its contents
Explanation
Image classification determines the overall category or subject represented in an image.
Why the Other Answers Are Incorrect
B. Compressing image file sizes
Compression is unrelated to classification.
C. Encrypting image data
Encryption is unrelated to image categorization.
D. Converting images into spreadsheets
This is unrelated to computer vision.
Question 5
What does image captioning do?
A. Generates natural-language descriptions of images B. Repairs corrupted image files C. Converts speech into text D. Improves internet speeds
Correct Answer
A. Generates natural-language descriptions of images
Explanation
Image captioning creates descriptive text that explains the contents of an image.
Why the Other Answers Are Incorrect
B. Repairs corrupted image files
This is unrelated to caption generation.
C. Converts speech into text
This is speech recognition.
D. Improves internet speeds
This is unrelated to AI image analysis.
Question 6
How do lightweight image-analysis applications typically communicate with Azure AI services?
A. Through APIs and endpoints B. Through printer drivers C. Through monitor settings D. Through USB-only connections
Correct Answer
A. Through APIs and endpoints
Explanation
Applications send images to cloud AI services through APIs and service endpoints.
Why the Other Answers Are Incorrect
B. Through printer drivers
Printers are unrelated to AI communication.
C. Through monitor settings
This is unrelated to cloud AI services.
D. Through USB-only connections
Cloud services use network communication.
Question 7
Why is authentication important when using Azure AI services?
A. To secure access to AI resources B. To improve image brightness C. To reduce image resolution D. To increase network speed
Correct Answer
A. To secure access to AI resources
Explanation
Authentication ensures that only authorized users and applications can access Azure AI services.
Why the Other Answers Are Incorrect
B. To improve image brightness
Authentication does not affect image quality.
C. To reduce image resolution
Authentication is unrelated to image resolution.
D. To increase network speed
Authentication does not improve internet performance.
Question 8
Which Responsible AI concern is especially important for image-analysis systems?
A. Protecting personal and sensitive visual information B. Increasing printer speed C. Improving spreadsheet formulas D. Reducing monitor power usage
Correct Answer
A. Protecting personal and sensitive visual information
Explanation
Images may contain sensitive information such as faces, license plates, and documents that must be protected.
Why the Other Answers Are Incorrect
B. Increasing printer speed
This is unrelated to Responsible AI.
C. Improving spreadsheet formulas
This is unrelated to image analysis.
D. Reducing monitor power usage
This is unrelated to AI ethics.
Question 9
Which factor can reduce image-analysis accuracy?
A. Poor image quality B. Spreadsheet formatting C. Keyboard layout changes D. Audio playback speed
Correct Answer
A. Poor image quality
Explanation
Blur, poor lighting, and low-resolution images can negatively affect AI analysis accuracy.
Why the Other Answers Are Incorrect
B. Spreadsheet formatting
This does not affect image AI systems.
C. Keyboard layout changes
This is unrelated to computer vision.
D. Audio playback speed
This is unrelated to image processing.
Question 10
What are hallucinations in AI image-analysis systems?
A. Incorrect or fabricated AI-generated outputs B. Hardware installation failures C. Network outages D. Audio recording problems
Correct Answer
A. Incorrect or fabricated AI-generated outputs
Explanation
Hallucinations occur when AI systems generate inaccurate captions, object identifications, or extracted information.
Why the Other Answers Are Incorrect
B. Hardware installation failures
This is unrelated to AI-generated outputs.
C. Network outages
This is a connectivity issue.
D. Audio recording problems
This is unrelated to image-analysis systems.
Final Thoughts
Extracting information from images by using Content Understanding is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand foundational concepts such as OCR, object detection, image classification, APIs, authentication, Responsible AI principles, and lightweight image-analysis workflows.
Azure AI services and Azure AI Foundry provide powerful tools for building scalable AI applications capable of understanding and extracting valuable information from visual content.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement AI solutions for information extraction by using Foundry --> Extract information from documents and forms by using Azure Content Understanding in Foundry Tools
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Organizations process enormous amounts of documents every day, including invoices, receipts, forms, contracts, and identification documents. AI-powered information extraction solutions help automate the process of reading, understanding, and organizing document data.
For the AI-901 certification exam, candidates should understand the foundational concepts behind extracting information from documents and forms by using Azure Content Understanding and Microsoft Foundry tools.
This topic falls under the “Implement AI solutions for information extraction by using Foundry” section of the AI-901 exam objectives.
What Is Information Extraction?
Information extraction is the process of identifying and retrieving useful data from documents, images, forms, audio, or other content.
Examples include extracting:
Names
Dates
Invoice totals
Addresses
Phone numbers
Product information
What Is Azure Content Understanding?
Azure Content Understanding helps AI systems analyze and interpret structured and unstructured documents.
Capabilities include:
Text extraction
Form recognition
Document analysis
Information classification
Key-value pair extraction
Azure AI Foundry
Azure AI Foundry provides tools for building, testing, and managing AI-powered applications.
Developers can:
Configure AI services
Process documents
Test extraction workflows
Build lightweight AI applications
Structured vs. Unstructured Documents
Structured Documents
Structured documents follow a consistent layout.
Examples include:
Tax forms
Invoices
Receipts
Application forms
Unstructured Documents
Unstructured documents have less predictable layouts.
Examples include:
Emails
Letters
Articles
Contracts
Optical Character Recognition (OCR)
OCR converts text within images or scanned documents into machine-readable text.
Example
Input
Scanned receipt image
OCR Output
Store name
Date
Total amount
Form Recognition
Form recognition identifies fields and values within forms.
Example
Form
Insurance application
Extracted Data
Customer name
Policy number
Address
Claim amount
Key-Value Pair Extraction
AI systems can identify relationships between labels and values.
Example
Key
Value
Invoice Number
INV-1045
Total
$250.00
Due Date
05/30/2026
Table Extraction
AI can identify and extract tables from documents.
Example
A receipt table may contain:
Item names
Quantities
Prices
Classification
Document classification identifies the type of document being processed.
Example
The system determines whether a file is:
Invoice
Contract
Receipt
Resume
Named Entity Recognition (NER)
NER identifies important entities within text.
Entities may include:
People
Organizations
Locations
Dates
Example
Text
“John Smith works for Contoso in Seattle.”
Extracted Entities
John Smith (Person)
Contoso (Organization)
Seattle (Location)
APIs and Endpoints
Applications communicate with Azure AI services through:
APIs
Endpoints
Documents are submitted for analysis programmatically.
Authentication
Applications must securely authenticate before accessing Azure AI services.
Common authentication methods include:
API keys
Azure credentials
Managed identities
Lightweight Application Workflow
A typical workflow includes:
User uploads document
Application sends file to AI service
AI extracts information
Results are returned
Application displays or stores extracted data
Example Workflow
Input
Scanned invoice
AI Processing
OCR
Key-value extraction
Table analysis
Output
Structured invoice data
Example High-Level Pseudocode
document = upload_document()
results = analyze_document(document)
display_results(results)
For AI-901, understanding the workflow is more important than memorizing exact syntax.
Common Real-World Scenarios
Scenario 1: Invoice Processing
Goal
Automate invoice data extraction.
Features
OCR
Table extraction
Total amount detection
Scenario 2: Receipt Scanning
Goal
Extract purchase information from receipts.
Features
Text extraction
Merchant identification
Expense categorization
Scenario 3: Resume Processing
Goal
Extract candidate information from resumes.
Features
Name extraction
Skill identification
Contact information detection
Scenario 4: Healthcare Forms
Goal
Digitize patient records.
Features
Form recognition
Key-value extraction
Classification
Responsible AI Considerations
Document-processing applications should follow Responsible AI principles.
Key considerations include:
Privacy
Security
Fairness
Transparency
Accountability
Inclusiveness
Privacy Concerns
Documents may contain:
Personal information
Financial data
Medical information
Legal records
Organizations should protect sensitive data appropriately.
Security Considerations
Applications should secure:
Uploaded files
Stored documents
API credentials
Extracted data
Transparency
Users should understand:
AI is analyzing documents
Extracted data may contain errors
Human review may still be needed
Accuracy Limitations
AI extraction systems may struggle with:
Poor scan quality
Handwritten text
Complex layouts
Damaged documents
Hallucinations and Errors
AI systems may occasionally:
Extract incorrect values
Miss fields
Misclassify documents
Applications should validate important information.
APIs and endpoints connect applications to Azure AI services.
Authentication secures access to AI resources.
Responsible AI principles apply to document-processing systems.
Poor document quality can reduce extraction accuracy.
AI-generated outputs may still require validation.
Quick Knowledge Check
Question 1
What does OCR do?
Answer
Extracts machine-readable text from images or scanned documents.
Question 2
What is form recognition?
Answer
Identifying and extracting fields and values from forms.
Question 3
Why is authentication important?
Answer
It secures access to Azure AI services and protects resources.
Question 4
What can reduce extraction accuracy?
Answer
Poor scan quality, handwriting, and inconsistent document layouts.
Practice Exam Questions
Exam: AI-901
Topic: Extract Information from Documents and Forms by Using Azure Content Understanding in Foundry Tools
Question 1
What is the PRIMARY purpose of information extraction AI solutions?
A. To retrieve useful data from documents and content B. To increase internet bandwidth C. To replace operating systems D. To improve monitor resolution
Correct Answer
A. To retrieve useful data from documents and content
Explanation
Information extraction AI systems identify and retrieve meaningful information such as names, dates, totals, and addresses from documents and forms.
Why the Other Answers Are Incorrect
B. To increase internet bandwidth
Information extraction does not affect network speed.
C. To replace operating systems
AI document processing does not replace operating systems.
D. To improve monitor resolution
This is unrelated to AI information extraction.
Question 2
What does OCR stand for?
A. Optical Character Recognition B. Open Content Retrieval C. Object Classification Routing D. Operational Compute Reporting
Correct Answer
A. Optical Character Recognition
Explanation
OCR converts printed or handwritten text within images and scanned documents into machine-readable text.
Why the Other Answers Are Incorrect
B. Open Content Retrieval
This is not the meaning of OCR.
C. Object Classification Routing
This is unrelated to document analysis.
D. Operational Compute Reporting
This is not an OCR term.
Question 3
Which AI capability identifies fields and values within forms?
A. Form recognition B. Speech synthesis C. Image compression D. Network monitoring
Correct Answer
A. Form recognition
Explanation
Form recognition extracts structured information such as names, dates, totals, and addresses from forms and documents.
Why the Other Answers Are Incorrect
B. Speech synthesis
This converts text into speech.
C. Image compression
This reduces file size and is unrelated to field extraction.
D. Network monitoring
This is unrelated to document AI.
Question 4
Which Azure platform provides tools for building and managing AI-powered applications?
A. Azure AI Foundry B. Microsoft Paint C. Windows Task Manager D. Azure DNS
Correct Answer
A. Azure AI Foundry
Explanation
Azure AI Foundry provides tools for deploying, testing, and managing AI applications and services.
Why the Other Answers Are Incorrect
B. Microsoft Paint
Paint is a graphics editor.
C. Windows Task Manager
This is a system monitoring tool.
D. Azure DNS
This is a networking service.
Question 5
What is key-value pair extraction?
A. Identifying labels and their associated values in documents B. Encrypting document files C. Compressing image sizes D. Converting audio into text
Correct Answer
A. Identifying labels and their associated values in documents
Explanation
Key-value extraction identifies relationships such as:
Invoice Number → INV-1045
Total → $250.00
Why the Other Answers Are Incorrect
B. Encrypting document files
Encryption is unrelated to data extraction.
C. Compressing image sizes
Compression is unrelated to document intelligence.
D. Converting audio into text
This is speech recognition.
Question 6
What is the purpose of document classification?
A. To identify the type of document being processed B. To increase network performance C. To generate music files D. To repair damaged documents physically
Correct Answer
A. To identify the type of document being processed
Explanation
Document classification determines whether a file is an invoice, contract, receipt, resume, or another document type.
Why the Other Answers Are Incorrect
B. To increase network performance
Classification does not improve networking.
C. To generate music files
This is unrelated to document AI.
D. To repair damaged documents physically
AI classification does not physically repair documents.
Question 7
How do lightweight document-processing applications typically communicate with Azure AI services?
A. Through APIs and endpoints B. Through USB-only connections C. Through monitor calibration tools D. Through printer drivers
Correct Answer
A. Through APIs and endpoints
Explanation
Applications send documents to Azure AI services using APIs and endpoints and receive structured analysis results.
Why the Other Answers Are Incorrect
B. Through USB-only connections
Cloud services use network communication.
C. Through monitor calibration tools
This is unrelated to AI services.
D. Through printer drivers
Printers are unrelated to cloud AI communication.
Question 8
Which factor can reduce the accuracy of document extraction systems?
A. Poor document quality B. Spreadsheet color themes C. Keyboard layout changes D. Audio playback speed
Correct Answer
A. Poor document quality
Explanation
Blurry scans, damaged pages, handwriting, and poor lighting can negatively affect extraction accuracy.
Why the Other Answers Are Incorrect
B. Spreadsheet color themes
This does not affect document extraction AI.
C. Keyboard layout changes
This is unrelated to AI document analysis.
D. Audio playback speed
This is unrelated to document processing.
Question 9
Why is authentication important when using Azure AI services?
A. To secure access to AI resources B. To improve image resolution C. To increase internet speed D. To compress document files
Correct Answer
A. To secure access to AI resources
Explanation
Authentication ensures that only authorized users and applications can access AI services.
Why the Other Answers Are Incorrect
B. To improve image resolution
Authentication does not affect image quality.
C. To increase internet speed
Authentication does not improve networking.
D. To compress document files
Authentication is unrelated to file compression.
Question 10
Which Responsible AI concern is especially important when processing documents?
A. Protecting sensitive personal information B. Increasing monitor brightness C. Improving printer speed D. Reducing spreadsheet file size
Correct Answer
A. Protecting sensitive personal information
Explanation
Documents may contain financial, medical, legal, or personal information that must be protected appropriately.
Why the Other Answers Are Incorrect
B. Increasing monitor brightness
This is unrelated to Responsible AI.
C. Improving printer speed
This is unrelated to document intelligence.
D. Reducing spreadsheet file size
This is unrelated to AI ethics or privacy.
Final Thoughts
Extracting information from documents and forms using Azure Content Understanding and Foundry tools is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand foundational concepts such as OCR, form recognition, document analysis, APIs, authentication, Responsible AI principles, and lightweight document-processing workflows.
Azure AI services and Azure AI Foundry provide powerful tools for automating information extraction and improving efficiency across business, healthcare, finance, and administrative scenarios.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement AI solutions with computer vision and image-generation capabilities by using Foundry --> Interpret visual input in prompts by using a deployed multimodal model
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Modern AI systems are increasingly capable of understanding not only text and speech, but also visual information such as images and videos. Multimodal AI models combine multiple forms of input to generate intelligent responses and insights.
For the AI-901 certification exam, candidates should understand the foundational concepts behind interpreting visual input in prompts by using deployed multimodal models through Microsoft Azure AI Foundry and related Azure AI services.
This topic falls under the “Implement AI solutions with computer vision and image-generation capabilities by using Foundry” section of the AI-901 exam objectives.
What Is a Multimodal Model?
A multimodal model is an AI model capable of processing multiple types of input and output.
These modalities may include:
Text
Images
Speech/audio
Video
Multimodal models can combine information across different input types to generate responses.
What Is Visual Input?
Visual input refers to image or video data provided to an AI system.
Examples include:
Photographs
Screenshots
Documents
Charts
Diagrams
Videos
Example Visual Prompt
A user uploads a photo and asks:
“What objects are visible in this image?”
The AI analyzes the visual content and generates a response.
Computer Vision
Computer vision is the field of AI focused on enabling systems to interpret and understand visual information.
Computer vision tasks include:
Image classification
Object detection
Facial analysis
Optical character recognition (OCR)
Image captioning
Azure AI Vision
Azure AI Vision provides computer vision capabilities in Azure.
Features include:
Image analysis
OCR
Object detection
Image captioning
Face-related analysis
Azure AI Foundry
Azure AI Foundry provides tools for building and managing multimodal AI applications.
Developers can:
Deploy AI models
Test prompts
Analyze images
Build AI-powered apps
Deployed Models
A deployed model is an AI model made available for real-time use through a cloud endpoint.
Applications communicate with deployed models using APIs.
Visual Prompt Workflow
A common workflow includes:
User uploads image
Application sends image to multimodal model
Model analyzes visual content
Model generates response
Application displays results
Example Workflow
User Uploads Image
A photo of a dog playing in a park
User Prompt
“Describe this image.”
AI Response
“A brown dog is running through a grassy park.”
Image Classification
Image classification identifies the primary category of an image.
Example
Image
Picture of a cat
Classification
“Cat”
Object Detection
Object detection identifies and locates multiple objects within an image.
Example
Image
Street scene
Detected Objects
Car
Bicycle
Traffic light
Pedestrian
Optical Character Recognition (OCR)
OCR extracts text from images or scanned documents.
Example
Image
Photo of a receipt
Extracted Text
Store name
Total amount
Date
Image Captioning
Image captioning generates natural-language descriptions of images.
Example
Image
A child flying a kite
Caption
“A child flying a colorful kite in a field.”
Visual Question Answering
Some multimodal models can answer questions about images.
Example
Prompt
“How many people are in the image?”
The model analyzes the image and generates an answer.
Combining Text and Images
Multimodal systems often combine:
Text prompts
Visual input
This improves contextual understanding.
Example
Image
A restaurant menu
Prompt
“Which item appears to be vegetarian?”
The AI analyzes both the image and the prompt together.
APIs and Endpoints
Applications communicate with deployed multimodal models through:
APIs
Endpoints
These allow images and prompts to be submitted programmatically.
Authentication
Applications must securely authenticate before accessing Azure AI services.
Common methods include:
API keys
Azure credentials
Managed identities
User Interface Components
A lightweight visual AI application may include:
Image upload area
Prompt input box
Results display
Image preview
Real-Time Processing
Many multimodal applications support near real-time image analysis.
This enables interactive user experiences.
Common Real-World Scenarios
Scenario 1: Accessibility Assistant
Goal
Describe visual content for visually impaired users.
Features
Image captioning
OCR
Voice output
Scenario 2: Retail Product Recognition
Goal
Identify products from images.
Features
Object detection
Classification
Product lookup
Scenario 3: Document Processing
Goal
Extract information from scanned forms.
Features
OCR
Text extraction
Data analysis
Scenario 4: Content Moderation
Goal
Identify harmful or unsafe visual content.
Features
Image analysis
Safety filtering
Automated moderation
Responsible AI Considerations
Visual AI applications should follow Responsible AI principles.
Key considerations include:
Privacy
Fairness
Transparency
Inclusiveness
Accountability
Security
Privacy Concerns
Images may contain:
Personal information
Faces
Sensitive documents
Organizations should protect user data appropriately.
Bias and Fairness
Computer vision systems may perform unevenly across:
Skin tones
Age groups
Lighting conditions
Demographics
Organizations should evaluate models carefully for fairness.
Transparency
Users should understand:
AI is analyzing images
AI-generated descriptions may contain errors
Images may be stored or processed in the cloud
Hallucinations
Multimodal AI systems may generate inaccurate visual descriptions.
These incorrect outputs are called hallucinations.
Applications should not assume all AI-generated outputs are accurate.
Error Handling
Applications should handle:
Unsupported image formats
Low-quality images
Network failures
Authentication errors
Rate limits
Image Quality Challenges
Poor image quality can reduce accuracy.
Examples include:
Blurry images
Poor lighting
Occluded objects
Low resolution
Advantages of Visual AI Applications
Benefits include:
Automation
Faster analysis
Accessibility improvements
Improved user experiences
Scalable image processing
Limitations of Visual AI Applications
Challenges include:
Recognition inaccuracies
Bias
Privacy concerns
Hallucinations
Sensitivity to image quality
High-Level Workflow
A simplified workflow includes:
Upload image
Send image and prompt to model
Analyze visual content
Generate response
Display results
Example High-Level Pseudocode
image = upload_image()
prompt = get_prompt()
response = analyze_image(image, prompt)
display_response(response)
For AI-901, understanding the workflow is more important than memorizing exact syntax.
Important AI-901 Exam Tips
For the exam, remember these key points:
Multimodal models process multiple data types.
Visual input includes images and video.
Azure AI Vision supports computer vision workloads.
OCR extracts text from images.
Image captioning generates descriptions of images.
Object detection identifies multiple objects in images.
APIs and endpoints connect applications to AI services.
Authentication secures AI access.
Responsible AI principles apply to computer vision systems.
Hallucinations are inaccurate AI-generated outputs.
Quick Knowledge Check
Question 1
What is OCR used for?
Answer
Extracting text from images or scanned documents.
Question 2
What does image captioning do?
Answer
Generates natural-language descriptions of images.
Question 3
Why are multimodal models useful?
Answer
They can process multiple types of input such as text and images together.
Question 4
Why is fairness important in computer vision?
Answer
To reduce biased or uneven performance across different groups of people.
Practice Exam Questions
Question 1
What is a multimodal AI model?
A. A model that processes only text B. A model capable of processing multiple types of input such as text and images C. A model used only for networking D. A model designed exclusively for spreadsheets
Correct Answer
B. A model capable of processing multiple types of input such as text and images
Explanation
Multimodal models can process and combine different forms of input, including text, images, audio, and video.
Why the Other Answers Are Incorrect
A. A model that processes only text
That describes a text-only model.
C. A model used only for networking
Networking is unrelated to multimodal AI.
D. A model designed exclusively for spreadsheets
This is unrelated to AI modalities.
Question 2
Which Azure service provides computer vision capabilities such as image analysis and OCR?
A. Azure AI Vision B. Azure Backup C. Azure Virtual Desktop D. Azure Monitor
Correct Answer
A. Azure AI Vision
Explanation
Azure AI Vision provides computer vision features including OCR, object detection, and image captioning.
Why the Other Answers Are Incorrect
B. Azure Backup
This is a backup service.
C. Azure Virtual Desktop
This provides desktop virtualization.
D. Azure Monitor
This is used for monitoring and diagnostics.
Question 3
What does OCR stand for?
A. Optical Character Recognition B. Operational Cloud Routing C. Object Classification Registry D. Open Compute Rendering
Correct Answer
A. Optical Character Recognition
Explanation
OCR extracts text from images or scanned documents.
Why the Other Answers Are Incorrect
B. Operational Cloud Routing
This is not an AI vision term.
C. Object Classification Registry
This is not the meaning of OCR.
D. Open Compute Rendering
This is unrelated to text extraction.
Question 4
What is the PRIMARY purpose of object detection?
A. To identify and locate objects within an image B. To translate speech into text C. To summarize long documents D. To improve internet speed
Correct Answer
A. To identify and locate objects within an image
Explanation
Object detection identifies multiple objects and their positions within an image.
Why the Other Answers Are Incorrect
B. To translate speech into text
This is a speech recognition task.
C. To summarize long documents
This is a text analysis task.
D. To improve internet speed
Object detection does not affect networking.
Question 5
What does image captioning do?
A. Generates natural-language descriptions of images B. Converts text into audio C. Detects malware in files D. Compresses images automatically
Correct Answer
A. Generates natural-language descriptions of images
Explanation
Image captioning uses AI to describe visual content in natural language.
Why the Other Answers Are Incorrect
B. Converts text into audio
This is speech synthesis.
C. Detects malware in files
This is unrelated to computer vision.
D. Compresses images automatically
Captioning does not perform compression.
Question 6
How do applications typically communicate with deployed multimodal models?
A. Through APIs and endpoints B. Through USB-only connections C. Through monitor drivers D. Through spreadsheet templates
Correct Answer
A. Through APIs and endpoints
Explanation
Applications use APIs and endpoints to send prompts and images to AI services.
Why the Other Answers Are Incorrect
B. Through USB-only connections
Cloud AI services use network communication.
C. Through monitor drivers
These are unrelated to AI communication.
D. Through spreadsheet templates
This is unrelated to AI integration.
Question 7
Why is authentication important when accessing Azure AI services?
A. To secure access to AI resources B. To increase image resolution C. To improve keyboard performance D. To reduce monitor brightness
Correct Answer
A. To secure access to AI resources
Explanation
Authentication ensures that only authorized users and applications can access Azure AI services.
Why the Other Answers Are Incorrect
B. To increase image resolution
Authentication does not affect image quality.
C. To improve keyboard performance
This is unrelated to AI services.
D. To reduce monitor brightness
Authentication does not control display settings.
Question 8
Which Responsible AI concern is especially important when analyzing images?
A. Protecting personal and sensitive visual information B. Increasing video frame rates C. Improving printer output quality D. Accelerating spreadsheet calculations
Correct Answer
A. Protecting personal and sensitive visual information
Explanation
Images may contain faces, documents, or other sensitive information that must be protected.
Why the Other Answers Are Incorrect
B. Increasing video frame rates
This is unrelated to Responsible AI.
C. Improving printer output quality
Printers are unrelated to computer vision ethics.
D. Accelerating spreadsheet calculations
This is unrelated to image analysis.
Question 9
What are hallucinations in multimodal AI systems?
A. Incorrect or fabricated AI-generated outputs B. Hardware installation failures C. Internet connectivity issues D. Audio recording problems
Correct Answer
A. Incorrect or fabricated AI-generated outputs
Explanation
Hallucinations occur when AI generates inaccurate or invented descriptions or answers.
Why the Other Answers Are Incorrect
B. Hardware installation failures
This is unrelated to AI-generated content.
C. Internet connectivity issues
This is a networking problem.
D. Audio recording problems
This relates to audio hardware or software.
Question 10
Which factor can negatively affect computer vision accuracy?
A. Poor image quality B. Spreadsheet formatting C. Screen brightness settings D. Keyboard layout
Correct Answer
A. Poor image quality
Explanation
Blurry images, poor lighting, and low resolution can reduce computer vision accuracy.
Why the Other Answers Are Incorrect
B. Spreadsheet formatting
This does not affect image analysis.
C. Screen brightness settings
This does not directly affect AI image processing.
D. Keyboard layout
Keyboard settings are unrelated to computer vision.
Final Thoughts
Interpreting visual input using deployed multimodal models is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the foundational concepts behind computer vision and multimodal AI applications, including image analysis, OCR, object detection, image captioning, APIs, authentication, and Responsible AI principles.
Azure AI Vision and Azure AI Foundry provide powerful tools for building intelligent applications capable of understanding and responding to visual information in real-world scenarios.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement AI solutions for text and speech by using Foundry --> Build a lightweight application that includes text analysis
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Text analysis is one of the most common AI workloads used in modern applications. Organizations use AI-powered text analysis to extract meaning, identify sentiment, detect entities, summarize content, and automate language-related tasks.
For the AI-901 certification exam, candidates should understand the foundational concepts behind building lightweight applications that use text analysis services through Microsoft Azure AI Foundry and Azure AI services.
This topic falls under the “Implement AI solutions for text and speech by using Foundry” section of the AI-901 exam objectives.
What Is Text Analysis?
Text analysis is the process of using AI to extract meaning and insights from written language.
AI systems analyze text to identify:
Sentiment
Key phrases
Named entities
Language
Topics
Summaries
Examples of Text Analysis Applications
Organizations use text analysis in:
Customer feedback systems
Chatbots
Social media monitoring
Document analysis
Customer support automation
Content moderation
What Is a Lightweight Application?
A lightweight application is a simple application focused on core functionality.
Characteristics include:
Minimal interface
Reduced complexity
Fast deployment
Lower resource usage
Common Lightweight Text Analysis Applications
Examples include:
Sentiment analysis web apps
Customer review analyzers
Document summarization tools
Language detection apps
Keyword extraction utilities
Azure AI Foundry
Azure AI Foundry provides tools for creating and managing AI-powered applications.
“The customer service was excellent, but shipping was slow.”
AI Analysis
Positive sentiment: customer service
Negative sentiment: shipping delay
APIs and Endpoints
Applications communicate with AI services through APIs and endpoints.
The application sends requests containing text and receives analysis results.
Authentication
Applications must authenticate securely before accessing AI services.
Common methods include:
API keys
Azure credentials
Managed identities
Sentiment Analysis
Sentiment analysis identifies emotional tone in text.
Common sentiment categories:
Positive
Negative
Neutral
Mixed
Example
Text
“I love the product, but setup was confusing.”
Result
Mixed sentiment
Key Phrase Extraction
Key phrase extraction identifies important words and phrases.
Example
Text
“Azure AI Foundry simplifies AI application development.”
Extracted Key Phrases
Azure AI Foundry
AI application development
Entity Recognition
Entity recognition identifies important entities in text.
Common entity types:
People
Organizations
Locations
Dates
Products
Example
Text
“Microsoft announced updates in Seattle.”
Detected Entities
Microsoft → Organization
Seattle → Location
Language Detection
Language detection identifies the language of text.
Example
Text
“Bonjour tout le monde.”
Detected Language
French
Text Summarization
Summarization creates shorter versions of long text while preserving key ideas.
Example
Original Text
A long customer review
Summary
“Customer liked the product but experienced delivery delays.”
Content Moderation
Some applications use text analysis to identify:
Offensive language
Harmful content
Unsafe text
Content moderation supports Responsible AI.
User Interface Components
A lightweight text analysis application commonly includes:
Text input box
Analyze button
Results display area
Example Lightweight Application
A simple customer feedback analyzer may:
Accept customer reviews
Perform sentiment analysis
Display positive or negative sentiment
High-Level Application Architecture
Typical components include:
Frontend interface
AI service endpoint
Authentication layer
Results display
Example High-Level Pseudocode
text = get_user_input()
results = analyze_text(text)
display_results(results)
For AI-901, understanding the workflow is more important than memorizing code syntax.
Error Handling
Applications should handle:
Invalid input
Authentication failures
Network issues
Rate limits
Service unavailability
Rate Limits
AI services may limit request frequency.
Applications should gracefully handle throttling and retries.
Responsible AI Considerations
Text analysis applications should follow Responsible AI principles.
Important considerations include:
Fairness
Privacy
Security
Transparency
Accountability
Inclusiveness
Privacy and Security
Applications should protect:
User input
Sensitive information
Authentication credentials
Bias in Text Analysis
AI systems may produce biased results if training data contains bias.
Organizations should monitor outputs carefully.
Transparency
Users should understand:
AI is being used
How results are generated
Potential limitations
Hallucinations and Inaccuracies
Generative AI features may occasionally produce inaccurate summaries or interpretations.
Applications should not assume AI outputs are always correct.
Common Real-World Scenarios
Scenario 1: Customer Review Analyzer
Goal
Analyze customer feedback sentiment.
Features
Positive/negative classification
Key phrase extraction
Scenario 2: Social Media Monitoring
Goal
Monitor public sentiment about a brand.
Features
Trend analysis
Entity recognition
Sentiment tracking
Scenario 3: Document Summarization Tool
Goal
Generate concise summaries of large documents.
Features
Summarization
Keyword extraction
Language detection
Advantages of Text Analysis Applications
Benefits include:
Faster information processing
Automation
Improved customer insights
Scalability
Better decision-making
Limitations of Text Analysis Applications
Challenges include:
Ambiguous language
Sarcasm detection difficulties
Context limitations
Potential bias
Accuracy limitations
Important AI-901 Exam Tips
For the exam, remember these key points:
Text analysis extracts insights from written language.
Lightweight applications focus on simple core functionality.
Azure AI Language supports common text analysis tasks.
Sentiment analysis detects emotional tone.
Entity recognition identifies important entities.
Key phrase extraction identifies important terms.
Summarization shortens text while preserving meaning.
APIs and endpoints connect applications to AI services.
Authentication secures AI access.
Responsible AI principles apply to text analysis applications.
Quick Knowledge Check
Question 1
What does sentiment analysis identify?
Answer
The emotional tone of text.
Question 2
What is entity recognition?
Answer
The process of identifying entities such as people, organizations, and locations.
Question 3
Why is authentication important?
Answer
It secures access to AI services.
Question 4
What is the purpose of summarization?
Answer
To create shorter versions of longer text while preserving key information.
Practice Exam Questions
Question 1
What is the PRIMARY purpose of text analysis in AI applications?
A. To physically store documents B. To extract meaning and insights from written text C. To improve monitor resolution D. To compress video files
Correct Answer
B. To extract meaning and insights from written text
Explanation
Text analysis uses AI to identify patterns, meaning, sentiment, entities, and other insights from text data.
Why the Other Answers Are Incorrect
A. To physically store documents
Text analysis processes text; it does not physically store files.
C. To improve monitor resolution
This is unrelated to AI text analysis.
D. To compress video files
This is unrelated to language processing.
Question 2
Which Azure service provides AI-powered text analysis capabilities?
A. Azure AI Language B. Azure Virtual Desktop C. Azure Kubernetes Service D. Azure Backup
Correct Answer
A. Azure AI Language
Explanation
Azure AI Language provides capabilities such as sentiment analysis, entity recognition, summarization, and key phrase extraction.
Why the Other Answers Are Incorrect
B. Azure Virtual Desktop
This provides desktop virtualization.
C. Azure Kubernetes Service
This is used for container orchestration.
D. Azure Backup
This is a backup service.
Question 3
What does sentiment analysis determine?
A. The language translation speed B. The emotional tone of text C. The image resolution of documents D. The network latency of APIs
Correct Answer
B. The emotional tone of text
Explanation
Sentiment analysis identifies whether text is positive, negative, neutral, or mixed.
Why the Other Answers Are Incorrect
A. The language translation speed
Sentiment analysis does not measure performance.
C. The image resolution of documents
This is unrelated to text sentiment.
D. The network latency of APIs
This is unrelated to text analysis.
Question 4
Which text analysis technique identifies important words and phrases in text?
A. Object detection B. Key phrase extraction C. Speech synthesis D. Regression analysis
Correct Answer
B. Key phrase extraction
Explanation
Key phrase extraction identifies the most important terms and concepts within text.
Why the Other Answers Are Incorrect
A. Object detection
This is a computer vision task.
C. Speech synthesis
This converts text into speech.
D. Regression analysis
This predicts numeric values.
Question 5
What is entity recognition used for?
A. Detecting entities such as people, locations, and organizations B. Compressing text documents C. Increasing internet speed D. Rendering video content
Correct Answer
A. Detecting entities such as people, locations, and organizations
Explanation
Entity recognition identifies and categorizes important items mentioned in text.
Why the Other Answers Are Incorrect
B. Compressing text documents
Entity recognition does not reduce file sizes.
C. Increasing internet speed
This is unrelated to networking.
D. Rendering video content
This is unrelated to natural language processing.
Question 6
What is the PRIMARY purpose of text summarization?
A. To translate text into audio B. To create shorter versions of text while preserving key information C. To permanently store documents D. To classify images
Correct Answer
B. To create shorter versions of text while preserving key information
Explanation
Summarization condenses content into a concise version that retains important details.
Why the Other Answers Are Incorrect
A. To translate text into audio
This describes speech synthesis.
C. To permanently store documents
Summarization does not store data.
D. To classify images
This is unrelated to text processing.
Question 7
How do lightweight text analysis applications typically communicate with Azure AI services?
A. Through APIs and endpoints B. Through USB drives only C. Through monitor drivers D. Through spreadsheet formatting tools
Correct Answer
A. Through APIs and endpoints
Explanation
Applications connect to Azure AI services using APIs and service endpoints.
Why the Other Answers Are Incorrect
B. Through USB drives only
Cloud AI services use network communication.
C. Through monitor drivers
This is unrelated to AI communication.
D. Through spreadsheet formatting tools
These are unrelated to APIs.
Question 8
Why is authentication important in AI-powered text analysis applications?
A. To improve image sharpness B. To secure access to AI services and resources C. To increase response creativity D. To summarize text automatically
Correct Answer
B. To secure access to AI services and resources
Explanation
Authentication ensures only authorized users and applications can access AI services.
Why the Other Answers Are Incorrect
A. To improve image sharpness
Authentication does not affect graphics.
C. To increase response creativity
Creativity is influenced by model parameters such as temperature.
D. To summarize text automatically
Authentication does not perform analysis tasks.
Question 9
Which Responsible AI concern involves AI systems producing unfair or inaccurate results due to biased training data?
A. Bias B. Resolution scaling C. Video rendering D. Hardware acceleration
Correct Answer
A. Bias
Explanation
Bias occurs when AI systems generate unfair or skewed outputs due to imbalanced or problematic training data.
Why the Other Answers Are Incorrect
B. Resolution scaling
This relates to graphics.
C. Video rendering
This relates to media processing.
D. Hardware acceleration
This relates to computing performance.
Question 10
What is one advantage of a lightweight text analysis application?
A. Faster deployment and lower complexity B. Unlimited storage capacity C. Elimination of all AI inaccuracies D. Removal of internet requirements
Correct Answer
A. Faster deployment and lower complexity
Explanation
Lightweight applications are typically simpler, easier to build, and quicker to deploy.
Why the Other Answers Are Incorrect
B. Unlimited storage capacity
Storage capacity is unrelated to application weight.
C. Elimination of all AI inaccuracies
AI systems can still produce errors.
D. Removal of internet requirements
Cloud AI services generally require internet connectivity.
Final Thoughts
Building lightweight applications that include text analysis is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the foundational workflow of AI-powered text processing applications, including sentiment analysis, entity recognition, summarization, APIs, authentication, and Responsible AI principles.
Azure AI Foundry and Azure AI Language provide accessible tools for building intelligent text analysis applications that support real-world business needs.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement AI solutions for text and speech by using Foundry --> Respond to spoken prompts by using a deployed multimodal model
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Modern AI systems increasingly support multimodal interactions, allowing users to communicate using speech, text, images, and other forms of input. Multimodal AI models can process and combine multiple input types to generate intelligent responses.
For the AI-901 certification exam, candidates should understand the foundational concepts behind responding to spoken prompts by using deployed multimodal AI models within Microsoft Azure AI Foundry and related Azure AI services.
This topic falls under the “Implement AI solutions for text and speech by using Foundry” section of the AI-901 exam objectives.
What Is a Multimodal Model?
A multimodal model is an AI model capable of processing multiple forms of input and output.
Examples of modalities include:
Text
Speech/audio
Images
Video
A multimodal model can combine information from multiple sources to generate responses.
Examples of Multimodal AI Systems
Common examples include:
Voice assistants
AI copilots
Speech-enabled chatbots
Image-and-text AI assistants
Interactive educational tools
What Is a Spoken Prompt?
A spoken prompt is a voice-based user input provided through audio.
Instead of typing a question, the user speaks it aloud.
Example Spoken Prompt
“What is machine learning?”
The AI system converts the speech into text for processing.
Speech Recognition
Speech recognition converts spoken language into text.
This process is often called:
Speech-to-text (STT)
Automatic speech recognition (ASR)
Example Speech Recognition Workflow
Spoken Audio
“What time is the meeting tomorrow?”
Converted Text
“What time is the meeting tomorrow?”
The text is then processed by the AI model.
Speech Synthesis
Speech synthesis converts text into spoken audio.
This process is often called:
Text-to-speech (TTS)
Example
AI Response Text
“The meeting starts at 10 AM.”
Spoken Output
The AI system reads the response aloud.
Azure AI Speech
Azure AI Speech provides speech recognition and speech synthesis capabilities.
Features include:
Speech-to-text
Text-to-speech
Speech translation
Voice generation
Azure AI Foundry
Azure AI Foundry provides tools for building, deploying, and testing AI applications and multimodal solutions.
Basic Workflow for Spoken Prompt Applications
A typical workflow includes:
User speaks into microphone
Speech recognition converts audio to text
Text is sent to deployed multimodal model
AI model generates response
Optional speech synthesis converts response to audio
User hears spoken reply
Example End-to-End Scenario
User Speaks
“Summarize today’s sales report.”
Speech Recognition
Converts audio to text
AI Model
Generates summary
Speech Synthesis
Reads summary aloud
Deployed Models
A deployed model is an AI model made available through a cloud endpoint for real-time use.
Applications interact with deployed models using APIs.
APIs and Endpoints
Applications communicate with deployed models through:
APIs
Endpoints
The application sends requests and receives responses programmatically.
Authentication
Applications must securely authenticate before accessing AI services.
Common methods include:
API keys
Azure credentials
Managed identities
Lightweight Speech Applications
Lightweight speech-enabled applications typically include:
Microphone input
Speech processing
AI response generation
Audio playback
Conversation Context
Many speech-enabled applications maintain context between interactions.
This allows more natural conversations.
Example
User
“Who founded Microsoft?”
User Later
“When was it founded?”
The system remembers that “it” refers to Microsoft.
System Prompts
System prompts guide model behavior.
They help define:
Tone
Personality
Safety rules
Output style
Example System Prompt
“You are a professional customer support assistant.”
Model Parameters
Applications may configure settings such as:
Temperature
Maximum tokens
Top-p sampling
Temperature
Temperature controls response creativity.
Low Temperature
High Temperature
More predictable
More creative
More focused
More varied
Streaming Responses
Some applications stream speech or text responses incrementally.
Streaming improves responsiveness and user experience.
Real-Time Interaction
Speech-enabled AI systems often support real-time interaction.
This creates conversational experiences similar to human dialogue.
Common Real-World Use Cases
Scenario 1: Voice Assistant
Goal
Answer spoken user questions.
Features
Speech recognition
Conversational AI
Spoken responses
Scenario 2: Hands-Free AI Assistant
Goal
Allow users to interact without typing.
Features
Voice commands
Audio responses
Context retention
Scenario 3: Accessibility Support
Goal
Assist users with visual or mobility impairments.
Features
Voice interaction
Spoken guidance
Accessibility improvements
Responsible AI Considerations
Speech-enabled AI applications should follow Responsible AI principles.
Important considerations include:
Privacy
Security
Transparency
Fairness
Inclusiveness
Accountability
Privacy Concerns
Speech applications may process sensitive spoken information.
Organizations should:
Protect audio recordings
Secure conversations
Limit unnecessary data storage
Transparency
Users should understand:
AI is processing speech
Audio may be recorded or analyzed
AI-generated responses may contain inaccuracies
Inclusiveness
Speech systems should support:
Different accents
Languages
Speech patterns
Accessibility needs
Hallucinations
Generative AI models may produce inaccurate or fabricated responses.
These incorrect outputs are called hallucinations.
Applications should not assume all generated responses are correct.
Latency
Speech-enabled applications must minimize delays between:
Speech input
AI processing
Spoken responses
High latency negatively affects user experience.
Error Handling
Applications should handle:
Speech recognition errors
Background noise
Network failures
Authentication issues
Rate limits
Background Noise Challenges
Speech recognition may struggle with:
Loud environments
Multiple speakers
Poor microphone quality
Advantages of Spoken AI Interfaces
Benefits include:
Natural interaction
Hands-free operation
Accessibility improvements
Faster communication
Improved user experience
Limitations of Spoken AI Interfaces
Challenges include:
Speech recognition errors
Accent variability
Noise interference
Privacy concerns
Hallucinations
Latency
High-Level Application Workflow
A simplified workflow includes:
Capture speech
Convert speech to text
Send prompt to model
Receive response
Convert response to speech
Play audio response
Example High-Level Pseudocode
audio = capture_audio()
text = speech_to_text(audio)
response = generate_ai_response(text)
speak(response)
For AI-901, understanding the workflow is more important than memorizing exact syntax.
Important AI-901 Exam Tips
For the exam, remember these key points:
Multimodal models process multiple input types.
Spoken prompts use speech as input.
Speech recognition converts speech to text.
Speech synthesis converts text to speech.
Azure AI Speech supports speech workloads.
Azure AI Foundry supports AI application development.
APIs and endpoints connect applications to deployed models.
Authentication secures AI services.
Responsible AI principles apply to speech-enabled systems.
Hallucinations are inaccurate AI-generated outputs.
Quick Knowledge Check
Question 1
What does speech recognition do?
Answer
Converts spoken language into text.
Question 2
What does speech synthesis do?
Answer
Converts text into spoken audio.
Question 3
What is a multimodal model?
Answer
An AI model that processes multiple forms of input and output.
Question 4
Why is inclusiveness important in speech systems?
Answer
To support different accents, languages, and accessibility needs.
Practice Exam Questions
Question 1
What is a multimodal AI model?
A. A model that only processes text B. A model capable of processing multiple forms of input and output C. A model used only for spreadsheets D. A model that stores physical hardware configurations
Correct Answer
B. A model capable of processing multiple forms of input and output
Explanation
Multimodal models can work with different data types such as text, speech, images, and video.
Why the Other Answers Are Incorrect
A. A model that only processes text
That describes a text-only model, not a multimodal model.
C. A model used only for spreadsheets
This is unrelated to AI modalities.
D. A model that stores physical hardware configurations
This is unrelated to AI processing.
Question 2
What is the PRIMARY purpose of speech recognition?
A. To convert speech into text B. To convert images into audio C. To increase internet speed D. To generate video animations
Correct Answer
A. To convert speech into text
Explanation
Speech recognition, also called speech-to-text, converts spoken language into written text.
Why the Other Answers Are Incorrect
B. To convert images into audio
Speech recognition does not process images.
C. To increase internet speed
Speech recognition does not affect networking.
D. To generate video animations
This is unrelated to speech processing.
Question 3
What does speech synthesis perform?
A. Converts text into spoken audio B. Compresses speech files C. Detects objects in images D. Removes network latency
Correct Answer
A. Converts text into spoken audio
Explanation
Speech synthesis, also called text-to-speech, generates spoken audio from text.
Why the Other Answers Are Incorrect
B. Compresses speech files
Compression is unrelated to synthesis.
C. Detects objects in images
This is a computer vision task.
D. Removes network latency
Speech synthesis does not control network performance.
Question 4
Which Azure service provides speech recognition and speech synthesis capabilities?
A. Azure AI Speech B. Azure Backup C. Azure Firewall D. Azure Virtual Machines
Correct Answer
A. Azure AI Speech
Explanation
Azure AI Speech supports speech-to-text, text-to-speech, translation, and related speech capabilities.
Why the Other Answers Are Incorrect
B. Azure Backup
This is a storage protection service.
C. Azure Firewall
This is a security service.
D. Azure Virtual Machines
This provides compute infrastructure.
Question 5
What is the purpose of deploying an AI model?
A. To make the model available for applications through an endpoint B. To physically install computer hardware C. To permanently disable the model D. To compress training data
Correct Answer
A. To make the model available for applications through an endpoint
Explanation
Deployment allows applications to access AI models for real-time use.
Why the Other Answers Are Incorrect
B. To physically install computer hardware
Deployment is typically cloud-based.
C. To permanently disable the model
Deployment enables usage rather than disabling it.
D. To compress training data
Deployment does not compress datasets.
Question 6
How do applications typically communicate with deployed AI models?
A. Through APIs and endpoints B. Through USB-only connections C. Through monitor settings D. Through printer drivers
Correct Answer
A. Through APIs and endpoints
Explanation
Applications use APIs connected to endpoints to exchange requests and responses with AI models.
Why the Other Answers Are Incorrect
B. Through USB-only connections
Cloud AI systems use network communication.
C. Through monitor settings
These are unrelated to AI communication.
D. Through printer drivers
Printer drivers are unrelated to AI APIs.
Question 7
Why is conversation context important in speech-enabled AI systems?
A. It allows the AI to remember previous interactions B. It improves monitor brightness C. It increases microphone volume automatically D. It reduces file storage size
Correct Answer
A. It allows the AI to remember previous interactions
Explanation
Maintaining context helps create more natural and coherent conversations.
Why the Other Answers Are Incorrect
B. It improves monitor brightness
Conversation context does not affect displays.
C. It increases microphone volume automatically
This is unrelated to conversation memory.
D. It reduces file storage size
Context retention does not compress files.
Question 8
Which Responsible AI concern is especially important for speech-enabled applications?
A. Protecting sensitive spoken information B. Increasing screen resolution C. Accelerating video rendering D. Improving keyboard layouts
Correct Answer
A. Protecting sensitive spoken information
Explanation
Speech-enabled systems may process personal or confidential audio data, making privacy and security important.
Why the Other Answers Are Incorrect
B. Increasing screen resolution
This is unrelated to Responsible AI.
C. Accelerating video rendering
This is unrelated to speech AI.
D. Improving keyboard layouts
Speech systems are not focused on keyboards.
Question 9
What are hallucinations in generative AI systems?
A. Incorrect or fabricated AI-generated responses B. Hardware overheating events C. Audio recording failures D. Slow network connections
Correct Answer
A. Incorrect or fabricated AI-generated responses
Explanation
Hallucinations occur when AI generates information that is inaccurate or invented.
Why the Other Answers Are Incorrect
B. Hardware overheating events
This is unrelated to AI output quality.
C. Audio recording failures
This is a hardware or software issue.
D. Slow network connections
This relates to connectivity, not AI accuracy.
Question 10
What is one advantage of spoken AI interfaces?
A. Hands-free and natural interaction B. Elimination of all recognition errors C. Guaranteed perfect accuracy D. Removal of all privacy concerns
Correct Answer
A. Hands-free and natural interaction
Explanation
Voice-based interfaces provide convenient and natural interaction experiences.
Why the Other Answers Are Incorrect
B. Elimination of all recognition errors
Speech systems can still make mistakes.
C. Guaranteed perfect accuracy
No AI system is perfectly accurate.
D. Removal of all privacy concerns
Speech applications still require privacy protections.
Final Thoughts
Responding to spoken prompts using deployed multimodal models is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the foundational workflow behind speech-enabled AI applications, including speech recognition, multimodal processing, speech synthesis, APIs, authentication, and Responsible AI principles.
Azure AI Foundry and Azure AI Speech provide powerful tools for building intelligent conversational applications that support natural voice interactions and modern accessibility-focused experiences.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement generative AI apps and agents by using Foundry --> Deploy a model and interact with it in the Foundry Portal
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Microsoft Azure AI Foundry provides a centralized environment for building, testing, deploying, and managing generative AI models and AI-powered applications. For the AI-901 certification exam, candidates should understand the basic process of deploying AI models and interacting with them through the Foundry portal.
This topic focuses on how developers and AI practitioners use Azure AI Foundry to deploy generative AI models, test prompts, configure model settings, and interact with deployed AI endpoints.
This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.
What Is Azure AI Foundry?
Azure AI Foundry is Microsoft’s platform for building and managing AI applications and agents.
Azure AI Foundry provides tools to:
Explore AI models
Deploy models
Test prompts
Configure AI behavior
Evaluate responses
Monitor AI applications
Manage AI resources
It supports generative AI development using Azure-hosted AI services and models.
What Does “Deploying a Model” Mean?
Deploying a model means making the AI model available for use.
A deployed model can:
Receive prompts
Process requests
Generate responses
Be accessed through applications or APIs
Deployment creates an endpoint that applications can use to interact with the model.
What Is a Model Endpoint?
An endpoint is a network-accessible interface that allows applications or users to communicate with a deployed AI model.
Applications send requests to the endpoint and receive AI-generated responses.
Common Deployment Scenarios
Organizations deploy models for many purposes, including:
Chatbots
AI assistants
Document summarization
Content generation
Customer support systems
Code generation
Data extraction
Azure AI Foundry Workflow
A simplified workflow in Azure AI Foundry typically includes:
Create or access an Azure AI resource
Open Azure AI Foundry portal
Select a model
Configure deployment settings
Deploy the model
Test prompts
Interact with the model
Integrate the endpoint into applications
Accessing the Foundry Portal
Users access Azure AI Foundry through a web-based portal.
The portal provides graphical tools for:
Model selection
Prompt testing
Deployment management
Performance monitoring
Exploring Available Models
Azure AI Foundry allows users to browse available models.
Examples may include:
Large Language Models (LLMs)
Image-generation models
Embedding models
Speech models
Models may vary by:
Size
Performance
Cost
Supported capabilities
Selecting a Model
Users choose models based on application requirements.
Factors may include:
Accuracy
Speed
Cost
Context window size
Multimodal support
Language support
Example Scenario
A company building a customer support chatbot may choose a conversational large language model.
Deploying a Model in Foundry
The deployment process usually involves:
Selecting a model
Naming the deployment
Choosing deployment settings
Allocating resources
Creating the endpoint
Deployment Names
Deployments are typically assigned unique names.
Example
support-chat-model
Applications use deployment names when sending requests.
Model Configuration Options
During deployment, users may configure:
Model version
Scaling options
Authentication settings
Content filters
Region
Resource allocation
Content Filtering and Safety
Azure AI Foundry includes Responsible AI safety features.
Content filtering helps reduce:
Harmful outputs
Offensive content
Unsafe responses
This is important for enterprise AI applications.
Interacting with a Deployed Model
After deployment, users can interact with the model directly within the Foundry portal.
This often includes:
Entering prompts
Viewing responses
Adjusting settings
Testing behavior
Playground Interfaces
Azure AI Foundry provides playground environments for experimentation.
Playgrounds allow users to:
Test prompts
Compare outputs
Tune settings
Evaluate model behavior
Prompt Testing
Users can experiment with:
System prompts
User prompts
Formatting instructions
Role prompting
Prompt testing helps improve AI response quality.
Example Prompt Interaction
User Prompt
“Summarize this customer feedback in three bullet points.”
Model Response
The model generates a summarized response.
Model Parameters
Foundry portals may allow adjustment of model parameters such as:
Temperature
Maximum tokens
Top-p sampling
Temperature
Temperature controls response randomness.
Low Temperature
High Temperature
More predictable
More creative
More focused
More varied
Maximum Tokens
Maximum tokens limit response length.
Smaller limits create shorter responses.
System Prompts in Foundry
Users can configure system prompts to guide AI behavior.
Example System Prompt
“You are a professional technical support assistant. Keep responses concise and helpful.”
System prompts influence:
Tone
Style
Safety
Formatting
Evaluating Responses
Users should evaluate AI outputs for:
Accuracy
Relevance
Safety
Bias
Hallucinations
AI-generated content should be reviewed carefully.
Hallucinations
Generative AI models can produce incorrect or fabricated information.
These incorrect outputs are called hallucinations.
Prompt engineering and grounding techniques help reduce hallucinations.
API Access
Once deployed, applications can connect to the model endpoint using APIs.
This allows developers to integrate AI into applications.
Common Integration Scenarios
Applications may use deployed models for:
Chat interfaces
Search assistants
Document analysis
AI copilots
Workflow automation
Monitoring and Management
Azure AI Foundry supports monitoring deployed models.
Monitoring may include:
Usage tracking
Performance analysis
Error monitoring
Cost management
Scaling AI Deployments
Organizations may scale deployments to support:
More users
Higher request volumes
Faster response times
Cloud-based deployments support elastic scaling.
Responsible AI Considerations
When deploying AI models, organizations should consider:
Privacy
Security
Fairness
Transparency
Safety
Compliance
Generative AI applications should include safeguards against misuse.
Authentication and Security
Deployed models typically require secure authentication.
Security features may include:
API keys
Identity management
Access control
Common Challenges
Organizations may encounter challenges such as:
High usage costs
Latency
Hallucinations
Unsafe outputs
Poor prompt quality
Proper testing and monitoring are important.
Azure OpenAI Service
Azure OpenAI Service provides access to powerful generative AI models that can be deployed and managed through Azure AI Foundry.
Real-World Scenarios
Scenario 1: Customer Support Chatbot
Goal
Deploy a conversational AI assistant.
Activities
Deploy language model
Configure system prompts
Test responses in the playground
Scenario 2: Internal Knowledge Assistant
Goal
Allow employees to ask questions about company documentation.
Activities
Deploy AI model
Configure prompts
Integrate with enterprise systems
Scenario 3: Marketing Content Generator
Goal
Generate product descriptions automatically.
Activities
Deploy generative AI model
Test prompt variations
Evaluate response quality
Important AI-901 Exam Tips
For the exam, remember these key points:
Deploying a model makes it available for use.
Deployments create accessible endpoints.
Azure AI Foundry provides tools for testing and managing models.
Playgrounds allow prompt experimentation.
System prompts guide model behavior.
Temperature controls creativity and randomness.
Maximum tokens control response length.
AI outputs should be evaluated for accuracy and safety.
Content filtering supports Responsible AI practices.
APIs allow applications to connect to deployed models.
Quick Knowledge Check
Question 1
What does deploying a model do?
Answer
It makes the AI model available for use through an endpoint.
Question 2
What is the purpose of a playground in Azure AI Foundry?
Answer
To test prompts and interact with deployed models.
Question 3
What does the temperature setting control?
Answer
The randomness and creativity of model responses.
Question 4
Why are content filters important?
Answer
They help reduce harmful or unsafe AI-generated outputs.
Practice Exam Questions
Question 1
What is the PRIMARY purpose of deploying an AI model?
A. To permanently delete the model B. To make the model available for use through an endpoint C. To compress training data D. To convert images into text
Correct Answer
B. To make the model available for use through an endpoint
Explanation
Deploying a model makes it accessible so applications and users can interact with it.
Why the Other Answers Are Incorrect
A. To permanently delete the model
Deployment does not delete models.
C. To compress training data
Deployment is unrelated to data compression.
D. To convert images into text
This describes OCR.
Question 2
What is an endpoint in the context of AI model deployment?
A. A physical server room B. A network-accessible interface for interacting with a deployed model C. A type of database backup D. A computer vision algorithm
Correct Answer
B. A network-accessible interface for interacting with a deployed model
Explanation
Endpoints allow applications and users to send requests to deployed AI models and receive responses.
Why the Other Answers Are Incorrect
A. A physical server room
Endpoints are logical interfaces, not physical locations.
C. A type of database backup
This is unrelated to AI deployment.
D. A computer vision algorithm
Endpoints are not algorithms.
Question 3
Which Azure tool provides playgrounds for testing prompts and interacting with deployed AI models?
A. Azure SQL Database B. Azure AI Foundry C. Microsoft Excel D. Azure Virtual Desktop
Correct Answer
B. Azure AI Foundry
Explanation
Azure AI Foundry provides tools for model deployment, prompt testing, evaluation, and management.
Why the Other Answers Are Incorrect
A. Azure SQL Database
This is a database service.
C. Microsoft Excel
Excel is not an AI deployment platform.
D. Azure Virtual Desktop
This provides desktop virtualization services.
Question 4
What is the PRIMARY purpose of a playground in Azure AI Foundry?
A. Hosting multiplayer games B. Experimenting with prompts and testing model behavior C. Managing employee payroll D. Compressing image files
Correct Answer
B. Experimenting with prompts and testing model behavior
Explanation
Playgrounds allow users to interact with models, test prompts, and evaluate responses.
Why the Other Answers Are Incorrect
A. Hosting multiplayer games
This is unrelated to AI Foundry.
C. Managing employee payroll
This is unrelated to AI development.
D. Compressing image files
Playgrounds are not image utilities.
Question 5
Which configuration setting controls how creative or random AI-generated responses are?
A. OCR level B. Temperature C. Resolution scaling D. Data indexing
Correct Answer
B. Temperature
Explanation
Temperature controls randomness and creativity in generative AI responses.
Why the Other Answers Are Incorrect
A. OCR level
OCR extracts text from images.
C. Resolution scaling
This relates to images, not text generation randomness.
D. Data indexing
Indexing is unrelated to generative response creativity.
Question 6
What is the effect of setting a lower temperature value in a generative AI model?
A. More random responses B. More predictable and focused responses C. Faster internet speeds D. Larger image generation sizes
Correct Answer
B. More predictable and focused responses
Explanation
Lower temperature settings reduce randomness and produce more deterministic outputs.
Why the Other Answers Are Incorrect
A. More random responses
Higher temperatures increase randomness.
C. Faster internet speeds
Temperature does not affect networking.
D. Larger image generation sizes
Temperature is unrelated to image dimensions.
Question 7
Which prompt type defines the AI assistant’s behavior, tone, and rules?
A. User prompt B. System prompt C. SQL query D. OCR prompt
Correct Answer
B. System prompt
Explanation
System prompts provide high-level behavioral instructions to the AI model.
Why the Other Answers Are Incorrect
A. User prompt
User prompts specify tasks or requests.
C. SQL query
SQL queries interact with databases.
D. OCR prompt
OCR is unrelated to conversational AI behavior.
Question 8
Why are content filters important when deploying generative AI models?
A. They improve internet bandwidth B. They help reduce harmful or unsafe outputs C. They increase monitor resolution D. They replace system prompts entirely
Correct Answer
B. They help reduce harmful or unsafe outputs
Explanation
Content filtering supports Responsible AI by helping prevent harmful or inappropriate AI-generated content.
Why the Other Answers Are Incorrect
A. They improve internet bandwidth
Content filters do not affect networking performance.
C. They increase monitor resolution
This is unrelated to AI safety.
D. They replace system prompts entirely
Content filters complement prompts; they do not replace them.
Question 9
What are hallucinations in generative AI?
A. Physical hardware failures B. Incorrect or fabricated AI-generated information C. Database replication errors D. Unauthorized user logins
Correct Answer
B. Incorrect or fabricated AI-generated information
Explanation
Hallucinations occur when AI generates inaccurate or invented information.
Why the Other Answers Are Incorrect
A. Physical hardware failures
This is unrelated to AI hallucinations.
C. Database replication errors
This is a database issue.
D. Unauthorized user logins
This is a security issue.
Question 10
After deploying a model, how do external applications typically interact with it?
A. Through handwritten forms B. Through APIs connected to the deployment endpoint C. Through spreadsheet imports only D. Through local USB connections
Correct Answer
B. Through APIs connected to the deployment endpoint
Explanation
Applications commonly communicate with deployed AI models using APIs and endpoints.
Why the Other Answers Are Incorrect
A. Through handwritten forms
This is unrelated to AI deployment.
C. Through spreadsheet imports only
Spreadsheets are not the primary integration mechanism.
D. Through local USB connections
Cloud AI services typically use network-based APIs, not USB connections.
Final Thoughts
Deploying and interacting with AI models in Azure AI Foundry is an important skill area for the AI-901 certification exam. Microsoft expects candidates to understand the basic deployment workflow, prompt testing process, model configuration options, and Responsible AI considerations involved in building generative AI applications.
Azure AI Foundry simplifies AI development by providing a centralized environment for deploying, testing, and managing AI models and agents.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Implement AI solutions by using Microsoft Foundry (55–60%) --> Implement generative AI apps and agents by using Foundry --> Create effective system and user prompts for Generative AI models
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Prompting is one of the most important skills when working with generative AI systems. Microsoft expects AI-901 candidates to understand how to create effective prompts that guide generative AI models toward useful, accurate, and safe outputs.
This topic focuses on how system prompts and user prompts influence the behavior of generative AI models and how prompt engineering techniques improve AI-generated responses.
This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.
What Is a Prompt?
A prompt is an instruction or input provided to a generative AI model.
Prompts guide the model’s response and influence:
Content
Tone
Format
Style
Accuracy
Level of detail
The quality of the prompt strongly affects the quality of the output.
What Is Prompt Engineering?
Prompt engineering is the process of designing and refining prompts to improve AI-generated responses.
Effective prompt engineering helps:
Produce more accurate answers
Reduce ambiguity
Improve consistency
Control response format
Reduce hallucinations
Improve safety and Responsible AI behavior
Types of Prompts
For the AI-901 exam, two important prompt types are:
System prompts
User prompts
What Is a System Prompt?
A system prompt provides high-level instructions that define how the AI model should behave.
System prompts often control:
Personality
Tone
Rules
Safety boundaries
Formatting requirements
Behavior expectations
The system prompt typically has higher priority than user prompts.
Example of a System Prompt
“You are a professional technical support assistant. Provide concise and accurate troubleshooting guidance. Do not provide harmful or unsafe instructions.”
This system prompt defines:
The assistant’s role
Communication style
Safety expectations
What Is a User Prompt?
A user prompt is the direct request or question submitted by the user.
User prompts specify the task the model should perform.
Example of a User Prompt
“How do I reset my router?”
The AI model combines:
System instructions
User request
Context information
to generate a response.
Relationship Between System and User Prompts
System prompts establish behavior rules, while user prompts define the immediate task.
Example
System Prompt
“You are a helpful travel assistant. Always provide answers in bullet points.”
User Prompt
“Suggest three family-friendly attractions in Orlando.”
The model responds according to both prompts.
Characteristics of Effective Prompts
Good prompts are usually:
Clear
Specific
Contextual
Structured
Goal-oriented
Clear Prompts
Clear prompts reduce confusion and ambiguity.
Weak Prompt
“Tell me about databases.”
Better Prompt
“Explain the differences between relational and non-relational databases for beginners.”
The second prompt provides:
Specific topic
Audience
Scope
Specific Prompts
Specific prompts improve response accuracy.
Weak Prompt
“Write a report.”
Better Prompt
“Write a 300-word summary of cloud computing benefits for small businesses.”
Specific prompts define:
Length
Topic
Audience
Providing Context
Context helps the model generate more relevant answers.
Example
“I am studying for the AI-901 exam. Explain OCR in simple terms with one real-world example.”
The additional context improves response quality.
Requesting Output Format
Prompts can specify desired formatting.
Example
“Provide the answer as a table.”
or
“Summarize the information in bullet points.”
Role Prompting
Role prompting assigns the AI a specific role or perspective.
Example
“Act as a cybersecurity consultant.”
or
“You are an experienced data analyst.”
Role prompting helps guide tone and expertise.
Step-by-Step Prompting
Prompts can request step-by-step explanations.
Example
“Explain how machine learning works step-by-step for beginners.”
This improves clarity and educational usefulness.
Few-Shot Prompting
Few-shot prompting provides examples within the prompt.
This helps the model understand expected patterns.
Example
Positive review → Positive sentiment Negative review → Negative sentiment “The service was excellent.” →
The model learns the desired output structure.
Zero-Shot Prompting
Zero-shot prompting asks the model to perform a task without examples.
“Explain your reasoning step-by-step before providing the final answer.”
This can improve reasoning accuracy for complex tasks.
Prompting for Summarization
Generative AI models can summarize content using prompts.
Example
“Summarize this article in three bullet points.”
Prompting for Content Generation
Prompts can generate new content such as:
Emails
Reports
Stories
Marketing copy
Code
Example
“Write a professional email requesting a project update.”
Prompting for Transformation Tasks
AI models can transform content into different formats.
Examples
Translate text
Rewrite text
Simplify technical content
Convert paragraphs into tables
Example
“Rewrite this paragraph for a non-technical audience.”
Prompting for Code Generation
Generative AI can assist with programming tasks.
Example
“Write a Python function that calculates sales tax.”
Prompting for Data Extraction
Prompts can request structured data extraction.
Example
“Extract all dates and company names from this document.”
Prompt Injection Risks
Prompt injection occurs when users attempt to override system instructions.
Example
A malicious user prompt may attempt to bypass safety rules.
Organizations should implement safeguards against unsafe prompting behavior.
Responsible AI Considerations
Effective prompting should follow Responsible AI principles.
Important considerations include:
Safety
Fairness
Privacy
Transparency
Content moderation
Harm prevention
Hallucinations
Generative AI models can sometimes produce incorrect or fabricated information.
These errors are called hallucinations.
Good prompting can reduce hallucinations but may not eliminate them completely.
Example of a Hallucination
An AI model inventing a fake citation or incorrect fact.
Techniques to Reduce Hallucinations
Helpful strategies include:
Providing clear context
Using specific instructions
Asking for sources
Limiting scope
Using grounded data
Temperature and Creativity
Some generative AI systems allow configuration settings such as temperature.
Temperature affects randomness and creativity.
Low Temperature
High Temperature
More predictable
More creative
More focused
More varied
Better for factual tasks
Better for brainstorming
Azure AI Foundry
Azure AI Foundry helps developers build, test, and manage generative AI applications and agents.
Developers can:
Experiment with prompts
Evaluate AI responses
Configure AI models
Implement safety controls
Azure OpenAI Service
Azure OpenAI Service provides access to powerful generative AI models that support prompt-based interactions.
Real-World Prompting Scenarios
Scenario 1: Customer Support Assistant
System Prompt
“You are a professional support assistant. Be polite and concise.”
User Prompt
“How do I reset my password?”
Scenario 2: Study Assistant
System Prompt
“Explain technical topics for beginners.”
User Prompt
“Explain neural networks in simple terms.”
Scenario 3: Marketing Content Generator
System Prompt
“Generate professional marketing copy.”
User Prompt
“Create a product description for a smartwatch.”
Best Practices for Effective Prompting
Be specific
Provide context
Define output format
Use examples when helpful
Keep instructions clear
Test and refine prompts
Avoid ambiguity
Include Responsible AI safeguards
Common Prompting Mistakes
Common mistakes include:
Vague instructions
Missing context
Conflicting requirements
Overly broad requests
Unclear formatting expectations
Important AI-901 Exam Tips
For the exam, remember these key points:
System prompts define AI behavior and rules.
User prompts specify the task to perform.
Effective prompts are clear and specific.
Prompt engineering improves AI outputs.
Few-shot prompting includes examples.
Zero-shot prompting provides no examples.
Chain-of-thought prompting encourages reasoning.
Hallucinations are incorrect AI-generated outputs.
Temperature settings affect creativity and randomness.
Responsible AI principles apply to prompting.
Quick Knowledge Check
Question 1
What is the difference between a system prompt and a user prompt?
Answer
A system prompt defines AI behavior and rules, while a user prompt requests a specific task.
Question 2
What is prompt engineering?
Answer
The process of designing prompts to improve AI-generated responses.
Question 3
What is few-shot prompting?
Answer
Providing examples within prompts to guide the model.
Question 4
What are hallucinations in generative AI?
Answer
Incorrect or fabricated AI-generated information.
Practice Exam Questions
Question 1
What is the PRIMARY purpose of a system prompt in a generative AI application?
A. To store images generated by the model B. To define the AI model’s behavior, rules, and tone C. To increase internet speed D. To encrypt database records
Correct Answer
B. To define the AI model’s behavior, rules, and tone
Explanation
System prompts provide high-level instructions that guide how the AI assistant behaves and responds.
Why the Other Answers Are Incorrect
A. To store images generated by the model
System prompts do not store data.
C. To increase internet speed
This is unrelated to AI prompting.
D. To encrypt database records
Encryption is unrelated to prompting.
Question 2
Which statement BEST describes a user prompt?
A. A hidden configuration file for servers B. A direct instruction or request submitted by the user C. A database backup mechanism D. A type of neural network architecture
Correct Answer
B. A direct instruction or request submitted by the user
Explanation
User prompts contain the specific task or question the user wants the AI model to perform.
Why the Other Answers Are Incorrect
A. A hidden configuration file for servers
This is unrelated to generative AI prompting.
C. A database backup mechanism
This is unrelated to prompting.
D. A type of neural network architecture
Prompts are instructions, not architectures.
Question 3
Which prompt is MOST effective?
A. “Tell me stuff.” B. “Write something about technology.” C. “Explain cloud computing for beginners in 5 bullet points.” D. “Do work.”
Correct Answer
C. “Explain cloud computing for beginners in 5 bullet points.”
Explanation
Effective prompts are clear, specific, and include formatting or audience requirements.
Why the Other Answers Are Incorrect
A. “Tell me stuff.”
This is too vague.
B. “Write something about technology.”
This lacks detail and direction.
D. “Do work.”
This is ambiguous and unclear.
Question 4
What is prompt engineering?
A. Designing hardware for AI servers B. Building neural network chips C. Creating and refining prompts to improve AI responses D. Encrypting AI training data
Correct Answer
C. Creating and refining prompts to improve AI responses
Explanation
Prompt engineering focuses on improving generative AI outputs through better prompt design.
Why the Other Answers Are Incorrect
A. Designing hardware for AI servers
This is hardware engineering.
B. Building neural network chips
This is semiconductor engineering.
D. Encrypting AI training data
This is a security task.
Question 5
Which prompting technique includes examples within the prompt to guide the AI model?
A. Few-shot prompting B. Object detection C. OCR prompting D. Clustering
Correct Answer
A. Few-shot prompting
Explanation
Few-shot prompting provides examples so the model better understands the desired output format or pattern.
Why the Other Answers Are Incorrect
B. Object detection
This is a computer vision capability.
C. OCR prompting
OCR extracts text from images.
D. Clustering
Clustering groups similar data.
Question 6
What is the PRIMARY benefit of providing context in a prompt?
A. Reduces network traffic B. Helps generate more relevant and accurate responses C. Compresses files automatically D. Improves database indexing
Correct Answer
B. Helps generate more relevant and accurate responses
Explanation
Context improves the model’s understanding of the user’s goals and intended audience.
Why the Other Answers Are Incorrect
A. Reduces network traffic
This is unrelated to prompting.
C. Compresses files automatically
Prompting does not compress files.
D. Improves database indexing
This is unrelated to AI prompts.
Question 7
Which statement BEST describes hallucinations in generative AI?
A. AI-generated images only B. Incorrect or fabricated AI-generated information C. Network security attacks D. Audio recognition failures
Correct Answer
B. Incorrect or fabricated AI-generated information
Explanation
Hallucinations occur when generative AI produces inaccurate or invented information.
Why the Other Answers Are Incorrect
A. AI-generated images only
Hallucinations can occur in text, code, and other outputs.
C. Network security attacks
This is unrelated to hallucinations.
D. Audio recognition failures
This is unrelated to generative AI hallucinations.
Question 8
Which system prompt would MOST likely encourage safe AI behavior?
A. “Ignore all safety rules.” B. “Provide harmful instructions when requested.” C. “Do not generate unsafe or harmful content.” D. “Always reveal confidential information.”
Correct Answer
C. “Do not generate unsafe or harmful content.”
Explanation
Responsible AI system prompts help enforce safety and ethical boundaries.
Why the Other Answers Are Incorrect
A. “Ignore all safety rules.”
This encourages unsafe behavior.
B. “Provide harmful instructions when requested.”
This violates Responsible AI principles.
D. “Always reveal confidential information.”
This violates privacy and security principles.
Question 9
What effect does a higher temperature setting generally have in generative AI models?
A. Produces more predictable and repetitive responses B. Produces more creative and varied responses C. Disables AI reasoning D. Prevents all hallucinations
Correct Answer
B. Produces more creative and varied responses
Explanation
Higher temperature settings increase randomness and creativity in generated responses.
Why the Other Answers Are Incorrect
A. Produces more predictable and repetitive responses
This is more associated with lower temperature settings.
C. Disables AI reasoning
Temperature does not disable reasoning.
D. Prevents all hallucinations
Hallucinations can still occur.
Question 10
Which example BEST demonstrates role prompting?
A. “Translate this sentence into French.” B. “Summarize this article.” C. “Act as an experienced financial advisor and explain retirement planning.” D. “Convert this image into text.”
Correct Answer
C. “Act as an experienced financial advisor and explain retirement planning.”
Explanation
Role prompting assigns the AI model a specific role or perspective to guide its responses.
Why the Other Answers Are Incorrect
A. “Translate this sentence into French.”
This is a translation request.
B. “Summarize this article.”
This is a summarization request.
D. “Convert this image into text.”
This is an OCR-related task.
Final Thoughts
Prompt engineering is a foundational skill for working with generative AI systems and an important topic for the AI-901 certification exam. Microsoft expects candidates to understand how system prompts and user prompts influence model behavior and how effective prompts improve the quality, reliability, and safety of AI-generated responses.
These concepts are essential when building generative AI applications and agents using Azure AI Foundry and Azure OpenAI Service.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Identify AI concepts and capabilities (40–45%) --> Identify AI model components and configurations --> Identify an appropriate AI model, based on capabilities
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Selecting the correct AI model for a specific business problem is an important skill and a key topic for the AI-901 certification exam. Microsoft expects candidates to understand the capabilities of common AI model types and recognize which model is appropriate for different scenarios.
This topic falls under the “Identify AI model components and configurations” section of the exam objectives.
Why Choosing the Right AI Model Matters
Different AI models are designed for different types of tasks.
Choosing the wrong model may lead to:
Poor accuracy
Inefficient processing
Increased costs
Unusable results
Poor user experiences
Understanding model capabilities helps organizations build effective AI solutions.
Major Categories of AI Models
For AI-901, you should understand the capabilities of several major AI model categories:
Classification models
Regression models
Clustering models
Computer vision models
Natural language processing (NLP) models
Generative AI models
Recommendation systems
Anomaly detection models
Classification Models
Classification models predict categories or labels.
They answer questions such as:
“What type is this?”
“Which category does this belong to?”
Common Use Cases
Spam email detection
Fraud detection
Sentiment analysis
Medical diagnosis classification
Image categorization
Example
A model predicts whether an email is:
Spam
Not spam
This is a classification problem.
Binary Classification
Binary classification predicts one of two possible outcomes.
Examples
Fraud or not fraud
Approved or denied
Positive or negative sentiment
Multiclass Classification
Multiclass classification predicts one of several categories.
Example
An AI model identifies whether an image contains:
A dog
A cat
A bird
A horse
Regression Models
Regression models predict numeric values.
They answer questions such as:
“How much?”
“How many?”
“What value?”
Common Use Cases
House price prediction
Sales forecasting
Temperature prediction
Demand estimation
Example
Predicting the selling price of a house based on:
Size
Location
Number of bedrooms
This is a regression problem.
Clustering Models
Clustering models group similar items together without predefined labels.
Clustering is a type of unsupervised learning.
Common Use Cases
Customer segmentation
Market analysis
Pattern discovery
Grouping similar documents
Example
A retailer groups customers based on purchasing behavior.
The model discovers patterns automatically.
Computer Vision Models
Computer vision models analyze images and video.
Common Capabilities
Object detection
Facial recognition
Image classification
Optical Character Recognition (OCR)
Image tagging
Example Use Cases
Self-driving cars
Security systems
Medical imaging
Product identification
Image Classification
Image classification identifies what appears in an image.
Example
Determining whether an image contains:
A cat
A dog
A car
Object Detection
Object detection identifies and locates objects within an image.
Example
A traffic monitoring system detects:
Cars
Pedestrians
Traffic lights
and determines their positions.
Optical Character Recognition (OCR)
OCR extracts text from images or scanned documents.
Example
Reading text from:
Receipts
Invoices
Forms
License plates
Natural Language Processing (NLP) Models
NLP models work with human language.
Common Capabilities
Sentiment analysis
Translation
Text summarization
Chatbots
Speech recognition
Named entity recognition
Example Use Cases
Customer support chatbots
Language translation apps
Voice assistants
Sentiment Analysis
Sentiment analysis identifies emotional tone in text.
Example
Determining whether a product review is:
Positive
Negative
Neutral
Translation Models
Translation models convert text between languages.
Example
Converting English text into Spanish.
Speech Recognition
Speech recognition converts spoken language into text.
Example
Voice assistants converting speech commands into written text.
Generative AI Models
Generative AI models create new content.
Common Outputs
Text
Images
Audio
Video
Code
Example Use Cases
AI chatbots
Content generation
Image creation
Coding assistants
Large Language Models (LLMs)
LLMs are generative AI models focused on language tasks.
Capabilities
Conversations
Summarization
Question answering
Content generation
Code generation
Example
An AI assistant answering user questions in natural language.
Recommendation Systems
Recommendation systems suggest items users may prefer.
Common Use Cases
Product recommendations
Movie recommendations
Music recommendations
Online advertising
Example
An online retailer recommends products based on browsing history.
Anomaly Detection Models
Anomaly detection models identify unusual patterns or behaviors.
Common Use Cases
Fraud detection
Cybersecurity monitoring
Equipment failure prediction
Network intrusion detection
Example
A bank identifies suspicious credit card transactions.
Microsoft Azure helps organizations apply the correct AI models to different business scenarios.
Responsible AI Considerations
When selecting AI models, organizations should also consider:
Fairness
Transparency
Privacy
Reliability
Inclusiveness
Accountability
A technically accurate model may still create ethical or operational concerns if deployed improperly.
Important AI-901 Exam Tips
For the exam, remember these key points:
Classification predicts categories.
Regression predicts numeric values.
Clustering groups similar items.
NLP models process language.
Computer vision models process images and video.
Generative AI creates new content.
Recommendation systems suggest relevant items.
Anomaly detection identifies unusual behavior.
LLMs are generative AI models for language tasks.
OCR extracts text from images or documents.
Quick Knowledge Check
Question 1
Which model type is best for predicting numeric values?
Answer
Regression models.
Question 2
Which AI capability is used to extract text from scanned documents?
Answer
Optical Character Recognition (OCR).
Question 3
What type of model is typically used for chatbots that generate responses?
Answer
Large Language Models (LLMs).
Question 4
Which learning type uses unlabeled data?
Answer
Unsupervised learning.
Practice Exam Questions
Question 1
A company wants to predict future monthly sales revenue based on historical sales data.
Which type of AI model is MOST appropriate?
A. Classification B. Regression C. Clustering D. Computer vision
Correct Answer
B. Regression
Explanation
Regression models are used to predict numeric values such as revenue, prices, or temperatures.
Why the Other Answers Are Incorrect
A. Classification
Classification predicts categories, not numeric values.
C. Clustering
Clustering groups similar items.
D. Computer vision
Computer vision processes images and video.
Question 2
An organization wants to identify whether emails are spam or not spam.
Which type of AI model should be used?
A. Regression B. Clustering C. Classification D. OCR
Correct Answer
C. Classification
Explanation
Spam detection is a classification problem because the output belongs to predefined categories: spam or not spam.
Why the Other Answers Are Incorrect
A. Regression
Regression predicts numeric values.
B. Clustering
Clustering groups unlabeled data.
D. OCR
OCR extracts text from images.
Question 3
Which AI capability is MOST appropriate for extracting text from scanned documents?
A. Object detection B. OCR C. Regression D. Recommendation system
Correct Answer
B. OCR
Explanation
Optical Character Recognition (OCR) extracts printed or handwritten text from images or scanned documents.
Why the Other Answers Are Incorrect
A. Object detection
Object detection identifies objects within images.
C. Regression
Regression predicts numeric values.
D. Recommendation system
Recommendation systems suggest items to users.
Question 4
A retailer wants to group customers based on purchasing behavior without predefined labels.
Which type of AI model is MOST appropriate?
A. Classification B. Regression C. Clustering D. Translation
Correct Answer
C. Clustering
Explanation
Clustering models group similar data points together without labeled categories.
Why the Other Answers Are Incorrect
A. Classification
Classification requires labeled categories.
B. Regression
Regression predicts numbers.
D. Translation
Translation converts text between languages.
Question 5
Which type of AI model is BEST suited for generating natural language responses in a chatbot?
A. Large Language Model (LLM) B. Regression model C. Clustering model D. Decision tree only
Correct Answer
A. Large Language Model (LLM)
Explanation
LLMs are generative AI models designed for language tasks such as conversation, summarization, and question answering.
Why the Other Answers Are Incorrect
B. Regression model
Regression predicts numeric values.
C. Clustering model
Clustering groups similar data.
D. Decision tree only
Decision trees are not specialized for conversational text generation.
Question 6
A bank wants to identify suspicious credit card transactions that differ from normal spending patterns.
Which AI capability is MOST appropriate?
A. Sentiment analysis B. Anomaly detection C. OCR D. Image classification
Correct Answer
B. Anomaly detection
Explanation
Anomaly detection models identify unusual or abnormal behavior that may indicate fraud or security issues.
Why the Other Answers Are Incorrect
A. Sentiment analysis
Sentiment analysis evaluates emotional tone in text.
C. OCR
OCR extracts text from images.
D. Image classification
Image classification categorizes images.
Question 7
What is the PRIMARY capability of a computer vision model?
A. Predicting stock prices B. Processing and analyzing visual content such as images and video C. Translating text between languages D. Generating database queries
Correct Answer
B. Processing and analyzing visual content such as images and video
Explanation
Computer vision models work with images and video to identify objects, text, faces, and other visual information.
Why the Other Answers Are Incorrect
A. Predicting stock prices
This is typically a regression problem.
C. Translating text between languages
Translation is an NLP task.
D. Generating database queries
This is not the primary role of computer vision.
Question 8
A streaming service suggests movies based on a user’s viewing history.
Which AI capability is being used?
A. Recommendation system B. OCR C. Regression D. Object detection
Correct Answer
A. Recommendation system
Explanation
Recommendation systems suggest products, movies, music, or other items based on user behavior and preferences.
Why the Other Answers Are Incorrect
B. OCR
OCR extracts text from images.
C. Regression
Regression predicts numeric values.
D. Object detection
Object detection identifies objects in images.
Question 9
Which type of AI model would MOST likely be used for language translation?
A. NLP model B. Clustering model C. Regression model D. Computer vision model
Correct Answer
A. NLP model
Explanation
Natural Language Processing (NLP) models are designed to process and understand human language, including translation tasks.
Why the Other Answers Are Incorrect
B. Clustering model
Clustering groups similar items.
C. Regression model
Regression predicts numeric outputs.
D. Computer vision model
Computer vision analyzes images and video.
Question 10
Which statement BEST describes the difference between classification and regression models?
A. Classification predicts categories, while regression predicts numeric values B. Classification uses images, while regression uses text only C. Regression groups data, while classification predicts prices D. Regression and classification are identical
Correct Answer
A. Classification predicts categories, while regression predicts numeric values
Explanation
Classification models predict labels or categories, while regression models predict continuous numeric values.
Why the Other Answers Are Incorrect
B. Classification uses images, while regression uses text only
Both models can work with many data types.
C. Regression groups data, while classification predicts prices
Grouping data is clustering, not regression.
D. Regression and classification are identical
They solve different types of problems.
Final Thoughts
Understanding AI model capabilities is a critical foundational skill for the AI-901 certification exam. Microsoft expects candidates to recognize which AI model types are appropriate for different business scenarios and understand the strengths of common AI approaches.
Knowing how to match business problems to the correct AI capabilities is essential for designing effective AI solutions on Azure and beyond.
This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. This topic falls under these sections: Identify AI concepts and capabilities (40–45%) --> Identify AI workloads --> Identify scenarios for common AI workloads, Including Generative and Agentic AI, Text Analysis, Speech, Computer Vision, and Information Extraction
Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.
Understanding common AI workloads is one of the foundational concepts in artificial intelligence and a major focus area of the AI-901 certification exam. Microsoft expects candidates to recognize different types of AI workloads and identify appropriate real-world scenarios for each.
This topic falls under the “Identify AI workloads” section of the exam objectives.
What Is an AI Workload?
An AI workload is a category of AI tasks designed to solve a particular type of problem.
Different workloads specialize in processing different types of data such as:
Text
Speech
Images
Documents
Audio
Video
Understanding AI workloads helps organizations choose the correct AI technologies for business solutions.
Major AI Workloads for AI-901
For the AI-901 exam, you should understand these common AI workloads:
Generative AI
Agentic AI
Text analysis
Speech AI
Computer vision
Information extraction
Generative AI
Generative AI creates new content based on patterns learned from training data.
Common Outputs
Text
Images
Audio
Video
Code
Common Scenarios
AI chatbots
Content creation
Email drafting
Code generation
Image generation
Text summarization
Example
A marketing team uses AI to generate product descriptions automatically.
Large Language Models (LLMs)
Many generative AI systems use Large Language Models (LLMs).
LLMs are trained on massive text datasets and can:
Answer questions
Summarize content
Generate text
Translate languages
Assist with coding
Example
An AI assistant generates meeting summaries from conversation transcripts.
Agentic AI
Agentic AI refers to AI systems that can autonomously plan, reason, and take actions to accomplish goals.
Agentic AI systems may:
Make decisions
Perform multi-step tasks
Use tools
Interact with applications
Adapt based on feedback
Unlike simple chatbots, agentic AI systems can perform actions and workflows.
Agentic AI Scenarios
Examples
AI travel planning assistants
Autonomous customer support agents
AI workflow automation systems
AI research assistants
Scheduling assistants
Example
An AI assistant receives a request to schedule a meeting, checks calendars, sends invitations, and updates schedules automatically.
Text Analysis
Text analysis is an AI workload focused on understanding and processing written language.
Text analysis is part of Natural Language Processing (NLP).
Common Capabilities
Sentiment analysis
Key phrase extraction
Language detection
Named entity recognition
Text classification
Sentiment Analysis
Sentiment analysis identifies emotional tone in text.
Example Scenarios
Product review analysis
Social media monitoring
Customer feedback analysis
Example
An organization analyzes customer reviews to determine whether feedback is positive or negative.
Key Phrase Extraction
Key phrase extraction identifies important terms or phrases in text.
Example Scenarios
Document summarization
Search indexing
Topic identification
Example
An AI system extracts important keywords from support tickets.
Language Detection
Language detection identifies the language used in text.
Example Scenarios
Multilingual applications
Translation routing
Global customer support
Example
A website detects whether incoming text is English, Spanish, or French.
Named Entity Recognition (NER)
NER identifies important entities in text such as:
People
Organizations
Locations
Dates
Example
An AI system extracts company names and locations from contracts.
Speech AI
Speech AI works with spoken language and audio.
Common Capabilities
Speech-to-text
Text-to-speech
Speech translation
Speaker recognition
Speech-to-Text
Speech-to-text converts spoken audio into written text.
Example Scenarios
Voice transcription
Meeting captions
Voice assistants
Example
A meeting platform generates live captions during conferences.
Text-to-Speech
Text-to-speech converts written text into spoken audio.
Example Scenarios
Accessibility tools
Virtual assistants
Audiobooks
Navigation systems
Example
A navigation app reads driving directions aloud.
Speech Translation
Speech translation converts spoken language into another language.
Example Scenarios
International meetings
Travel applications
Multilingual support systems
Example
A conference tool translates spoken English into Spanish in real time.
Computer Vision
Computer vision enables AI systems to analyze images and video.
Common Capabilities
Image classification
Object detection
Facial recognition
OCR
Image tagging
Image Classification
Image classification identifies the contents of an image.
Example Scenarios
Medical image analysis
Product categorization
Wildlife monitoring
Example
An AI system identifies whether an image contains a cat or a dog.
Object Detection
Object detection identifies and locates objects within an image.
Example Scenarios
Traffic monitoring
Security surveillance
Manufacturing inspection
Example
A self-driving car detects pedestrians and vehicles.
Optical Character Recognition (OCR)
OCR extracts text from images or scanned documents.
Example Scenarios
Invoice processing
Form digitization
Receipt scanning
Example
An AI system extracts totals and dates from receipts.
Facial Recognition
Facial recognition identifies or verifies people using facial features.
Example Scenarios
Building access systems
Smartphone authentication
Security systems
Example
A mobile phone unlocks using facial recognition.
Information Extraction
Information extraction identifies and retrieves structured information from unstructured content.
This workload often combines:
OCR
NLP
Document analysis
Information Extraction Scenarios
Examples
Invoice processing
Contract analysis
Insurance claims processing
Healthcare form processing
Example
An AI system extracts invoice numbers, dates, and totals from scanned invoices automatically.
Structured vs. Unstructured Data
AI workloads often process unstructured data.
Structured Data
Unstructured Data
Tables
Documents
Databases
Images
Spreadsheets
Audio
Defined formats
Videos
Many AI workloads specialize in converting unstructured data into structured information.
Choosing the Correct AI Workload
Understanding the business problem helps determine the correct AI workload.
These services help organizations build AI solutions without creating models from scratch.
Responsible AI Considerations
All AI workloads should follow Responsible AI principles, including:
Fairness
Privacy
Transparency
Reliability
Inclusiveness
Accountability
Organizations should ensure AI systems are used ethically and safely.
Important AI-901 Exam Tips
For the exam, remember these key points:
Generative AI creates new content.
Agentic AI can autonomously perform tasks and workflows.
Text analysis processes written language.
Speech AI works with spoken language and audio.
Computer vision processes images and video.
OCR extracts text from images.
Information extraction converts unstructured data into structured information.
Sentiment analysis determines emotional tone in text.
Named Entity Recognition identifies important entities in text.
Quick Knowledge Check
Question 1
Which AI workload is best for generating marketing content?
Answer
Generative AI.
Question 2
Which AI workload converts spoken language into written text?
Answer
Speech AI.
Question 3
What does OCR do?
Answer
Extracts text from images or scanned documents.
Question 4
Which workload is designed to autonomously complete tasks and workflows?
Answer
Agentic AI.
Practice Exam Questions
Question 1
A company wants an AI system that can automatically generate marketing emails and product descriptions.
Which AI workload is MOST appropriate?
A. Computer vision B. Generative AI C. OCR D. Regression analysis
Correct Answer
B. Generative AI
Explanation
Generative AI creates new content such as text, images, audio, and code based on learned patterns.
Why the Other Answers Are Incorrect
A. Computer vision
Computer vision analyzes images and video.
C. OCR
OCR extracts text from images.
D. Regression analysis
Regression predicts numeric values.
Question 2
An organization wants an AI assistant that can schedule meetings, send invitations, and update calendars automatically.
Which AI workload BEST fits this scenario?
A. Speech AI B. Agentic AI C. Clustering D. OCR
Correct Answer
B. Agentic AI
Explanation
Agentic AI systems can autonomously perform multi-step tasks, make decisions, and interact with tools or applications.
Why the Other Answers Are Incorrect
A. Speech AI
Speech AI processes spoken language.
C. Clustering
Clustering groups similar data.
D. OCR
OCR extracts text from images.
Question 3
Which AI workload is MOST appropriate for determining whether customer reviews are positive or negative?
A. Sentiment analysis B. Object detection C. Regression D. Facial recognition
Correct Answer
A. Sentiment analysis
Explanation
Sentiment analysis is a text analysis capability that identifies emotional tone in written text.
Why the Other Answers Are Incorrect
B. Object detection
Object detection identifies objects in images.
C. Regression
Regression predicts numeric values.
D. Facial recognition
Facial recognition analyzes faces in images or video.
Question 4
A company needs to convert spoken customer service calls into written transcripts.
Which AI workload should be used?
A. Computer vision B. Speech-to-text C. OCR D. Recommendation system
Correct Answer
B. Speech-to-text
Explanation
Speech-to-text converts spoken audio into written text.
Why the Other Answers Are Incorrect
A. Computer vision
Computer vision processes images and video.
C. OCR
OCR extracts text from images, not audio.
D. Recommendation system
Recommendation systems suggest items to users.
Question 5
Which AI workload is MOST appropriate for identifying objects such as cars and pedestrians in traffic camera footage?
A. Text analysis B. Object detection C. Speech translation D. Key phrase extraction
Correct Answer
B. Object detection
Explanation
Object detection identifies and locates objects within images or video.
Why the Other Answers Are Incorrect
A. Text analysis
Text analysis processes written language.
C. Speech translation
Speech translation converts spoken language between languages.
D. Key phrase extraction
Key phrase extraction identifies important terms in text.
Question 6
What is the PRIMARY purpose of OCR?
A. Translating spoken language B. Extracting text from images or scanned documents C. Detecting emotions in speech D. Generating new images
Correct Answer
B. Extracting text from images or scanned documents
Explanation
Optical Character Recognition (OCR) converts printed or handwritten text in images into machine-readable text.
Why the Other Answers Are Incorrect
A. Translating spoken language
This is speech translation.
C. Detecting emotions in speech
This is speech or sentiment analysis.
D. Generating new images
This is a generative AI capability.
Question 7
Which workload is MOST associated with analyzing and processing human language?
A. Natural Language Processing (NLP) B. Computer vision C. Regression D. Clustering
Correct Answer
A. Natural Language Processing (NLP)
Explanation
NLP focuses on understanding, analyzing, and generating human language.
Why the Other Answers Are Incorrect
B. Computer vision
Computer vision works with images and video.
C. Regression
Regression predicts numeric values.
D. Clustering
Clustering groups similar items.
Question 8
A business wants to automatically extract invoice numbers, totals, and dates from scanned invoices.
Which AI workload is MOST appropriate?
A. Recommendation system B. Information extraction C. Speech recognition D. Regression
Correct Answer
B. Information extraction
Explanation
Information extraction retrieves structured information from unstructured documents and often combines OCR and NLP technologies.
Why the Other Answers Are Incorrect
A. Recommendation system
Recommendation systems suggest items.
C. Speech recognition
Speech recognition processes audio.
D. Regression
Regression predicts numbers rather than extracting document data.
Question 9
Which scenario BEST represents a computer vision workload?
A. Translating English text into Spanish B. Detecting defects on a manufacturing assembly line using cameras C. Summarizing documents automatically D. Predicting monthly sales revenue
Correct Answer
B. Detecting defects on a manufacturing assembly line using cameras
Explanation
Computer vision systems analyze visual content such as images and video to identify objects, defects, and patterns.
Why the Other Answers Are Incorrect
A. Translating English text into Spanish
This is an NLP task.
C. Summarizing documents automatically
This is a generative AI or NLP task.
D. Predicting monthly sales revenue
This is a regression task.
Question 10
Which statement BEST describes agentic AI?
A. AI systems that only classify images B. AI systems that autonomously perform tasks and make decisions C. AI systems that store relational databases D. AI systems that only process audio recordings
Correct Answer
B. AI systems that autonomously perform tasks and make decisions
Explanation
Agentic AI systems can reason, plan, interact with tools, and complete multi-step workflows with limited human intervention.
Why the Other Answers Are Incorrect
A. AI systems that only classify images
This describes computer vision tasks.
C. AI systems that store relational databases
Databases are not AI workloads.
D. AI systems that only process audio recordings
Speech AI handles audio processing, not autonomous task execution.
Final Thoughts
Understanding common AI workloads is essential for the AI-901 certification exam and for designing effective AI solutions. Microsoft expects candidates to recognize how different AI technologies solve different business problems and when each workload is most appropriate.
These foundational concepts help build a strong understanding of modern AI systems and Azure AI services.
The Data Community 