This post is a part of the AI-103: Develop AI Apps and Agents on Azure Exam Prep Hub. 
This topic falls under these sections:
Plan and manage an Azure AI solution (25–30%)
   --> Choose the appropriate Foundry services for generative AI and agents
      --> Choose the Appropriate Foundry Services for generative tasks, Grounding, Vector Search, Agent Workflows, or Multimodal Processing

Note that there are 10 practice questions (with answers and explanations) at the end of each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available from the hub's main page below the exam topics section.

Introduction

One of the core responsibilities of an Azure AI developer is selecting the correct Azure AI Foundry services and supporting Azure technologies for specific AI workloads.

The AI-103 certification exam places significant emphasis on understanding how Azure AI Foundry services support:

Generative AI tasks
Grounding and Retrieval-Augmented Generation (RAG)
Vector search
AI agent workflows
Multimodal processing

Modern AI solutions are composed of multiple services working together rather than a single AI model.

For example:

A chatbot may require an LLM, vector search, embeddings, grounding, and agent orchestration.
A document assistant may require multimodal processing, OCR, embeddings, and RAG.
An AI agent may require tool calling, memory, orchestration, and workflow management.

Understanding which Foundry services to use in each scenario is critical both for the AI-103 exam and for real-world Azure AI development.

What Is Azure AI Foundry?

Azure AI Foundry is Microsoft’s unified AI development platform for:

Building AI applications
Developing AI agents
Managing models
Orchestrating workflows
Evaluating AI systems
Implementing responsible AI controls

Azure AI Foundry provides:

Model access
Prompt engineering tools
Agent frameworks
Retrieval and grounding tools
Evaluation systems
Safety controls
Deployment and monitoring capabilities

It integrates with many Azure AI services including:

Azure OpenAI
Azure AI Search
Azure AI Vision
Azure AI Language
Azure AI Document Intelligence
Azure AI Content Safety

Understanding the Core Service Categories

For the AI-103 exam, you should understand how Foundry services align to these major AI solution categories:

Generative AI services
Grounding and RAG services
Vector search services
Agent workflow services
Multimodal processing services
Evaluation and safety services

Generative AI Services

What Are Generative AI Services?

Generative AI services enable applications to:

Generate text
Summarize content
Create conversations
Produce code
Generate structured outputs
Perform reasoning tasks
Support AI copilots and assistants

The primary Foundry-related service for generative AI is:

Azure OpenAI Service

Azure OpenAI Service

Azure OpenAI provides access to advanced foundation models such as:

GPT models
GPT-4-class reasoning models
Multimodal GPT models
Embedding models
Audio-capable models

Azure OpenAI is commonly used for:

Chatbots
AI copilots
Content generation
AI agents
Coding assistants
Summarization
Question answering

When to Use Azure OpenAI

Use Azure OpenAI when the solution requires:

Natural language generation
Conversational AI
Complex reasoning
Function/tool calling
AI agents
Summarization
Code generation
Long-context processing

Example Generative AI Scenario

Scenario

A company wants to create an AI assistant that:

Answers employee questions
Summarizes internal documents
Generates emails
Uses enterprise data

Recommended Services:

Azure OpenAI
Azure AI Search
Embedding models
RAG architecture

Reason:

Azure OpenAI provides the conversational and reasoning capabilities.

Grounding and Retrieval-Augmented Generation (RAG)

What Is Grounding?

Grounding refers to providing AI models with reliable external data sources so responses are based on factual and current information.

Without grounding, LLMs may:

Hallucinate
Provide outdated information
Generate inaccurate answers

Grounding improves:

Accuracy
Relevance
Reliability
Enterprise trustworthiness

What Is Retrieval-Augmented Generation (RAG)?

RAG combines:

Retrieval systems
Embedding models
Vector search
Generative AI models

The workflow typically includes:

Convert documents into embeddings
Store vectors in a vector index
Convert user query into embeddings
Retrieve relevant content
Inject retrieved content into the LLM prompt
Generate grounded response

Azure Services Used for RAG

Common Azure services used for grounding and RAG include:

Azure AI Search
Azure OpenAI
Embedding models
Azure Storage
Azure Cosmos DB (optional)
Azure SQL Database with vector support

Azure AI Search

Azure AI Search is a core service for:

Vector search
Hybrid search
Semantic search
Enterprise retrieval
RAG pipelines

It enables applications to:

Index documents
Perform semantic retrieval
Store vector embeddings
Execute hybrid search queries

Types of Search in Azure AI Search

Keyword Search

Traditional lexical matching.

Example:

Exact term searches

Semantic Search

Understands contextual meaning.

Example:

Searching for “car” may also retrieve “vehicle.”

Vector Search

Uses embeddings to retrieve semantically similar content.

Example:

Finding conceptually similar documents even without exact keywords.

Hybrid Search

Combines:

Keyword search
Semantic ranking
Vector search

Hybrid search often produces the best retrieval quality.

When to Use Azure AI Search

Use Azure AI Search when applications require:

RAG
Semantic retrieval
Vector similarity search
Enterprise document retrieval
Knowledge-base search
Hybrid search scenarios

Example Grounding Scenario

Scenario

A healthcare chatbot must answer questions using the latest internal policy documents.

Recommended Services:

Azure OpenAI
Azure AI Search
Embedding models

Reason:

RAG enables grounded responses using current enterprise documents.

Vector Search Services

What Is Vector Search?

Vector search retrieves information based on semantic similarity rather than exact text matching.

Documents and queries are converted into numerical vectors called embeddings.

Similar meanings produce similar vectors.

Embedding Models

Embedding models transform content into vector representations.

These embeddings support:

Similarity matching
Semantic retrieval
Recommendation systems
RAG pipelines

Azure Services Supporting Vector Search

Azure AI Search

Primary enterprise vector search platform.

Azure Cosmos DB

Can support vector indexing and similarity search.

Useful for:

Globally distributed systems
High-scale AI applications

Azure SQL Database

Supports vector operations in modern AI workloads.

Useful for:

Structured enterprise systems
Integrated relational and AI workloads

Choosing the Correct Vector Search Service

Use Azure AI Search When:

Building enterprise RAG systems
Implementing hybrid search
Using semantic ranking
Creating AI copilots

Use Azure Cosmos DB When:

Global distribution is required
Massive scale is needed
NoSQL flexibility is important

Use Azure SQL Database When:

AI functionality must integrate with relational data
Existing SQL systems already exist

Agent Workflow Services

What Are AI Agents?

AI agents are AI systems capable of:

Reasoning
Planning
Tool usage
Multi-step execution
Task automation
Dynamic decision-making

Unlike basic chatbots, agents can:

Take actions
Call APIs
Use memory
Execute workflows
Interact with systems

Azure AI Foundry Agent Capabilities

Azure AI Foundry supports agent development with:

Tool calling
Function calling
Prompt orchestration
Workflow execution
Agent memory
Retrieval integration

Prompt Flow

Prompt Flow is a key Foundry tool for building:

AI workflows
Prompt chains
Tool orchestration
Agent pipelines
Multi-step AI systems

Prompt Flow helps developers:

Test prompts
Connect services
Evaluate outputs
Build reusable workflows

Tool Calling and Function Calling

LLMs can interact with external systems using:

Tool calling
Function calling

Examples:

Query databases
Call REST APIs
Retrieve documents
Send emails
Trigger workflows

This is a critical AI-103 topic.

Agent Workflow Scenario

Scenario

An AI travel assistant must:

Search flights
Check hotel pricing
Access calendars
Generate itineraries

Recommended Services:

Azure OpenAI
Prompt Flow
Agent orchestration tools
Tool/function calling

Reason:

This solution requires multi-step agent workflows.

Multimodal Processing Services

What Is Multimodal Processing?

Multimodal AI systems process multiple types of input such as:

Text
Images
Audio
Video
Documents

These systems combine multiple modalities to improve understanding.

Azure Services for Multimodal Processing

Common services include:

Azure OpenAI multimodal models
Azure AI Vision
Azure AI Document Intelligence
Azure AI Speech

Azure AI Vision

Azure AI Vision supports:

Image analysis
Object detection
OCR
Face analysis
Caption generation
Scene understanding

Use Azure AI Vision when applications require:

Image processing
Computer vision
OCR tasks
Visual analysis

Azure AI Document Intelligence

Azure AI Document Intelligence extracts structured information from documents such as:

Invoices
Receipts
Contracts
Forms
IDs

Capabilities include:

OCR
Key-value extraction
Layout analysis
Table extraction
Custom models

Azure AI Speech

Azure AI Speech supports:

Speech-to-text
Text-to-speech
Translation
Voice assistants
Real-time transcription

Choosing the Correct Multimodal Service

Use Azure AI Vision When:

Analyzing images
Detecting objects
Extracting text from images

Use Azure AI Document Intelligence When:

Extracting structured document data
Processing forms and invoices
Understanding layouts and tables

Use Azure AI Speech When:

Processing voice input
Building voice assistants
Performing speech transcription

Use Azure OpenAI Multimodal Models When:

Combining conversational reasoning with image understanding
Performing multimodal interactions
Building advanced AI assistants

Safety and Responsible AI Services

AI solutions require safety and governance.

Azure AI Foundry includes services such as:

Azure AI Content Safety
Content filtering
Prompt injection detection
Harm detection

These services help:

Detect unsafe content
Prevent abuse
Improve compliance
Support responsible AI development

Evaluation and Monitoring Services

Azure AI Foundry provides evaluation tools for:

Groundedness
Relevance
Accuracy
Latency
Cost
Toxicity
Hallucination detection

Evaluation is important because AI quality can vary significantly.

Choosing the Correct Foundry Service

The AI-103 exam frequently tests scenario-based service selection.

Scenario 1: Enterprise Knowledge Chatbot

Requirements:

Conversational AI
Enterprise document grounding
Semantic retrieval

Recommended Services:

Azure OpenAI
Azure AI Search
Embedding models

Scenario 2: Invoice Processing System

Requirements:

OCR
Table extraction
Structured document understanding

Recommended Services:

Azure AI Document Intelligence

Scenario 3: AI Agent with Workflow Automation

Requirements:

Tool usage
API calls
Multi-step execution

Recommended Services:

Azure OpenAI
Prompt Flow
Agent orchestration tools

Scenario 4: Image Analysis Application

Requirements:

Object detection
Image captioning
OCR

Recommended Services:

Azure AI Vision

Scenario 5: Semantic Product Search

Requirements:

Similarity search
Semantic retrieval
Vector indexing

Recommended Services:

Azure AI Search
Embedding models

Common AI-103 Exam Tips

Understand Service Roles

Know which services specialize in:

Generative AI
Retrieval
Search
Vision
Speech
Documents
Agent workflows

Know Common Service Pairings

Azure OpenAI + Azure AI Search

Used for:

RAG systems
Enterprise chatbots
Knowledge assistants

Azure OpenAI + Prompt Flow

Used for:

AI agents
Multi-step workflows
Tool orchestration

Azure AI Vision + Azure OpenAI

Used for:

Multimodal assistants
Visual question answering

Remember Hybrid Search

Hybrid search combines:

Vector search
Keyword search
Semantic ranking

This is commonly tested on AI-103.

Know When Specialized Services Are Better

Example:

Azure AI Document Intelligence is better for invoice extraction than using only a general-purpose LLM.

Summary

Selecting the appropriate Azure AI Foundry services is essential for building scalable, accurate, and cost-effective AI applications.

For the AI-103 exam, you should understand:

Which services support generative AI
How grounding and RAG work
When to use vector search
How AI agents are orchestrated
Which services support multimodal processing
How Azure AI Search integrates into enterprise AI systems
How Prompt Flow supports AI workflows
The role of specialized services like Vision and Document Intelligence

Strong service-selection skills are critical for both certification success and real-world Azure AI solution development.

Practice Exam Questions

Question 1

Which Azure service is MOST commonly used to provide generative AI chat capabilities?

A. Azure AI Search
B. Azure OpenAI
C. Azure AI Vision
D. Azure Monitor

Answer

B. Azure OpenAI

Explanation

Azure OpenAI provides access to GPT-based generative AI models.

Question 2

What is the primary purpose of Retrieval-Augmented Generation (RAG)?

A. Reduce GPU usage
B. Improve groundedness using retrieved data
C. Replace embeddings
D. Eliminate vector search

Answer

B. Improve groundedness using retrieved data

Explanation

RAG retrieves relevant information to ground LLM responses.

Question 3

Which Azure service is MOST appropriate for vector search and semantic retrieval?

A. Azure AI Search
B. Azure Backup
C. Azure DNS
D. Azure Automation

Answer

A. Azure AI Search

Explanation

Azure AI Search provides vector indexing and semantic retrieval capabilities.

Question 4

Which Foundry tool is designed for building multi-step AI workflows and prompt orchestration?

A. Azure Policy
B. Prompt Flow
C. Azure Backup
D. Azure DevOps

Answer

B. Prompt Flow

Explanation

Prompt Flow supports orchestration of prompts, tools, and workflows.

Question 5

A solution must extract tables and key-value pairs from invoices. Which service is MOST appropriate?

A. Azure AI Vision
B. Azure AI Document Intelligence
C. Azure Monitor
D. Azure AI Search

Answer

B. Azure AI Document Intelligence

Explanation

Document Intelligence specializes in structured document extraction.

Question 6

Which capability allows an LLM to interact with APIs and external systems?

A. OCR
B. Function calling
C. Vectorization
D. Semantic ranking

Answer

B. Function calling

Explanation

Function calling enables AI models to invoke external tools and APIs.

Question 7

Which Azure service is MOST appropriate for image analysis and object detection?

A. Azure AI Vision
B. Azure AI Search
C. Azure Cosmos DB
D. Azure SQL Database

Answer

A. Azure AI Vision

Explanation

Azure AI Vision provides computer vision capabilities.

Question 8

What is the main purpose of embeddings in AI applications?

A. Image generation
B. Semantic vector representation
C. Text-to-speech conversion
D. Function orchestration

Answer

B. Semantic vector representation

Explanation

Embeddings convert content into vectors for semantic similarity operations.

Question 9

Which search method combines vector search, keyword search, and semantic ranking?

A. Lexical search
B. OCR search
C. Hybrid search
D. Binary search

Answer

C. Hybrid search

Explanation

Hybrid search combines multiple retrieval methods for improved results.

Question 10

Which Azure AI service is MOST appropriate for speech-to-text transcription?

A. Azure AI Speech
B. Azure AI Search
C. Azure AI Vision
D. Azure Policy

Answer

A. Azure AI Speech

Explanation

Azure AI Speech provides speech recognition and transcription capabilities.

Go to the AI-103 Exam Prep Hub main page