Tag: Azure AI Foundry

Create and test a single-agent solution in the Foundry Portal (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement generative AI apps and agents by using Foundry
--> Create and test a single-agent solution in the Foundry Portal


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

AI agents are an increasingly important part of modern AI applications. Microsoft Azure AI Foundry provides tools that allow developers to create, configure, test, and manage AI agents directly within the Foundry portal.

For the AI-901 certification exam, candidates should understand the basic concepts behind creating and testing a single-agent AI solution using Azure AI Foundry.

This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.


What Is an AI Agent?

An AI agent is an AI-powered system designed to perform tasks, answer questions, and interact with users autonomously or semi-autonomously.

Agents often use:

  • Large Language Models (LLMs)
  • Prompt engineering
  • External tools
  • Memory
  • Data sources

to complete tasks.


What Is a Single-Agent Solution?

A single-agent solution uses one AI agent to manage interactions and tasks.

The agent receives input, processes requests, and generates responses.


Examples of Single-Agent Solutions

Common examples include:

  • Customer support assistants
  • FAQ bots
  • IT help desk assistants
  • Educational tutors
  • Internal knowledge assistants

AI Agent vs. Traditional Chatbot

Traditional ChatbotAI Agent
Often rule-basedAI-driven reasoning
Limited flexibilityMore adaptive
Predefined responsesDynamic responses
Basic workflowsCan perform complex tasks

Azure AI Foundry

Azure AI Foundry provides tools for creating and managing AI agents and generative AI applications.

The portal allows developers to:

  • Configure agents
  • Test prompts
  • Connect models
  • Evaluate responses
  • Monitor behavior

Basic Components of a Single-Agent Solution

A single-agent solution often includes:

  • AI model
  • System instructions
  • User interaction interface
  • Memory/context handling
  • Optional tools or data connections

AI Models in Agents

Agents typically use generative AI models such as large language models.

The model processes prompts and generates responses.


System Instructions

System instructions define how the agent should behave.

These instructions influence:

  • Tone
  • Personality
  • Safety
  • Response style
  • Allowed behavior

Example System Instruction

“You are a professional customer support assistant. Provide concise and helpful answers.”


User Prompts

Users interact with the agent by entering prompts or questions.


Example User Prompt

“How do I reset my password?”


Context and Memory

Many agents maintain conversational context.

This allows the agent to remember previous interactions during a session.


Example

User

“Tell me about Azure AI.”

User Later

“Can it support chatbots?”

The agent remembers the conversation topic.


Creating a Single-Agent Solution in Foundry

The general workflow includes:

  1. Open Azure AI Foundry
  2. Create or select a project
  3. Choose an AI model
  4. Configure the agent
  5. Define system instructions
  6. Test the agent
  7. Refine prompts and settings

Selecting a Model

Developers choose a model based on:

  • Performance
  • Cost
  • Speed
  • Language support
  • Context window size

Configuring the Agent

Agent configuration may include:

  • Name
  • Instructions
  • Model selection
  • Safety settings
  • Tool connections

Testing the Agent

The Foundry portal allows interactive testing.

Users can:

  • Enter prompts
  • Review responses
  • Adjust settings
  • Refine instructions

Playground Testing

Foundry includes playground environments for experimentation.

Developers can test:

  • Prompt quality
  • Tone
  • Accuracy
  • Context handling

before deploying applications.


Example Testing Scenario

System Instruction

“You are a helpful study assistant.”

User Prompt

“Explain supervised learning.”

The agent generates a response according to its instructions.


Prompt Engineering for Agents

Effective prompts improve agent behavior.

Helpful techniques include:

  • Clear instructions
  • Specific tasks
  • Output formatting
  • Context inclusion

Model Parameters

Developers may configure model settings such as:

  • Temperature
  • Maximum tokens
  • Top-p sampling

Temperature

Temperature controls response creativity.

Low TemperatureHigh Temperature
More predictableMore creative
More focusedMore varied

Maximum Tokens

Maximum tokens limit response length.

Lower values create shorter responses.


Tool Integration

Some agents can connect to external tools or data sources.

Examples include:

  • Databases
  • Search systems
  • APIs
  • Knowledge bases

Example Tool Usage

An IT support agent may retrieve information from a company knowledge base.


Grounding

Grounding connects AI responses to trusted data sources.

Grounded responses are generally more accurate and reliable.


Hallucinations

AI agents may occasionally produce incorrect or fabricated information.

These errors are called hallucinations.

Testing and grounding help reduce hallucinations.


Responsible AI Considerations

Single-agent solutions should follow Responsible AI principles.

Important considerations include:

  • Fairness
  • Privacy
  • Security
  • Transparency
  • Safety
  • Accountability

Content Filtering

Content filtering helps reduce:

  • Harmful outputs
  • Offensive content
  • Unsafe instructions

Authentication and Access Control

Organizations should secure access to AI agents using:

  • API keys
  • Identity management
  • Role-based access controls

Monitoring and Evaluation

Organizations should monitor agents for:

  • Accuracy
  • Performance
  • Bias
  • Safety
  • Usage patterns

Common Real-World Use Cases


Scenario 1: Customer Support Agent

Goal

Answer customer questions automatically.

Capabilities

  • Conversational responses
  • Knowledge retrieval
  • Escalation guidance

Scenario 2: Educational Tutor

Goal

Help students learn technical concepts.

Capabilities

  • Step-by-step explanations
  • Personalized tutoring
  • Interactive Q&A

Scenario 3: Internal Company Assistant

Goal

Help employees find company information.

Capabilities

  • Policy lookup
  • Document summarization
  • Search assistance

Advantages of Single-Agent Solutions

Benefits include:

  • Simpler architecture
  • Easier management
  • Faster deployment
  • Lower complexity
  • Natural interactions

Limitations of Single-Agent Solutions

Challenges may include:

  • Limited specialization
  • Hallucinations
  • Context limitations
  • Dependency on prompt quality

More complex systems may require multiple agents.


Single-Agent vs. Multi-Agent Systems

Single-AgentMulti-Agent
One agent handles tasksMultiple specialized agents
Simpler designMore complex
Easier managementBetter specialization
Lower overheadGreater coordination

Important AI-901 Exam Tips

For the exam, remember these key points:

  • AI agents use generative AI models to interact with users.
  • A single-agent solution uses one agent for interactions and tasks.
  • Azure AI Foundry provides tools for creating and testing agents.
  • System instructions guide agent behavior.
  • User prompts define tasks and questions.
  • Playground environments allow interactive testing.
  • Temperature controls creativity.
  • Grounding improves reliability.
  • Hallucinations are incorrect AI-generated outputs.
  • Responsible AI principles apply to AI agents.

Quick Knowledge Check

Question 1

What is a single-agent solution?

Answer

An AI system that uses one agent to process interactions and tasks.


Question 2

What is the purpose of system instructions?

Answer

To guide agent behavior, tone, and safety.


Question 3

What does grounding help improve?

Answer

Accuracy and reliability of AI responses.


Question 4

What are hallucinations?

Answer

Incorrect or fabricated AI-generated information.


Practice Exam Questions

Question 1

What is a single-agent solution?

A. A system that uses multiple AI agents simultaneously
B. A system that uses one AI agent to handle interactions and tasks
C. A database clustering solution
D. A networking security appliance


Correct Answer

B. A system that uses one AI agent to handle interactions and tasks


Explanation

A single-agent solution uses one AI-powered agent to process user requests and generate responses.


Why the Other Answers Are Incorrect

A. A system that uses multiple AI agents simultaneously

This describes a multi-agent system.

C. A database clustering solution

This is unrelated to AI agents.

D. A networking security appliance

This is unrelated to AI systems.


Question 2

Which Microsoft platform provides tools for creating and testing AI agents?

A. Microsoft Word
B. Azure AI Foundry
C. Microsoft Paint
D. Azure Virtual Desktop


Correct Answer

B. Azure AI Foundry


Explanation

Azure AI Foundry provides tools for building, testing, configuring, and managing AI agents and generative AI applications.


Why the Other Answers Are Incorrect

A. Microsoft Word

Word is a document editor.

C. Microsoft Paint

Paint is a graphics application.

D. Azure Virtual Desktop

This provides virtual desktop infrastructure services.


Question 3

What is the PRIMARY purpose of system instructions in an AI agent?

A. To physically store AI models
B. To define the agent’s behavior, tone, and rules
C. To improve monitor resolution
D. To compress training data


Correct Answer

B. To define the agent’s behavior, tone, and rules


Explanation

System instructions guide how the AI agent behaves and responds to users.


Why the Other Answers Are Incorrect

A. To physically store AI models

System instructions do not store models.

C. To improve monitor resolution

This is unrelated to AI agents.

D. To compress training data

This is unrelated to prompting.


Question 4

Which statement BEST describes grounding in AI systems?

A. Permanently deleting unused prompts
B. Connecting AI responses to trusted data sources
C. Increasing image brightness automatically
D. Compressing API requests


Correct Answer

B. Connecting AI responses to trusted data sources


Explanation

Grounding improves reliability by helping AI generate responses based on trusted information.


Why the Other Answers Are Incorrect

A. Permanently deleting unused prompts

This is unrelated to grounding.

C. Increasing image brightness automatically

This is unrelated to generative AI.

D. Compressing API requests

Grounding is unrelated to network compression.


Question 5

What is the PRIMARY purpose of playground testing in Azure AI Foundry?

A. Managing payroll systems
B. Experimenting with prompts and evaluating AI responses
C. Compressing video files
D. Managing physical servers


Correct Answer

B. Experimenting with prompts and evaluating AI responses


Explanation

Playgrounds allow developers to interactively test prompts, instructions, and AI behavior.


Why the Other Answers Are Incorrect

A. Managing payroll systems

This is unrelated to AI Foundry.

C. Compressing video files

Playgrounds are not media tools.

D. Managing physical servers

Playgrounds focus on AI interaction and testing.


Question 6

Which parameter controls how creative or random an AI agent’s responses will be?

A. Temperature
B. OCR threshold
C. Pixel density
D. Frame rate


Correct Answer

A. Temperature


Explanation

Temperature controls randomness and creativity in generated responses.


Why the Other Answers Are Incorrect

B. OCR threshold

This relates to text extraction from images.

C. Pixel density

This relates to image quality.

D. Frame rate

This relates to video playback.


Question 7

What are hallucinations in generative AI systems?

A. Hardware failures in cloud servers
B. Incorrect or fabricated AI-generated information
C. Authentication timeouts
D. Network bandwidth limitations


Correct Answer

B. Incorrect or fabricated AI-generated information


Explanation

Hallucinations occur when AI systems generate false or invented information.


Why the Other Answers Are Incorrect

A. Hardware failures in cloud servers

This is unrelated to hallucinations.

C. Authentication timeouts

This is a security or networking issue.

D. Network bandwidth limitations

This is unrelated to AI-generated accuracy.


Question 8

Why is conversation context important in AI agents?

A. It increases monitor resolution
B. It helps the agent remember previous interactions during a session
C. It permanently stores training datasets
D. It reduces internet costs


Correct Answer

B. It helps the agent remember previous interactions during a session


Explanation

Conversation context allows the AI agent to generate more coherent and relevant responses across multiple prompts.


Why the Other Answers Are Incorrect

A. It increases monitor resolution

Context does not affect displays.

C. It permanently stores training datasets

Context is session-related, not training storage.

D. It reduces internet costs

Context does not directly affect networking costs.


Question 9

Which Responsible AI feature helps reduce harmful or offensive AI-generated outputs?

A. Content filtering
B. Image compression
C. Database replication
D. Spreadsheet formatting


Correct Answer

A. Content filtering


Explanation

Content filtering helps block unsafe or inappropriate AI-generated responses.


Why the Other Answers Are Incorrect

B. Image compression

This reduces file size.

C. Database replication

This copies database data.

D. Spreadsheet formatting

This is unrelated to AI safety.


Question 10

What is one advantage of a single-agent solution compared to a multi-agent system?

A. Greater architectural complexity
B. Easier management and simpler design
C. Requires no prompts
D. Eliminates all hallucinations


Correct Answer

B. Easier management and simpler design


Explanation

Single-agent solutions are generally simpler to configure, deploy, and manage.


Why the Other Answers Are Incorrect

A. Greater architectural complexity

Multi-agent systems are usually more complex.

C. Requires no prompts

AI agents still rely on prompts and instructions.

D. Eliminates all hallucinations

Hallucinations can still occur in single-agent systems.


Final Thoughts

Creating and testing single-agent solutions in Azure AI Foundry is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the core concepts behind AI agents, prompt configuration, testing workflows, grounding, and Responsible AI practices.

Azure AI Foundry provides an accessible environment for building and experimenting with conversational AI agents that can support a wide variety of real-world business scenarios.


Go to the AI-901 Exam Prep Hub main page

Create a lightweight chat client application by using the Foundry SDK (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement generative AI apps and agents by using Foundry
--> Create a lightweight chat client application by using the Foundry SDK


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Modern generative AI applications often include chat-based interfaces that allow users to interact naturally with AI models. Microsoft Azure AI Foundry provides SDKs (Software Development Kits) that developers can use to build lightweight chat applications that connect to deployed AI models.

For the AI-901 certification exam, candidates should understand the basic concepts behind creating chat client applications using the Foundry SDK and how these applications interact with deployed generative AI models.

This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.


What Is a Chat Client Application?

A chat client application is a software application that allows users to communicate with an AI model using conversational prompts and responses.

Users type messages, and the AI model generates replies.


Common Chat Application Examples

Examples include:

  • AI assistants
  • Customer support bots
  • Internal company copilots
  • Study assistants
  • Virtual agents
  • Help desk chatbots

What Is an SDK?

SDK stands for Software Development Kit.

An SDK provides tools and libraries that help developers build applications more easily.

SDKs typically include:

  • APIs
  • Authentication tools
  • Code libraries
  • Documentation
  • Example code

What Is the Foundry SDK?

The Foundry SDK allows developers to connect applications to deployed AI models within Azure AI Foundry.

Developers can use SDKs to:

  • Send prompts
  • Receive AI-generated responses
  • Manage conversations
  • Configure requests
  • Handle authentication

Why Use an SDK?

Using an SDK simplifies development.

Without an SDK, developers would need to manually handle:

  • Network requests
  • Authentication
  • Error handling
  • API formatting

SDKs abstract much of this complexity.


Lightweight Chat Applications

A lightweight chat client is a simple application focused on core chat functionality.

It usually includes:

  • User input field
  • Conversation display
  • AI response generation
  • Basic session management

Basic Chat Workflow

A typical AI chat application workflow includes:

  1. User enters a prompt
  2. Application sends request to deployed model
  3. AI model processes prompt
  4. Model generates response
  5. Application displays response

Connecting to a Deployed Model

Chat applications connect to deployed AI models using:

  • API endpoints
  • Authentication credentials
  • SDK libraries

The deployed model processes incoming prompts.


Authentication

Applications typically authenticate using:

  • API keys
  • Azure credentials
  • Managed identities

Authentication ensures only authorized users and applications can access AI services.


Example Chat Interaction

User

“Explain machine learning in simple terms.”

AI Model

“Machine learning is a type of AI where computers learn patterns from data instead of being explicitly programmed.”


Conversation History

Many chat applications maintain conversation history.

This allows the AI model to remember context during the session.


Example of Context Retention

User

“Who founded Microsoft?”

AI

“Microsoft was founded by Bill Gates and Paul Allen.”

User

“When was it founded?”

Because conversation history is maintained, the AI understands the second question refers to Microsoft.


System Prompts in Chat Applications

Chat applications often include system prompts that guide model behavior.


Example System Prompt

“You are a helpful technical tutor. Explain topics clearly for beginners.”

This influences:

  • Tone
  • Style
  • Behavior
  • Safety

User Prompts

User prompts represent the questions or requests entered during the conversation.


Example User Prompt

“Explain neural networks.”


Model Responses

The deployed AI model generates responses based on:

  • System prompt
  • User prompt
  • Conversation history
  • Model parameters

Model Parameters

Chat applications may configure parameters such as:

  • Temperature
  • Maximum tokens
  • Top-p sampling

Temperature

Temperature controls response creativity.

Low TemperatureHigh Temperature
More focusedMore creative
More predictableMore varied

Maximum Tokens

Maximum tokens limit response length.

Smaller values create shorter responses.


Streaming Responses

Some chat applications support streaming responses.

Streaming displays generated text gradually as the model produces it.

This improves user experience by reducing perceived waiting time.


Error Handling

Applications should handle errors gracefully.

Common issues include:

  • Network failures
  • Invalid credentials
  • Rate limits
  • Timeout errors

Rate Limits

AI services may limit request frequency.

Applications should be designed to handle:

  • Request throttling
  • Retry logic
  • Usage quotas

Responsible AI Considerations

Chat applications should follow Responsible AI principles.

Important considerations include:

  • Content filtering
  • Privacy
  • Safety
  • Bias reduction
  • Transparency

Content Filtering

Content filters help reduce:

  • Harmful responses
  • Offensive content
  • Unsafe outputs

Privacy and Security

Applications should protect:

  • User conversations
  • Authentication credentials
  • Sensitive information

Logging and Monitoring

Organizations may monitor chat applications for:

  • Performance
  • Usage
  • Errors
  • Safety concerns

Azure AI Foundry

Azure AI Foundry provides tools for deploying models and managing generative AI applications.

Developers can:

  • Deploy models
  • Test prompts
  • Monitor applications
  • Manage AI resources

Azure OpenAI Service

Azure OpenAI Service provides access to generative AI models used in chat applications.


High-Level SDK Workflow

A simplified workflow for a lightweight chat application typically includes:

  1. Install SDK
  2. Configure credentials
  3. Connect to deployed model
  4. Send prompts
  5. Receive responses
  6. Display conversation

Example High-Level Pseudocode

connect_to_model()
while True:
user_prompt = get_user_input()
response = send_prompt(user_prompt)
display_response(response)

For AI-901, understanding the overall workflow is more important than memorizing syntax.


Common Real-World Scenarios


Scenario 1: Customer Support Chatbot

Goal

Answer customer questions automatically.

Features

  • Conversational interface
  • Context retention
  • Safe responses

Scenario 2: Internal Knowledge Assistant

Goal

Help employees search company information.

Features

  • Question answering
  • Document summarization
  • Secure access

Scenario 3: Educational Tutor

Goal

Provide interactive learning assistance.

Features

  • Step-by-step explanations
  • Conversational learning
  • Prompt customization

Advantages of Chat-Based AI Applications

Benefits include:

  • Natural user interaction
  • Faster information access
  • Automation of repetitive tasks
  • Improved customer experience
  • Scalability

Challenges and Limitations

Organizations should consider:

  • Hallucinations
  • Incorrect responses
  • Cost management
  • Privacy concerns
  • Latency
  • Prompt injection risks

Hallucinations

Generative AI models may occasionally generate incorrect or fabricated information.

These incorrect outputs are called hallucinations.

Applications should not assume all AI-generated responses are accurate.


Prompt Injection Risks

Malicious users may attempt to manipulate prompts to bypass safety controls.

Applications should implement safeguards against unsafe behavior.


Important AI-901 Exam Tips

For the exam, remember these key points:

  • SDKs simplify application development.
  • Chat clients communicate with deployed AI model endpoints.
  • System prompts define AI behavior.
  • User prompts represent user requests.
  • Conversation history helps maintain context.
  • Temperature controls response randomness.
  • Maximum tokens limit response length.
  • Streaming responses improve user experience.
  • Responsible AI principles apply to chat applications.
  • Authentication secures access to AI services.

Quick Knowledge Check

Question 1

What is the purpose of an SDK?

Answer

To simplify application development using tools and libraries.


Question 2

Why is conversation history important in chat applications?

Answer

It helps maintain context across multiple user interactions.


Question 3

What does temperature control in a generative AI model?

Answer

The creativity and randomness of responses.


Question 4

Why are content filters important?

Answer

They help reduce harmful or unsafe AI-generated outputs.


Practice Exam Questions

Question 1

What is the PRIMARY purpose of a chat client application in generative AI?

A. To physically store servers
B. To allow users to interact conversationally with an AI model
C. To compress database files
D. To manage network hardware


Correct Answer

B. To allow users to interact conversationally with an AI model


Explanation

A chat client application enables users to send prompts and receive AI-generated conversational responses.


Why the Other Answers Are Incorrect

A. To physically store servers

Chat clients are software applications, not physical infrastructure.

C. To compress database files

This is unrelated to chat applications.

D. To manage network hardware

This is unrelated to generative AI chat systems.


Question 2

What does SDK stand for?

A. Secure Data Kernel
B. Software Development Kit
C. System Deployment Key
D. Structured Data Kit


Correct Answer

B. Software Development Kit


Explanation

An SDK provides tools, libraries, and documentation that help developers build applications more efficiently.


Why the Other Answers Are Incorrect

A. Secure Data Kernel

This is not the correct definition.

C. System Deployment Key

This is incorrect terminology.

D. Structured Data Kit

This is not the meaning of SDK.


Question 3

Why do developers commonly use SDKs when building AI applications?

A. SDKs eliminate the need for internet access
B. SDKs simplify communication with AI services and APIs
C. SDKs permanently store all prompts automatically
D. SDKs replace AI models entirely


Correct Answer

B. SDKs simplify communication with AI services and APIs


Explanation

SDKs help developers handle authentication, requests, responses, and integration more easily.


Why the Other Answers Are Incorrect

A. SDKs eliminate the need for internet access

Cloud AI services still require connectivity.

C. SDKs permanently store all prompts automatically

SDKs do not inherently provide permanent storage.

D. SDKs replace AI models entirely

SDKs connect applications to models; they do not replace them.


Question 4

What allows a chat application to remember previous user interactions during a conversation?

A. OCR
B. Conversation history
C. Image classification
D. Regression analysis


Correct Answer

B. Conversation history


Explanation

Conversation history preserves context so the AI can respond appropriately across multiple prompts.


Why the Other Answers Are Incorrect

A. OCR

OCR extracts text from images.

C. Image classification

This categorizes images.

D. Regression analysis

Regression predicts numeric values.


Question 5

Which prompt type defines the AI assistant’s behavior and communication style?

A. User prompt
B. System prompt
C. SQL prompt
D. OCR prompt


Correct Answer

B. System prompt


Explanation

System prompts establish behavior rules, tone, style, and safety guidelines.


Why the Other Answers Are Incorrect

A. User prompt

User prompts contain requests or questions.

C. SQL prompt

SQL is related to databases.

D. OCR prompt

OCR is unrelated to conversational behavior.


Question 6

What is the PRIMARY purpose of authentication in a chat client application?

A. To improve image resolution
B. To ensure only authorized users or applications access AI services
C. To increase response creativity
D. To summarize conversations


Correct Answer

B. To ensure only authorized users or applications access AI services


Explanation

Authentication protects AI resources and controls access to deployed services.


Why the Other Answers Are Incorrect

A. To improve image resolution

Authentication does not affect graphics.

C. To increase response creativity

Temperature settings influence creativity.

D. To summarize conversations

Authentication does not summarize data.


Question 7

Which configuration parameter controls how creative or random a generative AI response will be?

A. Temperature
B. OCR threshold
C. Frame rate
D. Compression ratio


Correct Answer

A. Temperature


Explanation

Temperature controls response randomness and creativity.


Why the Other Answers Are Incorrect

B. OCR threshold

This relates to text extraction.

C. Frame rate

This relates to video processing.

D. Compression ratio

This relates to file compression.


Question 8

What is the benefit of streaming AI responses in a chat application?

A. It improves monitor resolution
B. It allows responses to appear gradually as they are generated
C. It permanently stores all conversations
D. It disables content filtering


Correct Answer

B. It allows responses to appear gradually as they are generated


Explanation

Streaming improves user experience by showing generated text incrementally instead of waiting for the entire response.


Why the Other Answers Are Incorrect

A. It improves monitor resolution

Streaming does not affect displays.

C. It permanently stores all conversations

Streaming does not automatically store data.

D. It disables content filtering

Streaming does not remove safety controls.


Question 9

Which Responsible AI feature helps reduce harmful or offensive AI-generated responses?

A. Content filtering
B. Data compression
C. Video rendering
D. File indexing


Correct Answer

A. Content filtering


Explanation

Content filters help prevent unsafe or inappropriate AI outputs.


Why the Other Answers Are Incorrect

B. Data compression

Compression reduces file size.

C. Video rendering

Rendering creates visual output.

D. File indexing

Indexing organizes data for search.


Question 10

What are hallucinations in generative AI systems?

A. Hardware overheating events
B. Incorrect or fabricated AI-generated information
C. Authentication failures
D. Video processing delays


Correct Answer

B. Incorrect or fabricated AI-generated information


Explanation

Hallucinations occur when AI models generate inaccurate or invented information.


Why the Other Answers Are Incorrect

A. Hardware overheating events

This is unrelated to AI hallucinations.

C. Authentication failures

This is a security issue.

D. Video processing delays

This relates to media performance, not AI accuracy.


Final Thoughts

Creating lightweight chat applications with the Foundry SDK is an important concept for the AI-901 certification exam. Microsoft expects candidates to understand the basic architecture and workflow of AI-powered chat applications, including prompts, endpoints, authentication, conversation management, and Responsible AI considerations.

Azure AI Foundry and Azure OpenAI Service provide powerful tools that allow developers to build conversational AI experiences quickly and efficiently.


Go to the AI-901 Exam Prep Hub main page

Deploy a model and interact with it in the Foundry Portal (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement generative AI apps and agents by using Foundry
--> Deploy a model and interact with it in the Foundry Portal


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

Microsoft Azure AI Foundry provides a centralized environment for building, testing, deploying, and managing generative AI models and AI-powered applications. For the AI-901 certification exam, candidates should understand the basic process of deploying AI models and interacting with them through the Foundry portal.

This topic focuses on how developers and AI practitioners use Azure AI Foundry to deploy generative AI models, test prompts, configure model settings, and interact with deployed AI endpoints.

This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.


What Is Azure AI Foundry?

Azure AI Foundry is Microsoft’s platform for building and managing AI applications and agents.

Azure AI Foundry provides tools to:

  • Explore AI models
  • Deploy models
  • Test prompts
  • Configure AI behavior
  • Evaluate responses
  • Monitor AI applications
  • Manage AI resources

It supports generative AI development using Azure-hosted AI services and models.


What Does “Deploying a Model” Mean?

Deploying a model means making the AI model available for use.

A deployed model can:

  • Receive prompts
  • Process requests
  • Generate responses
  • Be accessed through applications or APIs

Deployment creates an endpoint that applications can use to interact with the model.


What Is a Model Endpoint?

An endpoint is a network-accessible interface that allows applications or users to communicate with a deployed AI model.

Applications send requests to the endpoint and receive AI-generated responses.


Common Deployment Scenarios

Organizations deploy models for many purposes, including:

  • Chatbots
  • AI assistants
  • Document summarization
  • Content generation
  • Customer support systems
  • Code generation
  • Data extraction

Azure AI Foundry Workflow

A simplified workflow in Azure AI Foundry typically includes:

  1. Create or access an Azure AI resource
  2. Open Azure AI Foundry portal
  3. Select a model
  4. Configure deployment settings
  5. Deploy the model
  6. Test prompts
  7. Interact with the model
  8. Integrate the endpoint into applications

Accessing the Foundry Portal

Users access Azure AI Foundry through a web-based portal.

The portal provides graphical tools for:

  • Model selection
  • Prompt testing
  • Deployment management
  • Performance monitoring

Exploring Available Models

Azure AI Foundry allows users to browse available models.

Examples may include:

  • Large Language Models (LLMs)
  • Image-generation models
  • Embedding models
  • Speech models

Models may vary by:

  • Size
  • Performance
  • Cost
  • Supported capabilities

Selecting a Model

Users choose models based on application requirements.

Factors may include:

  • Accuracy
  • Speed
  • Cost
  • Context window size
  • Multimodal support
  • Language support

Example Scenario

A company building a customer support chatbot may choose a conversational large language model.


Deploying a Model in Foundry

The deployment process usually involves:

  • Selecting a model
  • Naming the deployment
  • Choosing deployment settings
  • Allocating resources
  • Creating the endpoint

Deployment Names

Deployments are typically assigned unique names.

Example

support-chat-model

Applications use deployment names when sending requests.


Model Configuration Options

During deployment, users may configure:

  • Model version
  • Scaling options
  • Authentication settings
  • Content filters
  • Region
  • Resource allocation

Content Filtering and Safety

Azure AI Foundry includes Responsible AI safety features.

Content filtering helps reduce:

  • Harmful outputs
  • Offensive content
  • Unsafe responses

This is important for enterprise AI applications.


Interacting with a Deployed Model

After deployment, users can interact with the model directly within the Foundry portal.

This often includes:

  • Entering prompts
  • Viewing responses
  • Adjusting settings
  • Testing behavior

Playground Interfaces

Azure AI Foundry provides playground environments for experimentation.

Playgrounds allow users to:

  • Test prompts
  • Compare outputs
  • Tune settings
  • Evaluate model behavior

Prompt Testing

Users can experiment with:

  • System prompts
  • User prompts
  • Formatting instructions
  • Role prompting

Prompt testing helps improve AI response quality.


Example Prompt Interaction

User Prompt

“Summarize this customer feedback in three bullet points.”

Model Response

The model generates a summarized response.


Model Parameters

Foundry portals may allow adjustment of model parameters such as:

  • Temperature
  • Maximum tokens
  • Top-p sampling

Temperature

Temperature controls response randomness.

Low TemperatureHigh Temperature
More predictableMore creative
More focusedMore varied

Maximum Tokens

Maximum tokens limit response length.

Smaller limits create shorter responses.


System Prompts in Foundry

Users can configure system prompts to guide AI behavior.


Example System Prompt

“You are a professional technical support assistant. Keep responses concise and helpful.”

System prompts influence:

  • Tone
  • Style
  • Safety
  • Formatting

Evaluating Responses

Users should evaluate AI outputs for:

  • Accuracy
  • Relevance
  • Safety
  • Bias
  • Hallucinations

AI-generated content should be reviewed carefully.


Hallucinations

Generative AI models can produce incorrect or fabricated information.

These incorrect outputs are called hallucinations.

Prompt engineering and grounding techniques help reduce hallucinations.


API Access

Once deployed, applications can connect to the model endpoint using APIs.

This allows developers to integrate AI into applications.


Common Integration Scenarios

Applications may use deployed models for:

  • Chat interfaces
  • Search assistants
  • Document analysis
  • AI copilots
  • Workflow automation

Monitoring and Management

Azure AI Foundry supports monitoring deployed models.

Monitoring may include:

  • Usage tracking
  • Performance analysis
  • Error monitoring
  • Cost management

Scaling AI Deployments

Organizations may scale deployments to support:

  • More users
  • Higher request volumes
  • Faster response times

Cloud-based deployments support elastic scaling.


Responsible AI Considerations

When deploying AI models, organizations should consider:

  • Privacy
  • Security
  • Fairness
  • Transparency
  • Safety
  • Compliance

Generative AI applications should include safeguards against misuse.


Authentication and Security

Deployed models typically require secure authentication.

Security features may include:

  • API keys
  • Identity management
  • Access control

Common Challenges

Organizations may encounter challenges such as:

  • High usage costs
  • Latency
  • Hallucinations
  • Unsafe outputs
  • Poor prompt quality

Proper testing and monitoring are important.


Azure OpenAI Service

Azure OpenAI Service provides access to powerful generative AI models that can be deployed and managed through Azure AI Foundry.


Real-World Scenarios


Scenario 1: Customer Support Chatbot

Goal

Deploy a conversational AI assistant.

Activities

  • Deploy language model
  • Configure system prompts
  • Test responses in the playground

Scenario 2: Internal Knowledge Assistant

Goal

Allow employees to ask questions about company documentation.

Activities

  • Deploy AI model
  • Configure prompts
  • Integrate with enterprise systems

Scenario 3: Marketing Content Generator

Goal

Generate product descriptions automatically.

Activities

  • Deploy generative AI model
  • Test prompt variations
  • Evaluate response quality

Important AI-901 Exam Tips

For the exam, remember these key points:

  • Deploying a model makes it available for use.
  • Deployments create accessible endpoints.
  • Azure AI Foundry provides tools for testing and managing models.
  • Playgrounds allow prompt experimentation.
  • System prompts guide model behavior.
  • Temperature controls creativity and randomness.
  • Maximum tokens control response length.
  • AI outputs should be evaluated for accuracy and safety.
  • Content filtering supports Responsible AI practices.
  • APIs allow applications to connect to deployed models.

Quick Knowledge Check

Question 1

What does deploying a model do?

Answer

It makes the AI model available for use through an endpoint.


Question 2

What is the purpose of a playground in Azure AI Foundry?

Answer

To test prompts and interact with deployed models.


Question 3

What does the temperature setting control?

Answer

The randomness and creativity of model responses.


Question 4

Why are content filters important?

Answer

They help reduce harmful or unsafe AI-generated outputs.


Practice Exam Questions

Question 1

What is the PRIMARY purpose of deploying an AI model?

A. To permanently delete the model
B. To make the model available for use through an endpoint
C. To compress training data
D. To convert images into text


Correct Answer

B. To make the model available for use through an endpoint


Explanation

Deploying a model makes it accessible so applications and users can interact with it.


Why the Other Answers Are Incorrect

A. To permanently delete the model

Deployment does not delete models.

C. To compress training data

Deployment is unrelated to data compression.

D. To convert images into text

This describes OCR.


Question 2

What is an endpoint in the context of AI model deployment?

A. A physical server room
B. A network-accessible interface for interacting with a deployed model
C. A type of database backup
D. A computer vision algorithm


Correct Answer

B. A network-accessible interface for interacting with a deployed model


Explanation

Endpoints allow applications and users to send requests to deployed AI models and receive responses.


Why the Other Answers Are Incorrect

A. A physical server room

Endpoints are logical interfaces, not physical locations.

C. A type of database backup

This is unrelated to AI deployment.

D. A computer vision algorithm

Endpoints are not algorithms.


Question 3

Which Azure tool provides playgrounds for testing prompts and interacting with deployed AI models?

A. Azure SQL Database
B. Azure AI Foundry
C. Microsoft Excel
D. Azure Virtual Desktop


Correct Answer

B. Azure AI Foundry


Explanation

Azure AI Foundry provides tools for model deployment, prompt testing, evaluation, and management.


Why the Other Answers Are Incorrect

A. Azure SQL Database

This is a database service.

C. Microsoft Excel

Excel is not an AI deployment platform.

D. Azure Virtual Desktop

This provides desktop virtualization services.


Question 4

What is the PRIMARY purpose of a playground in Azure AI Foundry?

A. Hosting multiplayer games
B. Experimenting with prompts and testing model behavior
C. Managing employee payroll
D. Compressing image files


Correct Answer

B. Experimenting with prompts and testing model behavior


Explanation

Playgrounds allow users to interact with models, test prompts, and evaluate responses.


Why the Other Answers Are Incorrect

A. Hosting multiplayer games

This is unrelated to AI Foundry.

C. Managing employee payroll

This is unrelated to AI development.

D. Compressing image files

Playgrounds are not image utilities.


Question 5

Which configuration setting controls how creative or random AI-generated responses are?

A. OCR level
B. Temperature
C. Resolution scaling
D. Data indexing


Correct Answer

B. Temperature


Explanation

Temperature controls randomness and creativity in generative AI responses.


Why the Other Answers Are Incorrect

A. OCR level

OCR extracts text from images.

C. Resolution scaling

This relates to images, not text generation randomness.

D. Data indexing

Indexing is unrelated to generative response creativity.


Question 6

What is the effect of setting a lower temperature value in a generative AI model?

A. More random responses
B. More predictable and focused responses
C. Faster internet speeds
D. Larger image generation sizes


Correct Answer

B. More predictable and focused responses


Explanation

Lower temperature settings reduce randomness and produce more deterministic outputs.


Why the Other Answers Are Incorrect

A. More random responses

Higher temperatures increase randomness.

C. Faster internet speeds

Temperature does not affect networking.

D. Larger image generation sizes

Temperature is unrelated to image dimensions.


Question 7

Which prompt type defines the AI assistant’s behavior, tone, and rules?

A. User prompt
B. System prompt
C. SQL query
D. OCR prompt


Correct Answer

B. System prompt


Explanation

System prompts provide high-level behavioral instructions to the AI model.


Why the Other Answers Are Incorrect

A. User prompt

User prompts specify tasks or requests.

C. SQL query

SQL queries interact with databases.

D. OCR prompt

OCR is unrelated to conversational AI behavior.


Question 8

Why are content filters important when deploying generative AI models?

A. They improve internet bandwidth
B. They help reduce harmful or unsafe outputs
C. They increase monitor resolution
D. They replace system prompts entirely


Correct Answer

B. They help reduce harmful or unsafe outputs


Explanation

Content filtering supports Responsible AI by helping prevent harmful or inappropriate AI-generated content.


Why the Other Answers Are Incorrect

A. They improve internet bandwidth

Content filters do not affect networking performance.

C. They increase monitor resolution

This is unrelated to AI safety.

D. They replace system prompts entirely

Content filters complement prompts; they do not replace them.


Question 9

What are hallucinations in generative AI?

A. Physical hardware failures
B. Incorrect or fabricated AI-generated information
C. Database replication errors
D. Unauthorized user logins


Correct Answer

B. Incorrect or fabricated AI-generated information


Explanation

Hallucinations occur when AI generates inaccurate or invented information.


Why the Other Answers Are Incorrect

A. Physical hardware failures

This is unrelated to AI hallucinations.

C. Database replication errors

This is a database issue.

D. Unauthorized user logins

This is a security issue.


Question 10

After deploying a model, how do external applications typically interact with it?

A. Through handwritten forms
B. Through APIs connected to the deployment endpoint
C. Through spreadsheet imports only
D. Through local USB connections


Correct Answer

B. Through APIs connected to the deployment endpoint


Explanation

Applications commonly communicate with deployed AI models using APIs and endpoints.


Why the Other Answers Are Incorrect

A. Through handwritten forms

This is unrelated to AI deployment.

C. Through spreadsheet imports only

Spreadsheets are not the primary integration mechanism.

D. Through local USB connections

Cloud AI services typically use network-based APIs, not USB connections.


Final Thoughts

Deploying and interacting with AI models in Azure AI Foundry is an important skill area for the AI-901 certification exam. Microsoft expects candidates to understand the basic deployment workflow, prompt testing process, model configuration options, and Responsible AI considerations involved in building generative AI applications.

Azure AI Foundry simplifies AI development by providing a centralized environment for deploying, testing, and managing AI models and agents.


Go to the AI-901 Exam Prep Hub main page

Practice Questions: Describe Features and Capabilities of Azure AI Foundry (AI-900 Exam Prep)

Practice Questions


Question 1

What is the primary purpose of Azure AI Foundry?

A. To provide pre-trained computer vision models only
B. To host virtual machines for AI workloads
C. To provide a unified platform for building, customizing, and managing generative AI solutions
D. To replace Azure Machine Learning

Correct Answer: C

Explanation:
Azure AI Foundry is a unified platform designed to help teams build, customize, deploy, and manage generative AI applications at scale. It does not replace Azure ML but complements it.


Question 2

Which capability of Azure AI Foundry allows organizations to compare and select the most appropriate model for a specific use case?

A. Role-Based Access Control (RBAC)
B. Model catalog and benchmarking
C. Azure Monitor integration
D. Speech synthesis APIs

Correct Answer: B

Explanation:
Azure AI Foundry includes a model catalog with tools to compare and benchmark multiple models, helping teams choose the best model based on performance, cost, or task suitability.


Question 3

A development team wants to create an AI system that can autonomously perform tasks and collaborate with other AI components. Which Azure AI Foundry capability supports this scenario?

A. Image classification
B. Agent orchestration
C. Text analytics
D. Speech recognition

Correct Answer: B

Explanation:
Azure AI Foundry supports AI agents and multi-agent workflows, enabling autonomous task execution and collaboration across agents.


Question 4

Which feature makes Azure AI Foundry suitable for enterprise environments?

A. Open-source licensing
B. Built-in gaming engines
C. Governance, monitoring, and role-based access controls
D. Support for only a single AI model

Correct Answer: C

Explanation:
Enterprise readiness comes from security, governance, RBAC, monitoring, and compliance controls, all of which are core features of Azure AI Foundry.


Question 5

Which task can be performed using Azure AI Foundry?

A. Only training custom neural networks from scratch
B. Managing physical AI hardware
C. Fine-tuning generative AI models for domain-specific use cases
D. Replacing Azure App Service

Correct Answer: C

Explanation:
Azure AI Foundry allows fine-tuning and optimization of generative AI models to adapt them to specific business or domain requirements.


Question 6

What stage of the AI lifecycle is supported by Azure AI Foundry?

A. Only model training
B. Only deployment
C. Only monitoring
D. The full lifecycle from experimentation to production and monitoring

Correct Answer: D

Explanation:
Azure AI Foundry supports the entire AI lifecycle, including experimentation, development, deployment, monitoring, and continuous improvement.


Question 7

Which scenario best matches the use of Azure AI Foundry?

A. Classifying images of animals
B. Translating text between languages
C. Building an enterprise chatbot that uses multiple AI models and enforces governance
D. Running batch SQL queries

Correct Answer: C

Explanation:
Azure AI Foundry is designed for complex generative AI scenarios, such as enterprise chatbots that require multiple models, orchestration, and governance.


Question 8

How does Azure AI Foundry integrate with other Azure services?

A. It operates completely independently
B. It only integrates with Azure OpenAI
C. It integrates with services like Azure App Service, Cosmos DB, and Logic Apps
D. It replaces all other Azure AI services

Correct Answer: C

Explanation:
Azure AI Foundry integrates deeply with the Azure ecosystem, allowing generative AI solutions to be embedded into broader applications and workflows.


Question 9

Which feature helps control access and usage of AI resources in Azure AI Foundry?

A. Prompt engineering
B. Role-Based Access Control (RBAC)
C. Image tagging
D. Speech transcription

Correct Answer: B

Explanation:
RBAC ensures that users and teams only have access to the resources and actions they are authorized to use, supporting secure enterprise deployments.


Question 10

On the AI-900 exam, when should you select Azure AI Foundry as the correct answer?

A. When the question focuses on basic image processing
B. When the question mentions simple sentiment analysis
C. When the scenario describes building, managing, and governing generative AI applications at scale
D. When the question requires only translation services

Correct Answer: C

Explanation:
Azure AI Foundry is the best choice when the scenario involves enterprise-scale generative AI, including model selection, agents, lifecycle management, and governance.


Quick Exam Summary

If the question mentions:

  • Generative AI
  • Multiple models
  • Agents or workflows
  • Enterprise governance
  • End-to-end AI lifecycle

👉 Think: Azure AI Foundry


Go to the AI-900 Exam Prep Hub main page.

Describe Features and Capabilities of Azure AI Foundry (AI-900 Exam Prep)

What Is Azure AI Foundry?

Azure AI Foundry — now commonly referred to as Microsoft Foundry — is a unified Azure platform for developing, managing, and scaling enterprise-grade generative AI applications. It brings together models, tools, governance, and infrastructure into a single, interoperable environment, making it easier for teams to build, deploy, and operate AI apps and agents securely and consistently.

For AI-900 purposes, think of Foundry as a comprehensive hub for generative AI development on Azure — far beyond just model hosting — that enables rapid innovation with governance and enterprise readiness built in.


Core Capabilities of Azure AI Foundry

📌 1. Unified AI Development Platform

Foundry provides a single platform for AI teams and developers to:

  • Explore and compare a broad catalog of foundational models
  • Build, test, and customize generative AI solutions
  • Monitor and refine models over time

This reduces complexity and streamlines workflows compared with managing disparate tools.


🧠 2. Vast Model Catalog & Interoperability

Foundry gives access to thousands of models from multiple sources:

  • Frontier and open models from Microsoft
  • Models from OpenAI
  • Third-party models (e.g., Meta, Mistral)
  • Partner and community models

Teams can benchmark and compare models for specific tasks before selecting one for production.


⚙️ 3. Customization and Optimization

Foundry provides tools to help you:

  • Fine-tune models for specific domain needs
  • Distill or upgrade models to improve quality or reduce cost
  • Route workloads to the best performing model for a given request

Automated routing helps balance performance vs cost in production AI applications.


🤖 4. Build Agents and Intelligent Workflows

With Foundry, developers can build:

  • AI agents that perform tasks autonomously
  • Multi-agent systems where agents collaborate to solve complex problems
  • RPA-like automation and AI-driven business logic

These agents can be integrated into apps, bots, or workflow systems to respond, act, and collaborate with users.


🔐 5. Enterprise-Ready Governance and Security

Foundry includes enterprise-grade tools to manage:

  • Role-Based Access Control (RBAC)
  • Monitoring, logging, and audit trails
  • Secure access and isolation between teams
  • Compliance with organizational policies

This makes it suitable for large teams and critical use cases.


🛠 6. Integrated Tools and Templates

Foundry includes:

  • Pre-built solution templates for common AI patterns (e.g., Q&A bots, document assistants)
  • SDKs and APIs for Python, C#, and other languages
  • IDE integrations (e.g., Visual Studio Code extensions)

These accelerate development and reduce the learning curve.


🔄 7. End-to-End Lifecycle Support

Foundry supports the full AI project lifecycle:

  • Experimentation with models
  • Development of applications or workflows
  • Testing and evaluation
  • Deployment to production
  • Monitoring and refinement for optimization

This means teams can start with prototypes and scale seamlessly.


🧩 8. Integration with Azure Ecosystem

Foundry is not limited to AI models — it integrates with other Azure services, such as:

  • Azure App Service
  • Azure Container Apps
  • Azure Cosmos DB
  • Azure Logic Apps
  • Microsoft 365 and Teams

This allows generative AI features to be embedded into broader enterprise systems.


Scenarios Where Azure AI Foundry Is Used

Foundry supports many generative AI workloads, including:

  • Conversational agents and bots
  • Knowledge-powered search and assistants
  • Context-aware automation
  • Enterprise RAG (Retrieval-Augmented Generation)
  • AI-powered workflows and multi-agent orchestration

Its focus on flexibility and scale makes it suitable for both prototyping and enterprise production.


How Foundry Relates to Other Azure Generative AI Services

CapabilityAzure AI FoundryOther Azure Services
Model hosting & comparisonAzure OpenAI / Azure AI services
Multi-model catalogIndividual service catalogs
Fine-tuning & optimizationAzure Machine Learning
Build agents & workflowsAzure AI Language / Bots
Governance & enterprise featuresCore Azure security services
Rapid prototyping templatesIndividual service templates

Foundry’s value is in bringing these capabilities together into a unified platform.


Exam Tips for AI-900

  • Foundry is the answer when a question describes building, customizing, and governing enterprise generative AI solutions at scale.
  • It is not just a model API, but a platform for development, deployment, and lifecycle management of generative AI apps.
  • If a question mentions agents, workflows, integrated governance, or multi-model support for generative workloads, think Azure AI Foundry / Microsoft Foundry.

Key Takeaways

  • Azure AI Foundry (Microsoft Foundry) is a unified enterprise AI platform for generative AI development on Azure.
  • It provides model catalogs, customization, development tools, agents, governance, and integrations.
  • It supports the full AI application lifecycle — from prototype to production.
  • It integrates deeply with the Azure ecosystem and supports enterprise-grade governance and security.

Go to the Practice Exam Questions for this topic.

Go to the AI-900 Exam Prep Hub main page.

Practice Questions: Describe features and capabilities of Azure AI Foundry model catalog (AI-900 Exam Prep)

Practice Questions


Question 1

What is the primary purpose of the Azure AI Foundry model catalog?

A. To store training datasets for Azure Machine Learning
B. To centrally discover, compare, and deploy AI models
C. To monitor AI model performance in production
D. To automatically fine-tune all deployed models

Correct Answer: B

Explanation:
The Azure AI Foundry model catalog is a centralized repository that allows users to discover, evaluate, compare, and deploy AI models from Microsoft and partner providers. It is not primarily used for dataset storage or monitoring.


Question 2

Which types of models are available in the Azure AI Foundry model catalog?

A. Only Microsoft-built models
B. Only open-source community models
C. Models from Microsoft and multiple third-party providers
D. Only models trained within Azure Machine Learning

Correct Answer: C

Explanation:
The model catalog includes models from Microsoft, OpenAI, Meta, Anthropic, Cohere, and other partners, giving users access to a diverse range of generative and AI models.


Question 3

Which feature helps users compare models within the Azure AI Foundry model catalog?

A. Azure Cost Management
B. Model leaderboards and benchmarking
C. AutoML pipelines
D. Feature engineering tools

Correct Answer: B

Explanation:
The model catalog includes leaderboards and benchmark metrics, allowing users to compare models based on performance characteristics and suitability for specific tasks.


Question 4

What information is typically included in a model card in the Azure AI Foundry model catalog?

A. Only pricing details
B. Only deployment scripts
C. Metadata such as capabilities, limitations, and licensing
D. Only training dataset information

Correct Answer: C

Explanation:
Model cards provide descriptive metadata, including model purpose, supported tasks, licensing terms, and usage considerations, helping users make informed decisions.


Question 5

Which deployment option allows you to consume a model without managing infrastructure?

A. Managed compute
B. Dedicated virtual machines
C. Serverless API deployment
D. On-premises deployment

Correct Answer: C

Explanation:
Serverless API deployment (Models-as-a-Service) allows users to call models via APIs without managing underlying infrastructure, making it ideal for rapid development and scalability.


Question 6

What is a key benefit of having search and filtering in the model catalog?

A. It automatically selects the best model
B. It restricts models to one provider
C. It helps users quickly find models that match specific needs
D. It enforces Responsible AI policies

Correct Answer: C

Explanation:
Search and filtering features allow users to narrow down models based on capabilities, provider, task type, and deployment options, speeding up model selection.


Question 7

Which AI workload is the Azure AI Foundry model catalog most closely associated with?

A. Traditional rule-based automation
B. Predictive analytics dashboards
C. Generative AI solutions
D. Network security monitoring

Correct Answer: C

Explanation:
The model catalog is a core capability supporting generative AI workloads, such as text generation, chat, summarization, and multimodal applications.


Question 8

Why might an organization choose managed compute instead of a serverless API deployment?

A. To avoid version control
B. To reduce accuracy
C. To gain more control over performance and resources
D. To eliminate licensing requirements

Correct Answer: C

Explanation:
Managed compute provides greater control over performance, scaling, and resource allocation, which can be important for predictable workloads or specialized use cases.


Question 9

Which scenario best illustrates the use of the Azure AI Foundry model catalog?

A. Writing SQL queries for data analysis
B. Comparing multiple large language models before deployment
C. Creating Power BI dashboards
D. Training image classification models from scratch

Correct Answer: B

Explanation:
The model catalog is designed to help users evaluate and compare models before deploying them into generative AI applications.


Question 10

For the AI-900 exam, which statement best describes the Azure AI Foundry model catalog?

A. A low-level training engine for custom neural networks
B. A centralized hub for discovering and deploying AI models
C. A compliance auditing tool
D. A replacement for Azure Machine Learning

Correct Answer: B

Explanation:
For AI-900, the key takeaway is that the model catalog acts as a central hub that simplifies model discovery, comparison, and deployment within Azure’s generative AI ecosystem.


🔑 Exam Tip

If an AI-900 question mentions:

  • Choosing between multiple generative models
  • Evaluating model performance or benchmarks
  • Using models from different providers in Azure

👉 The correct answer is very likely related to the Azure AI Foundry model catalog.


Go to the AI-900 Exam Prep Hub main page.

Describe features and capabilities of Azure AI Foundry model catalog (AI-900 Exam Prep)

What Is the Azure AI Foundry Model Catalog?

The Azure AI Foundry model catalog (also known as Microsoft Foundry Models) is a centralized, searchable repository of AI models that developers and organizations can use to build generative AI solutions on Azure. It contains hundreds to thousands of models from multiple providers — including Microsoft, OpenAI, Anthropic, Meta, Cohere, DeepSeek, NVIDIA, and more — and provides tools to explore, compare, and deploy them for various AI workloads.

The model catalog is a key feature of Azure AI Foundry because it lets teams discover and evaluate the right models for specific tasks before integrating them into applications.


Key Capabilities of the Model Catalog

🌐 1. Wide and Diverse Model Selection

The catalog includes a broad set of models, such as:

  • Large language models (LLMs) for text generation and chat
  • Domain-specific models for legal, medical, or industry tasks
  • Multimodal models that handle text + images
  • Reasoning and specialized task models
    These models come from multiple providers including Microsoft, OpenAI, Anthropic, Meta, Mistral AI, and more.

This diversity ensures that developers can find models that fit a wide range of use cases, from simple text completion to advanced multi-agent workflows.


🔍 2. Search and Filtering Tools

The model catalog provides tools to help you find the right model by:

  • Keyword search
  • Provider and collection filters
  • Filtering by capabilities (e.g., reasoning, tool calling)
  • Deployment type (e.g., serverless API vs managed compute)
  • Inference and fine-tune task types
  • Industry or domain tags

These filters make it easier to match models to specific AI workloads.


📊 3. Comparison and Benchmarking

The catalog includes features like:

  • Model performance leaderboards
  • Benchmark metrics for selected models
  • Side-by-side comparison tools

This lets organizations evaluate and compare models based on real-world performance metrics before deployment.

This is especially useful when choosing between models for accuracy, cost, or task suitability.


📄 4. Model Cards with Metadata

Each model in the catalog has a model card that provides:

  • Quick facts about the model
  • A description
  • Version and supported data types
  • Licenses and legal information
  • Benchmark results (if available)
  • Deployment status and options

Model cards help users understand model capabilities, constraints, and appropriate use cases.


🚀 5. Multiple Deployment Options

Models in the Foundry catalog can be deployed using:

  • Serverless API: A “Models as a Service” approach where the model is hosted and managed by Azure, and you pay per API call
  • Managed compute: Dedicated virtual machines for predictable performance and long-running applications

This gives teams flexibility in choosing cost and performance trade-offs.


⚙️ 6. Integration and Customization

The model catalog isn’t just for discovery — it also supports:

  • Fine-tuning of models based on your data
  • Custom deployments within your enterprise environment
  • Integration with other Azure tools and services, like Azure AI Foundry deployment workflows and AI development tooling

This makes the catalog a foundational piece of end-to-end generative AI development on Azure.


Model Categories in the Catalog

The model catalog is organized into key categories such as:

  • Models sold directly by Azure: Models hosted and supported by Microsoft with enterprise-grade integration, support, and compliant terms.
  • Partner and community models: Models developed by external organizations like OpenAI, Anthropic, Meta, or Cohere. These often extend capabilities or offer domain-specific strengths.

This structure helps teams select between fully supported enterprise models and innovative third-party models.


Scenarios Where You Would Use the Model Catalog

The Azure AI Foundry model catalog is especially useful when:

  • Exploring models for text generation, chat, summarization, or reasoning
  • Comparing multiple models for accuracy vs cost
  • Deploying models in different formats (serverless API vs compute)
  • Integrating models from multiple providers in a single AI pipeline

It is a central discovery and evaluation hub for generative AI on Azure.


How This Relates to AI-900

For the AI-900 exam, you should understand:

  • The model catalog is a core capability of Azure AI Foundry
  • It allows discovering, comparing, and deploying models
  • It supports multiple model providers
  • It offers deployment options and metadata to guide selection

If a question mentions finding the right generative model for a use case, evaluating model performance, or using a variety of models in Azure, then the Azure AI Foundry model catalog is likely being described.


Summary (Exam Highlights)

  • Azure AI Foundry model catalog provides discoverability for thousands of AI models.
  • Models can be filtered, compared, and evaluated.
  • Catalog entries include useful metadata (model cards) and benchmarking.
  • Models come from Microsoft and partner providers like OpenAI, Anthropic, Meta, etc.
  • Deployment options vary between serverless APIs and managed compute.

Go to the Practice Exam Questions for this topic.

Go to the AI-900 Exam Prep Hub main page.