Create and test a single-agent solution in the Foundry Portal (AI-901 Exam Prep)

This post is a part of the AI-901: Microsoft Azure AI Fundamentals Exam Prep Hub. 
This topic falls under these sections:
Implement AI solutions by using Microsoft Foundry (55–60%)
--> Implement generative AI apps and agents by using Foundry
--> Create and test a single-agent solution in the Foundry Portal


Note that there are 10 practice questions (with answers and explanations) for each section to help you solidify your knowledge of the material. Also, there are 2 practice tests with 60 questions each available on the hub below the exam topics section.

AI agents are an increasingly important part of modern AI applications. Microsoft Azure AI Foundry provides tools that allow developers to create, configure, test, and manage AI agents directly within the Foundry portal.

For the AI-901 certification exam, candidates should understand the basic concepts behind creating and testing a single-agent AI solution using Azure AI Foundry.

This topic falls under the “Implement generative AI apps and agents by using Foundry” section of the AI-901 exam objectives.


What Is an AI Agent?

An AI agent is an AI-powered system designed to perform tasks, answer questions, and interact with users autonomously or semi-autonomously.

Agents often use:

  • Large Language Models (LLMs)
  • Prompt engineering
  • External tools
  • Memory
  • Data sources

to complete tasks.


What Is a Single-Agent Solution?

A single-agent solution uses one AI agent to manage interactions and tasks.

The agent receives input, processes requests, and generates responses.


Examples of Single-Agent Solutions

Common examples include:

  • Customer support assistants
  • FAQ bots
  • IT help desk assistants
  • Educational tutors
  • Internal knowledge assistants

AI Agent vs. Traditional Chatbot

Traditional ChatbotAI Agent
Often rule-basedAI-driven reasoning
Limited flexibilityMore adaptive
Predefined responsesDynamic responses
Basic workflowsCan perform complex tasks

Azure AI Foundry

Azure AI Foundry provides tools for creating and managing AI agents and generative AI applications.

The portal allows developers to:

  • Configure agents
  • Test prompts
  • Connect models
  • Evaluate responses
  • Monitor behavior

Basic Components of a Single-Agent Solution

A single-agent solution often includes:

  • AI model
  • System instructions
  • User interaction interface
  • Memory/context handling
  • Optional tools or data connections

AI Models in Agents

Agents typically use generative AI models such as large language models.

The model processes prompts and generates responses.


System Instructions

System instructions define how the agent should behave.

These instructions influence:

  • Tone
  • Personality
  • Safety
  • Response style
  • Allowed behavior

Example System Instruction

“You are a professional customer support assistant. Provide concise and helpful answers.”


User Prompts

Users interact with the agent by entering prompts or questions.


Example User Prompt

“How do I reset my password?”


Context and Memory

Many agents maintain conversational context.

This allows the agent to remember previous interactions during a session.


Example

User

“Tell me about Azure AI.”

User Later

“Can it support chatbots?”

The agent remembers the conversation topic.


Creating a Single-Agent Solution in Foundry

The general workflow includes:

  1. Open Azure AI Foundry
  2. Create or select a project
  3. Choose an AI model
  4. Configure the agent
  5. Define system instructions
  6. Test the agent
  7. Refine prompts and settings

Selecting a Model

Developers choose a model based on:

  • Performance
  • Cost
  • Speed
  • Language support
  • Context window size

Configuring the Agent

Agent configuration may include:

  • Name
  • Instructions
  • Model selection
  • Safety settings
  • Tool connections

Testing the Agent

The Foundry portal allows interactive testing.

Users can:

  • Enter prompts
  • Review responses
  • Adjust settings
  • Refine instructions

Playground Testing

Foundry includes playground environments for experimentation.

Developers can test:

  • Prompt quality
  • Tone
  • Accuracy
  • Context handling

before deploying applications.


Example Testing Scenario

System Instruction

“You are a helpful study assistant.”

User Prompt

“Explain supervised learning.”

The agent generates a response according to its instructions.


Prompt Engineering for Agents

Effective prompts improve agent behavior.

Helpful techniques include:

  • Clear instructions
  • Specific tasks
  • Output formatting
  • Context inclusion

Model Parameters

Developers may configure model settings such as:

  • Temperature
  • Maximum tokens
  • Top-p sampling

Temperature

Temperature controls response creativity.

Low TemperatureHigh Temperature
More predictableMore creative
More focusedMore varied

Maximum Tokens

Maximum tokens limit response length.

Lower values create shorter responses.


Tool Integration

Some agents can connect to external tools or data sources.

Examples include:

  • Databases
  • Search systems
  • APIs
  • Knowledge bases

Example Tool Usage

An IT support agent may retrieve information from a company knowledge base.


Grounding

Grounding connects AI responses to trusted data sources.

Grounded responses are generally more accurate and reliable.


Hallucinations

AI agents may occasionally produce incorrect or fabricated information.

These errors are called hallucinations.

Testing and grounding help reduce hallucinations.


Responsible AI Considerations

Single-agent solutions should follow Responsible AI principles.

Important considerations include:

  • Fairness
  • Privacy
  • Security
  • Transparency
  • Safety
  • Accountability

Content Filtering

Content filtering helps reduce:

  • Harmful outputs
  • Offensive content
  • Unsafe instructions

Authentication and Access Control

Organizations should secure access to AI agents using:

  • API keys
  • Identity management
  • Role-based access controls

Monitoring and Evaluation

Organizations should monitor agents for:

  • Accuracy
  • Performance
  • Bias
  • Safety
  • Usage patterns

Common Real-World Use Cases


Scenario 1: Customer Support Agent

Goal

Answer customer questions automatically.

Capabilities

  • Conversational responses
  • Knowledge retrieval
  • Escalation guidance

Scenario 2: Educational Tutor

Goal

Help students learn technical concepts.

Capabilities

  • Step-by-step explanations
  • Personalized tutoring
  • Interactive Q&A

Scenario 3: Internal Company Assistant

Goal

Help employees find company information.

Capabilities

  • Policy lookup
  • Document summarization
  • Search assistance

Advantages of Single-Agent Solutions

Benefits include:

  • Simpler architecture
  • Easier management
  • Faster deployment
  • Lower complexity
  • Natural interactions

Limitations of Single-Agent Solutions

Challenges may include:

  • Limited specialization
  • Hallucinations
  • Context limitations
  • Dependency on prompt quality

More complex systems may require multiple agents.


Single-Agent vs. Multi-Agent Systems

Single-AgentMulti-Agent
One agent handles tasksMultiple specialized agents
Simpler designMore complex
Easier managementBetter specialization
Lower overheadGreater coordination

Important AI-901 Exam Tips

For the exam, remember these key points:

  • AI agents use generative AI models to interact with users.
  • A single-agent solution uses one agent for interactions and tasks.
  • Azure AI Foundry provides tools for creating and testing agents.
  • System instructions guide agent behavior.
  • User prompts define tasks and questions.
  • Playground environments allow interactive testing.
  • Temperature controls creativity.
  • Grounding improves reliability.
  • Hallucinations are incorrect AI-generated outputs.
  • Responsible AI principles apply to AI agents.

Quick Knowledge Check

Question 1

What is a single-agent solution?

Answer

An AI system that uses one agent to process interactions and tasks.


Question 2

What is the purpose of system instructions?

Answer

To guide agent behavior, tone, and safety.


Question 3

What does grounding help improve?

Answer

Accuracy and reliability of AI responses.


Question 4

What are hallucinations?

Answer

Incorrect or fabricated AI-generated information.


Practice Exam Questions

Question 1

What is a single-agent solution?

A. A system that uses multiple AI agents simultaneously
B. A system that uses one AI agent to handle interactions and tasks
C. A database clustering solution
D. A networking security appliance


Correct Answer

B. A system that uses one AI agent to handle interactions and tasks


Explanation

A single-agent solution uses one AI-powered agent to process user requests and generate responses.


Why the Other Answers Are Incorrect

A. A system that uses multiple AI agents simultaneously

This describes a multi-agent system.

C. A database clustering solution

This is unrelated to AI agents.

D. A networking security appliance

This is unrelated to AI systems.


Question 2

Which Microsoft platform provides tools for creating and testing AI agents?

A. Microsoft Word
B. Azure AI Foundry
C. Microsoft Paint
D. Azure Virtual Desktop


Correct Answer

B. Azure AI Foundry


Explanation

Azure AI Foundry provides tools for building, testing, configuring, and managing AI agents and generative AI applications.


Why the Other Answers Are Incorrect

A. Microsoft Word

Word is a document editor.

C. Microsoft Paint

Paint is a graphics application.

D. Azure Virtual Desktop

This provides virtual desktop infrastructure services.


Question 3

What is the PRIMARY purpose of system instructions in an AI agent?

A. To physically store AI models
B. To define the agent’s behavior, tone, and rules
C. To improve monitor resolution
D. To compress training data


Correct Answer

B. To define the agent’s behavior, tone, and rules


Explanation

System instructions guide how the AI agent behaves and responds to users.


Why the Other Answers Are Incorrect

A. To physically store AI models

System instructions do not store models.

C. To improve monitor resolution

This is unrelated to AI agents.

D. To compress training data

This is unrelated to prompting.


Question 4

Which statement BEST describes grounding in AI systems?

A. Permanently deleting unused prompts
B. Connecting AI responses to trusted data sources
C. Increasing image brightness automatically
D. Compressing API requests


Correct Answer

B. Connecting AI responses to trusted data sources


Explanation

Grounding improves reliability by helping AI generate responses based on trusted information.


Why the Other Answers Are Incorrect

A. Permanently deleting unused prompts

This is unrelated to grounding.

C. Increasing image brightness automatically

This is unrelated to generative AI.

D. Compressing API requests

Grounding is unrelated to network compression.


Question 5

What is the PRIMARY purpose of playground testing in Azure AI Foundry?

A. Managing payroll systems
B. Experimenting with prompts and evaluating AI responses
C. Compressing video files
D. Managing physical servers


Correct Answer

B. Experimenting with prompts and evaluating AI responses


Explanation

Playgrounds allow developers to interactively test prompts, instructions, and AI behavior.


Why the Other Answers Are Incorrect

A. Managing payroll systems

This is unrelated to AI Foundry.

C. Compressing video files

Playgrounds are not media tools.

D. Managing physical servers

Playgrounds focus on AI interaction and testing.


Question 6

Which parameter controls how creative or random an AI agent’s responses will be?

A. Temperature
B. OCR threshold
C. Pixel density
D. Frame rate


Correct Answer

A. Temperature


Explanation

Temperature controls randomness and creativity in generated responses.


Why the Other Answers Are Incorrect

B. OCR threshold

This relates to text extraction from images.

C. Pixel density

This relates to image quality.

D. Frame rate

This relates to video playback.


Question 7

What are hallucinations in generative AI systems?

A. Hardware failures in cloud servers
B. Incorrect or fabricated AI-generated information
C. Authentication timeouts
D. Network bandwidth limitations


Correct Answer

B. Incorrect or fabricated AI-generated information


Explanation

Hallucinations occur when AI systems generate false or invented information.


Why the Other Answers Are Incorrect

A. Hardware failures in cloud servers

This is unrelated to hallucinations.

C. Authentication timeouts

This is a security or networking issue.

D. Network bandwidth limitations

This is unrelated to AI-generated accuracy.


Question 8

Why is conversation context important in AI agents?

A. It increases monitor resolution
B. It helps the agent remember previous interactions during a session
C. It permanently stores training datasets
D. It reduces internet costs


Correct Answer

B. It helps the agent remember previous interactions during a session


Explanation

Conversation context allows the AI agent to generate more coherent and relevant responses across multiple prompts.


Why the Other Answers Are Incorrect

A. It increases monitor resolution

Context does not affect displays.

C. It permanently stores training datasets

Context is session-related, not training storage.

D. It reduces internet costs

Context does not directly affect networking costs.


Question 9

Which Responsible AI feature helps reduce harmful or offensive AI-generated outputs?

A. Content filtering
B. Image compression
C. Database replication
D. Spreadsheet formatting


Correct Answer

A. Content filtering


Explanation

Content filtering helps block unsafe or inappropriate AI-generated responses.


Why the Other Answers Are Incorrect

B. Image compression

This reduces file size.

C. Database replication

This copies database data.

D. Spreadsheet formatting

This is unrelated to AI safety.


Question 10

What is one advantage of a single-agent solution compared to a multi-agent system?

A. Greater architectural complexity
B. Easier management and simpler design
C. Requires no prompts
D. Eliminates all hallucinations


Correct Answer

B. Easier management and simpler design


Explanation

Single-agent solutions are generally simpler to configure, deploy, and manage.


Why the Other Answers Are Incorrect

A. Greater architectural complexity

Multi-agent systems are usually more complex.

C. Requires no prompts

AI agents still rely on prompts and instructions.

D. Eliminates all hallucinations

Hallucinations can still occur in single-agent systems.


Final Thoughts

Creating and testing single-agent solutions in Azure AI Foundry is an important topic for the AI-901 certification exam. Microsoft expects candidates to understand the core concepts behind AI agents, prompt configuration, testing workflows, grounding, and Responsible AI practices.

Azure AI Foundry provides an accessible environment for building and experimenting with conversational AI agents that can support a wide variety of real-world business scenarios.


Go to the AI-901 Exam Prep Hub main page

One thought on “Create and test a single-agent solution in the Foundry Portal (AI-901 Exam Prep)”

Leave a comment