Tag: Azure OpenAI

AI, AI-900, Artificial Intelligence (AI), Microsoft Certification, Natural Language Processing (NLP)

Identify Features and Uses for Language Modeling (AI-900 Exam Prep)

Overview

Language modeling is a core concept in Natural Language Processing (NLP) that focuses on enabling machines to understand, generate, and predict human language. In the context of the AI-900 exam, language modeling is not about building models from scratch, but about recognizing what language models do, what problems they solve, and how Azure provides access to them.

Language models power many modern AI experiences, including chatbots, text generation, summarization, translation, and question answering.

What Is a Language Model?

A language model is a type of AI model that learns patterns in language so it can:

  • Predict the next word or token in a sequence
  • Understand context and meaning
  • Generate coherent and contextually relevant text

At a fundamental level, language models calculate the probability of word sequences, which allows them to both interpret and generate language.

Key Features of Language Modeling

1. Text Prediction and Generation

Language models can:

  • Predict the next word in a sentence
  • Generate full sentences, paragraphs, or documents
  • Produce human-like responses in conversations

Example:

“The weather today is very…” → sunny

2. Context Awareness

Modern language models (especially transformer-based models) consider context, not just individual words.

This allows them to:

  • Understand sentence meaning
  • Maintain coherence across multiple sentences
  • Respond appropriately based on prior text

3. Natural Language Understanding and Generation

Language models support both:

  • Understanding text (reading and interpreting meaning)
  • Generating text (writing responses, summaries, or explanations)

This dual capability is central to many NLP workloads.

4. Pretrained Models

In Azure, language modeling typically relies on pretrained models, meaning:

  • No custom training is required
  • Models are already trained on large text datasets
  • Users can immediately apply them to common NLP tasks

This aligns with the AI-900 focus on consuming AI services, not building models.

Common Uses of Language Modeling

1. Chatbots and Virtual Assistants

Language models enable conversational AI by:

  • Understanding user input
  • Generating natural responses
  • Maintaining conversation context

Azure Example:
Chatbots built using Azure OpenAI Service or language-based Azure AI services.

2. Text Completion and Content Generation

Language models can:

  • Auto-complete sentences
  • Generate emails, reports, or documentation
  • Assist with creative writing or code comments

3. Question Answering

Language models can:

  • Interpret natural language questions
  • Generate relevant answers based on context or provided data

This is commonly used in:

  • Help desks
  • Knowledge bases
  • Internal support tools

4. Text Summarization

Language models can:

  • Condense long documents
  • Extract key points
  • Provide concise summaries

This helps users quickly understand large volumes of text.

5. Language Translation and Adaptation

While translation is often a separate NLP workload, language models:

  • Understand sentence structure
  • Preserve meaning across languages
  • Adapt phrasing naturally

Language Modeling in Azure

In Azure, language modeling capabilities are available through services such as:

Azure OpenAI Service

  • Provides access to powerful large language models
  • Supports text generation, chat, summarization, and reasoning tasks
  • Uses pretrained transformer-based models

Azure AI Language

  • Focuses on structured NLP tasks
  • Complements language modeling with features like sentiment analysis and entity recognition

For AI-900, it’s important to recognize what language models enable, not the underlying implementation details.

Language Modeling vs Other NLP Tasks (Exam Tip)

NLP TaskFocus
Sentiment analysisEmotional tone
Entity recognitionIdentifying names, places, organizations
Key phrase extractionImportant terms
Language modelingUnderstanding and generating language

If the question involves predicting, generating, or responding with text, language modeling is likely the correct concept.

Why Language Modeling Matters for AI-900

Microsoft includes language modeling in AI-900 to ensure candidates understand:

  • How modern AI systems interact with human language
  • Why conversational AI is possible
  • How Azure provides ready-to-use NLP capabilities

You are not expected to train models — only to identify features, uses, and scenarios.

Exam Takeaway

If a question mentions:

  • Text generation
  • Conversational AI
  • Predicting words or sentences
  • Understanding context in language

👉 Think Language Modeling

Go to the Practice Exam Questions for this topic.

Go to the AI-900 Exam Prep Hub main page.

AI, AI-900, Artificial Intelligence (AI), Generative AI, Microsoft Certification

Identify Features of Generative AI Models (AI-900 Exam Prep)

Introduction

Generative AI models are a class of artificial intelligence systems designed to create new content rather than simply analyze or classify existing data. In the AI-900 exam, Microsoft focuses on conceptual understanding, not implementation details. You are expected to recognize what generative AI models do, how they behave, and what makes them different from traditional machine learning models.

Generative AI underpins many modern Azure AI solutions, including Azure OpenAI Service, and plays a central role in text, image, code, and audio generation workloads.

What Is a Generative AI Model?

A generative AI model learns patterns, structure, and relationships from large datasets and uses that knowledge to generate new, original outputs that resemble the data it was trained on.

Unlike predictive models (which output labels or numeric values), generative models produce:

  • Text
  • Images
  • Code
  • Audio
  • Synthetic data

Key Features of Generative AI Models (Exam Focus)

1. Content Generation

Generative AI models can create new content rather than selecting from predefined responses.

Examples:

  • Writing emails, stories, or summaries
  • Generating images from text descriptions
  • Producing computer code
  • Creating conversational responses

AI-900 cue: If the scenario involves creating something new, it likely involves generative AI.

2. Large Pretrained Models

Generative AI models are typically pretrained on massive datasets containing text, images, or other media.

Key characteristics:

  • Trained on diverse, large-scale data
  • Capture language structure, context, and semantics
  • Can generalize to many tasks without retraining

Examples:

  • Large language models (LLMs)
  • Multimodal foundation models

3. Prompt-Based Interaction

Generative AI models are commonly controlled using prompts, which are natural language instructions or inputs.

Prompts can:

  • Ask questions
  • Provide instructions
  • Set constraints or styles
  • Include examples (few-shot prompting)

Exam tip: Prompts guide how the model responds but do not retrain the model.

4. Probabilistic Output (Non-Deterministic)

Generative AI models produce probabilistic responses, meaning:

  • The same prompt can produce different outputs
  • Responses are not fixed or guaranteed
  • Outputs are generated based on likelihood, not rules

This enables creativity but also requires careful validation.

5. Context Awareness

Generative AI models can use context provided in a conversation or prompt to influence responses.

Examples:

  • Remembering earlier parts of a conversation
  • Adjusting tone or topic based on prior input
  • Generating coherent multi-turn dialogue

This is especially relevant for chat-based AI systems.

6. General-Purpose Capability

Generative AI models are often multi-task by design.

A single model can:

  • Answer questions
  • Summarize text
  • Translate languages
  • Generate explanations
  • Write code

This contrasts with traditional ML models, which are typically task-specific.

7. Fine-Tuning and Customization

While generative AI models are pretrained, they can be:

  • Fine-tuned with domain-specific data
  • Prompt-engineered for specific use cases
  • Configured with system instructions

For AI-900, it’s important to know customization is possible, not how to implement it.

8. Human-Like Outputs

Generative AI models are designed to produce outputs that appear:

  • Natural
  • Fluent
  • Contextually relevant
  • Similar to human-generated content

This is especially true for text and conversational AI.

9. Support for Multimodal Data

Some generative AI models can work across multiple data types, such as:

  • Text → Image
  • Image → Text
  • Text → Code

AI-900 expects recognition of this capability, not technical depth.

10. Need for Responsible AI Controls

Generative AI models require safeguards due to risks such as:

  • Hallucinations (incorrect but confident outputs)
  • Bias
  • Harmful or inappropriate content

Microsoft emphasizes:

  • Content filtering
  • Responsible AI principles
  • Human oversight

Generative AI vs Traditional Machine Learning (High-Yield Comparison)

AspectTraditional MLGenerative AI
Primary goalPredict or classifyCreate new content
Output typeLabels or numbersText, images, code, audio
Task scopeNarrow, specificBroad, general-purpose
Interaction styleStructured inputsNatural language prompts
CreativityNoneHigh

Azure Context (What AI-900 Expects You to Recognize)

Generative AI workloads on Azure are commonly delivered through:

  • Azure OpenAI Service
  • Integrated Azure AI tooling
  • Secure, enterprise-ready AI deployments

You are not expected to know APIs or pricing — only capabilities and use cases.

Common Exam Triggers to Watch For 👀

If a question mentions:

  • Writing text
  • Creating images
  • Generating code
  • Conversational responses
  • Prompt-based interaction

➡️ Think: Generative AI model

Summary

For the AI-900 exam, generative AI models are defined by their ability to:

  • Generate new content
  • Respond to prompts
  • Operate probabilistically
  • Handle multiple tasks
  • Produce human-like outputs
  • Require responsible AI safeguards

Understanding these features, not implementation details, is the key to scoring well in this exam section.

Go to the Practice Exam Questions for this topic.

Go to the AI-900 Exam Prep Hub main page.

AI, AI-900, Artificial Intelligence (AI), Generative AI, Microsoft Certification

Identify Common Scenarios for Generative AI (AI-900 Exam Prep)

Overview

In the AI-900: Microsoft Azure AI Fundamentals exam, generative AI represents a significant and growing focus area. This topic assesses your ability to recognize when generative AI is the appropriate solution and how it differs from traditional AI and predictive machine learning.

Generative AI models are designed to create new content—such as text, images, audio, or code—based on patterns learned from large datasets and guided by user prompts.

This article explains common real-world scenarios where generative AI is used, how those scenarios appear on the AI-900 exam, and how they map to Azure services.

What Makes a Scenario “Generative AI”?

A workload is a generative AI scenario when:

  • The output is newly generated content, not just a prediction or classification
  • The model responds to natural language prompts or instructions
  • The output can vary creatively, even for similar inputs

If the task is to predict, classify, or extract, it is not generative AI. If the task is to create, compose, or generate, it is.

Common Generative AI Scenarios (AI-900 Focus)

1. Text Generation

Scenario examples:

  • Writing emails, reports, or marketing copy
  • Drafting blog posts or documentation
  • Generating summaries from bullet points

Why this is generative AI: The model creates original text based on a prompt rather than selecting from predefined responses.

2. Conversational AI and Chatbots

Scenario examples:

  • AI-powered customer support chatbots
  • Virtual assistants that answer open-ended questions
  • Knowledge assistants that explain concepts conversationally

Why this is generative AI: Responses are dynamically generated and context-aware, rather than rule-based or scripted.

3. Text Summarization

Scenario examples:

  • Summarizing long documents
  • Creating executive summaries
  • Condensing meeting transcripts

Why this is generative AI: The model produces a new, concise version of the original content while preserving meaning.

4. Translation and Language Transformation

Scenario examples:

  • Translating text between languages
  • Rewriting text to be simpler or more formal
  • Paraphrasing content

Why this is generative AI: The output text is newly generated rather than extracted or classified.

5. Code Generation and Assistance

Scenario examples:

  • Generating code from natural language descriptions
  • Explaining existing code
  • Refactoring or optimizing code snippets

Why this is generative AI: The model creates original source code based on intent expressed in a prompt.

6. Image Generation

Scenario examples:

  • Creating images from text prompts
  • Generating artwork or design concepts
  • Producing visual content for marketing

Why this is generative AI: The model synthesizes entirely new images rather than identifying objects in existing ones.

7. Audio and Speech Generation

Scenario examples:

  • Converting text into natural-sounding speech
  • Generating voiceovers
  • Creating spoken responses for virtual assistants

Why this is generative AI: The audio output is generated dynamically from text input.

Azure Services Commonly Used for Generative AI

For the AI-900 exam, generative AI scenarios are most commonly associated with:

  • Azure OpenAI Service
    • Large language models (LLMs)
    • Text, code, and image generation
    • Conversational AI

Other Azure services (such as Azure AI Speech or Language) may support generative capabilities, but Azure OpenAI Service is the primary service to associate with generative AI workloads.

Generative AI vs Other AI Approaches (Quick Contrast)

Task TypeAI Approach
Predict a value or categoryPredictive Machine Learning
Follow predefined rulesTraditional AI
Create new text, images, or codeGenerative AI

How This Appears on the AI-900 Exam

On the exam, generative AI scenarios are typically described using words such as:

  • Generate
  • Create
  • Write
  • Summarize
  • Compose
  • Respond conversationally

If the question emphasizes creative or open-ended output, generative AI is likely the correct choice.

Key Takeaways for Exam Day

  • Generative AI is about creation, not prediction
  • Outputs are flexible and context-aware
  • Azure OpenAI Service is the primary Azure service for generative AI
  • If the output did not previously exist, generative AI is likely the answer

Go to the Practice Exam Questions for this topic.

Go to the AI-900 Exam Prep Hub main page.

AI, AI-900, Artificial Intelligence (AI), Large Language Models (LLMs), Microsoft Certification

Practice Questions: Describe Features and Capabilities of Azure OpenAI Service (AI-900 Exam Prep)

Practice Questions

Question 1

You need to build a chatbot that can generate natural, human-like responses and maintain context across multiple user interactions. Which Azure service should you use?

A. Azure AI Language
B. Azure AI Speech
C. Azure OpenAI Service
D. Azure AI Vision

Correct Answer: C

Explanation:
Azure OpenAI Service provides large language models capable of multi-turn conversational AI. Azure AI Language supports traditional NLP tasks but not advanced generative conversations.

Question 2

Which feature of Azure OpenAI Service enables semantic search by representing text as numerical vectors?

A. Prompt engineering
B. Text completion
C. Embeddings
D. Tokenization

Correct Answer: C

Explanation:
Embeddings convert text into vectors that capture semantic meaning, enabling similarity search and retrieval-augmented generation (RAG).

Question 3

An organization wants to generate summaries of long internal documents while ensuring their data is not used to train public models. Which service meets this requirement?

A. Open-source LLM hosted on a VM
B. Azure AI Language
C. Azure OpenAI Service
D. Azure Cognitive Search

Correct Answer: C

Explanation:
Azure OpenAI ensures customer data isolation and does not use customer data to retrain models, making it suitable for enterprise and regulated environments.

Question 4

Which type of workload is Azure OpenAI Service primarily designed to support?

A. Predictive analytics
B. Generative AI
C. Rule-based automation
D. Image preprocessing

Correct Answer: B

Explanation:
Azure OpenAI focuses on generative AI workloads, including text generation, conversational AI, code generation, and embeddings.

Question 5

A developer wants to build an AI assistant that can explain code, generate new code snippets, and translate code between programming languages. Which Azure service should be used?

A. Azure AI Language
B. Azure Machine Learning
C. Azure OpenAI Service
D. Azure AI Vision

Correct Answer: C

Explanation:
Azure OpenAI supports code-capable large language models designed for code generation, explanation, and translation.

Question 6

Which Azure OpenAI capability is MOST useful for building retrieval-augmented generation (RAG) solutions?

A. Chat completion
B. Embeddings
C. Image generation
D. Speech synthesis

Correct Answer: B

Explanation:
RAG solutions rely on embeddings to retrieve relevant content based on semantic similarity before generating responses.

Question 7

Which security feature is a key benefit of using Azure OpenAI Service instead of public OpenAI endpoints?

A. Anonymous access
B. Built-in image labeling
C. Azure Active Directory integration
D. Automatic data labeling

Correct Answer: C

Explanation:
Azure OpenAI integrates with Azure Active Directory and RBAC, providing enterprise-grade authentication and access control.

Question 8

A solution requires generating marketing copy, summarizing customer feedback, and answering user questions in natural language. Which Azure service best supports all these requirements?

A. Azure AI Language
B. Azure OpenAI Service
C. Azure AI Vision
D. Azure AI Search

Correct Answer: B

Explanation:
Azure OpenAI excels at generating and transforming text using large language models, covering all described scenarios.

Question 9

Which statement BEST describes how Azure OpenAI Service handles customer data?

A. Customer data is used to retrain models globally
B. Customer data is publicly accessible
C. Customer data is isolated and not used for model training
D. Customer data is stored permanently without controls

Correct Answer: C

Explanation:
Azure OpenAI ensures data isolation and does not use customer prompts or responses to retrain foundation models.

Question 10

When should you choose Azure OpenAI Service instead of Azure AI Language?

A. When performing key phrase extraction
B. When detecting named entities
C. When generating original text or conversational responses
D. When identifying sentiment polarity

Correct Answer: C

Explanation:
Azure AI Language is designed for traditional NLP tasks, while Azure OpenAI is used for generative AI tasks such as text generation and conversational AI.

Final Exam Tip

If the scenario involves creating new content, chatting naturally, generating code, or semantic understanding at scale, the correct answer is likely related to Azure OpenAI Service.

Go to the AI-900 Exam Prep Hub main page.

AI, AI-900, Artificial Intelligence (AI), Large Language Models (LLMs), Microsoft Certification

Describe Features and Capabilities of Azure OpenAI Service (AI-900 Exam Prep)

Overview

The Azure OpenAI Service provides access to powerful OpenAI large language models (LLMs)—such as GPT models—directly within the Microsoft Azure cloud environment. It enables organizations to build generative AI applications while benefiting from Azure’s security, compliance, governance, and enterprise integration capabilities.

For the AI-900 exam, Azure OpenAI is positioned as Microsoft’s primary service for generative AI workloads, especially those involving text, code, and conversational AI.

What Is Azure OpenAI Service?

Azure OpenAI Service allows developers to deploy, customize, and consume OpenAI models using Azure-native tooling, APIs, and security controls.

Key characteristics:

  • Hosted and managed by Microsoft Azure
  • Provides enterprise-grade security and compliance
  • Uses REST APIs and SDKs
  • Integrates seamlessly with other Azure services

👉 On the exam, Azure OpenAI is the correct answer when a scenario describes generative AI powered by large language models.

Core Capabilities of Azure OpenAI Service

1. Access to Large Language Models (LLMs)

Azure OpenAI provides access to advanced models such as:

  • GPT models for text generation and understanding
  • Chat models for conversational AI
  • Embedding models for semantic search and retrieval
  • Code-focused models for programming assistance

These models can:

  • Generate human-like text
  • Answer questions
  • Summarize content
  • Write code
  • Explain concepts
  • Generate creative content

2. Text and Content Generation

Azure OpenAI can generate:

  • Articles, emails, and reports
  • Chatbot responses
  • Marketing copy
  • Knowledge base answers
  • Product descriptions

Exam tip:
If the question mentions writing, summarizing, or generating text, Azure OpenAI is likely the answer.

3. Conversational AI (Chatbots)

Azure OpenAI supports natural, multi-turn conversations, making it ideal for:

  • Customer support chatbots
  • Virtual assistants
  • Internal helpdesk bots
  • AI copilots

These chatbots:

  • Maintain conversation context
  • Generate natural responses
  • Can be grounded in enterprise data

4. Code Generation and Assistance

Azure OpenAI can:

  • Generate code snippets
  • Explain existing code
  • Translate code between languages
  • Assist with debugging

This makes it valuable for developer productivity tools and AI-assisted coding scenarios.

5. Embeddings and Semantic Search

Azure OpenAI can create vector embeddings that represent the meaning of text.

Use cases include:

  • Semantic search
  • Document similarity
  • Recommendation systems
  • Retrieval-augmented generation (RAG)

Exam tip:
If the scenario mentions searching based on meaning rather than keywords, think embeddings + Azure OpenAI.

6. Enterprise Security and Compliance

One of the most important exam points:

Azure OpenAI provides:

  • Data isolation
  • No training on customer data
  • Azure Active Directory integration
  • Role-Based Access Control (RBAC)
  • Compliance with Microsoft standards

This makes it suitable for regulated industries.

7. Integration with Azure Services

Azure OpenAI integrates with:

  • Azure AI Foundry
  • Azure AI Search
  • Azure Machine Learning
  • Azure App Service
  • Azure Functions
  • Azure Logic Apps

This allows organizations to build end-to-end generative AI solutions within Azure.

Common Use Cases Tested on AI-900

You should associate Azure OpenAI with:

  • Chatbots and conversational agents
  • Text generation and summarization
  • AI copilots
  • Semantic search
  • Code generation
  • Enterprise generative AI solutions

Azure OpenAI vs Other Azure AI Services (Exam Perspective)

ServicePrimary Focus
Azure OpenAIGenerative AI using large language models
Azure AI LanguageTraditional NLP (sentiment, entities, key phrases)
Azure AI VisionImage analysis and OCR
Azure AI SpeechSpeech-to-text and text-to-speech
Azure AI FoundryEnd-to-end generative AI app lifecycle

Key Exam Takeaways

For AI-900, remember:

  • Azure OpenAI = Generative AI
  • Best for text, chat, code, and embeddings
  • Enterprise-ready with security and compliance
  • Uses pre-trained OpenAI models
  • Integrates with the broader Azure ecosystem

One-Line Exam Rule

If the question describes generating new content using large language models in Azure, the answer is likely related to Azure OpenAI Service.

Go to the Practice Exam Questions for this topic.

Go to the AI-900 Exam Prep Hub main page.