Tag: keyword search

Implement hybrid search (DP-800 Exam Prep)

This post is a part of the DP-800: Developing AI-Enabled Database Solutions Exam Prep Hub.
This topic falls under these sections:
Implement AI capabilities in database solutions (25–30%)
   --> Design and implement intelligent search
      --> Implement hybrid search


Note that there are 10 practice questions (with answers) at the end of each section to help you solidify your knowledge of the material. Also, there are 4 practice tests with 30 questions each available from the hub's main page below the exam topics section.

Introduction

Hybrid search is a core capability for modern AI-enabled database solutions because it combines the strengths of traditional keyword search and vector (semantic) search. By leveraging both lexical and semantic matching techniques, hybrid search delivers more accurate, relevant, and context-aware search results than either approach alone. Hybrid search is widely used in Retrieval-Augmented Generation (RAG) applications, enterprise knowledge bases, AI assistants, recommendation systems, and intelligent search platforms.


What Is Hybrid Search?

Hybrid search combines multiple search techniques into a single query, typically including:

  • Keyword search
  • Full-text search
  • Vector (semantic) search

Instead of relying on only one search method, hybrid search retrieves candidates from multiple search engines and combines the results using a ranking algorithm.

For example, consider a user searching for:

“How do I reduce Azure storage costs?”

A keyword search might find documents containing the exact terms:

  • Azure
  • Storage
  • Costs

A vector search might retrieve documents discussing:

  • Lower cloud expenses
  • Optimize storage spending
  • Reduce infrastructure costs

Hybrid search combines both result sets and ranks the most relevant documents at the top.


Why Hybrid Search Is Important

Neither keyword search nor vector search is perfect by itself.

Keyword Search Strengths

Keyword search excels at finding:

  • Exact product names
  • Error codes
  • File names
  • Database object names
  • Technical terminology

Example:

SQL72014

A keyword search finds documents containing that exact error code.


Keyword Search Weaknesses

Keyword search struggles with:

  • Synonyms
  • Different wording
  • Natural language
  • Conceptual relationships

Example:

Search:

“Vacation policy”

Document:

“Paid time off guidelines”

Although both describe the same concept, keyword search may not find the document.


Vector Search Strengths

Vector search understands meaning.

Example:

Search:

“Improve application speed”

Documents discussing:

  • Performance optimization
  • Query tuning
  • Faster database execution

can all be returned because their embeddings are semantically similar.


Vector Search Weaknesses

Vector search may struggle with:

  • Product IDs
  • Version numbers
  • Error codes
  • Exact names
  • Highly specialized terminology

Example:

Searching for:

SQL71561

works better with keyword search.


Hybrid Search Combines Both Approaches

User Query
Keyword Search
+
Vector Search
Combined Results
Ranking
Top Results

This allows users to benefit from both lexical precision and semantic understanding.


How Hybrid Search Works

A hybrid search implementation generally follows these steps.

Step 1. User Submits a Query

Example:

“How do I configure Azure SQL backups?”


Step 2. Keyword Search Executes

The database searches for:

  • Azure
  • SQL
  • Backups
  • Configure

using:

  • Full-text indexes
  • SQL predicates
  • Traditional search indexes

Step 3. Vector Search Executes

The same query is converted into an embedding.

Query
Embedding Model
Vector

The vector is compared against stored document embeddings.


Step 4. Merge Results

Suppose keyword search returns:

DocumentScore
Backup Overview95
SQL Backup Guide90

Vector search returns:

DocumentScore
Disaster Recovery93
Data Protection88

The system merges these candidate sets.


Step 5. Rank Results

The ranking engine evaluates:

  • Keyword relevance
  • Semantic similarity
  • Metadata
  • Popularity
  • Freshness
  • Business rules

The highest-ranking documents are returned.


Components of a Hybrid Search Solution

Source Documents

Examples include:

  • PDFs
  • Product documentation
  • Knowledge articles
  • Support tickets
  • Policies
  • Emails
  • SQL records

Full-Text Index

Supports traditional keyword searching.

Optimized for:

  • Exact phrases
  • Words
  • Wildcards
  • Boolean searches

Embedding Model

Generates vector representations for documents and queries.

Examples:

  • Azure OpenAI Embeddings
  • OpenAI embedding models
  • Sentence Transformers

The same embedding model should be used during indexing and querying.


Vector Index

Stores embeddings for efficient semantic search.

Examples:

  • HNSW
  • IVF
  • Flat index
  • Product Quantization (PQ)

Ranking Engine

Combines multiple signals into a single relevance score.


Search Pipeline

User Query
Keyword Search
\
\
Ranking Engine
/
/
Vector Search
Combined Results

Both searches occur independently before the results are combined.


Ranking in Hybrid Search

Hybrid search is more than simply combining two result lists.

Each result receives a relevance score based on multiple factors.

Typical ranking signals include:

  • Keyword score
  • Vector similarity score
  • Document freshness
  • Popularity
  • User permissions
  • Metadata
  • Business importance

The ranking algorithm determines the final ordering.


Metadata Filtering

Hybrid search often includes structured SQL filters.

Example:

WHERE Department = 'Finance'

or

WHERE DocumentType = 'Policy'

The search becomes:

Keyword Search
+
Vector Search
+
Metadata Filters
Ranking

Filtering improves both relevance and performance.


Hybrid Search in RAG

Hybrid search is commonly used in Retrieval-Augmented Generation.

Workflow:

User Question
Hybrid Search
Relevant Documents
Large Language Model
Grounded Response

Benefits include:

  • Higher-quality context
  • Reduced hallucinations
  • More complete retrieval
  • Better factual accuracy

Example Scenario

Suppose an employee asks:

“How do I access my benefits after changing jobs?”

Keyword search retrieves:

  • Benefits
  • Jobs

Vector search retrieves:

  • Employee transition
  • HR onboarding
  • Employment status changes

Hybrid search combines both sets, increasing the likelihood of returning the most relevant documents.


Hybrid Search vs Keyword Search

FeatureKeyword SearchHybrid Search
Exact termsExcellentExcellent
SynonymsPoorExcellent
Natural languageLimitedExcellent
Error codesExcellentExcellent
Semantic understandingNoneExcellent
AI applicationsLimitedExcellent

Hybrid Search vs Vector Search

FeatureVector SearchHybrid Search
Semantic understandingExcellentExcellent
Exact identifiersModerateExcellent
Error codesModerateExcellent
Product namesModerateExcellent
Natural languageExcellentExcellent
Overall relevanceHighVery High

Benefits of Hybrid Search

Better Relevance

Combines multiple search signals.


Handles Synonyms

Users don’t need exact wording.


Supports Technical Queries

Keyword search finds:

  • Error codes
  • File names
  • Product names

Supports Natural Language

Vector search understands concepts.


Improved User Satisfaction

Users receive better search results.


Better RAG Responses

The LLM receives more relevant context.


Challenges

Increased Complexity

Two search systems must be maintained.


Higher Resource Usage

Both keyword and vector searches execute.


Ranking Tuning

Determining the correct weighting between keyword and semantic scores may require experimentation.


Embedding Maintenance

Embeddings should be regenerated when source content changes significantly or when migrating to a new embedding model.


Common Hybrid Search Scenarios

Enterprise Knowledge Bases

Employees search documentation using natural language.


Customer Support

Support agents retrieve troubleshooting articles using both error codes and descriptive questions.


Product Catalogs

Customers search using product names, descriptions, or intent.


Healthcare

Clinicians search using symptoms while also matching standardized medical terminology.


Legal Research

Lawyers search using statutes, case numbers, and legal concepts.


Financial Services

Analysts search reports using account identifiers and descriptive business questions.


Best Practices

  • Combine full-text and vector search for production AI applications.
  • Use the same embedding model during indexing and querying.
  • Create appropriate full-text and vector indexes.
  • Apply metadata filters whenever possible.
  • Tune ranking weights using representative user queries.
  • Evaluate both precision and recall during testing.
  • Continuously monitor search quality and user feedback.
  • Refresh embeddings when source documents change significantly.
  • Secure search results using role-based access controls and document permissions.

DP-800 Exam Tips

Remember these key points for the exam:

  • Hybrid search combines traditional keyword search with vector search.
  • Keyword search excels at exact terms, identifiers, and technical strings.
  • Vector search excels at semantic meaning and natural language.
  • Hybrid search generally provides better relevance than either approach alone.
  • Ranking combines multiple signals, including lexical relevance, semantic similarity, and metadata.
  • Metadata filtering improves both performance and result quality.
  • Hybrid search is commonly used in Retrieval-Augmented Generation (RAG) systems.
  • The same embedding model should be used for both indexing and querying to ensure meaningful vector comparisons.

Practice Exam Questions

Question 1

A company is building an AI-powered knowledge base that must support searches for both exact error codes and natural language questions.

Which search approach is most appropriate?

A. Hybrid search

B. Keyword search only

C. Vector search only

D. Relational indexing only

Answer: A

Explanation:
Hybrid search combines keyword and vector search, enabling both exact matching for error codes and semantic matching for natural language queries.


Question 2

A user searches for:

“Improve database response time”

The system returns documents discussing query tuning, indexing strategies, and SQL optimization, even though those exact words were not used.

Which component enabled this behavior?

A. Full-text search

B. Vector search

C. Clustered indexes

D. Foreign key constraints

Answer: B

Explanation:
Vector search compares embeddings that capture semantic meaning, allowing conceptually related documents to be retrieved even when different wording is used.


Question 3

What is the primary purpose of the ranking engine in a hybrid search solution?

A. Generate document embeddings

B. Create vector indexes

C. Combine and order results from multiple search methods

D. Encrypt search results

Answer: C

Explanation:
The ranking engine merges results from keyword and vector searches and orders them using relevance signals such as lexical score, semantic similarity, freshness, and metadata.


Question 4

Which type of query is generally handled most effectively by keyword search?

A. “How can I reduce cloud expenses?”

B. “Best practices for disaster recovery”

C. “Ways to improve SQL performance”

D. “SQL71561”

Answer: D

Explanation:
Exact identifiers such as error codes, product names, and version numbers are best handled using keyword or full-text search.


Question 5

Why is hybrid search commonly used in Retrieval-Augmented Generation (RAG) applications?

A. It eliminates the need for embeddings.

B. It improves retrieval quality by combining lexical and semantic matching.

C. It replaces large language models.

D. It removes the need for vector indexes.

Answer: B

Explanation:
Hybrid search retrieves more comprehensive and relevant information than either keyword or vector search alone, providing higher-quality context to the LLM.


Question 6

A search solution first performs keyword search, then vector similarity search, and finally combines both result sets.

Which step typically follows next?

A. Delete duplicate documents from the database.

B. Recreate all vector indexes.

C. Rank the combined results using relevance signals.

D. Generate new embeddings for every document.

Answer: C

Explanation:
After gathering candidate documents, the ranking engine evaluates multiple relevance signals to determine the final ordering presented to the user.


Question 7

Which statement best describes metadata filtering in hybrid search?

A. It replaces vector search.

B. It restricts search results using structured attributes such as department or document type.

C. It converts SQL tables into embeddings.

D. It automatically updates document embeddings.

Answer: B

Explanation:
Metadata filters narrow the search scope using structured data while still allowing semantic and keyword search within the filtered dataset.


Question 8

A developer configures hybrid search using one embedding model for indexing documents and a different embedding model for processing user queries.

What is the most likely result?

A. Improved semantic accuracy.

B. Reduced index size.

C. Faster query execution.

D. Lower-quality semantic matches because vectors occupy different embedding spaces.

Answer: D

Explanation:
Embeddings produced by different models are generally not directly comparable, leading to poorer semantic similarity calculations and less relevant search results.


Question 9

Which advantage does hybrid search have over vector search alone?

A. It supports exact matching for identifiers while preserving semantic search capabilities.

B. It eliminates the need for full-text indexes.

C. It guarantees mathematically perfect search results.

D. It removes the need for metadata.

Answer: A

Explanation:
Hybrid search enhances vector search by adding lexical matching, making it more effective for exact terms such as product names, file names, and error codes.


Question 10

Which best practice should a database developer follow when implementing hybrid search?

A. Use different embedding models for documents and queries.

B. Disable metadata filtering to improve semantic search.

C. Combine full-text search, vector search, and structured filtering to improve relevance.

D. Use exhaustive vector search for every production workload regardless of size.

Answer: C

Explanation:
A well-designed hybrid search solution combines lexical search, semantic search, and structured metadata filtering to maximize relevance, scalability, and user satisfaction in AI-enabled database applications.


Go to the DP-800 Exam Prep Hub main page