AI-103: Develop AI apps and agents on Azure

Course content:

Develop generative AI apps in Azure

Plan and prepare to develop AI solutions on Azure

• Introduction
• What is AI?
• Microsoft Foundry
• Foundry Tools
• Developer tools and SDKs
• Responsible AI
• Exercise - Prepare for an AI development project

Select, deploy, and evaluate Microsoft Foundry models

• Introduction
• Explore the model catalog
• Select models using benchmarks
• Deploy models to endpoints
• Evaluate model performance
• Exercise - Select, deploy, and evaluate models

Develop a generative AI chat app with Microsoft Foundry

• Introduction
• Explore with the model playground
• Choose an endpoint and SDK
• Generate responses with the Responses API
• Generate responses with the ChatCompletions API
• Exercise - Create a generative AI chat app

Develop generative AI apps that use tools

• Introduction
• What are tools?
• Use the code_interpreter tool
• Use the web_search tool
• Use the file_search tool
• Use the functions tool
• Exercise - Create a generative AI chat app that uses tools

Optimize generative AI model performance with Microsoft Foundry

• Introduction
• Optimize model output with prompt engineering
• Ground your model with Retrieval Augmented Generation
• Fine-tune a model for consistent behavior
• Compare and combine optimization strategies
• Exercise - Optimize generative AI model performance

Implement a responsible generative AI solution in Microsoft Foundry

• Introduction
• Plan a responsible generative AI solution
• Map potential harms
• Measure potential harms
• Mitigate potential harms
• Manage a responsible generative AI solution
• Exercise - Apply guardrails to prevent harmful content

Develop AI agents on Azure

Develop AI agents with Microsoft Foundry and Visual Studio Code

• Introduction
• Understand AI agents and Microsoft Foundry Agent Service
• Explore development approaches
• Build your first agent in Microsoft Foundry
• Set up Visual Studio Code for agent development
• Configure and manage agents in Visual Studio Code
• Extend agent capabilities with tools
• Test, deploy, and integrate agents
• Exercise - Build and deploy an AI agent

Integrate custom tools into your agent

• Introduction
• Why use custom tools
• Options for implementing custom tools
• How to integrate custom tools
• Exercise - Build an agent with custom tools

Integrate MCP Tools with Azure AI Agents

• Introduction
• Understand MCP tool discovery
• Integrate agent tools using an MCP server and client
• Use Azure AI agents with MCP servers
• Exercise - Connect MCP tools to Azure AI Agents

Build knowledge-enhanced AI agents with Foundry IQ

• Introduction
• Understanding RAG for agents
• Explore Foundry IQ
• Configure data sources for knowledge bases
• Configure retrieval with Foundry IQ
• Exercise - Integrate an AI agent with Foundry IQ

Integrate your agent with Microsoft 365

• Introduction
• Understand Foundry agent publishing options
• Publish an agent to Teams
• Use Microsoft 365 Agents Toolkit
• Access Microsoft 365 data with Work IQ
• Test and iterate your integrated agent
• Exercise - Publish a Foundry agent to Teams

Build agent-driven workflows using Microsoft Foundry

• Introduction
• Understand workflows
• Identify workflow patterns
• Create workflows in Microsoft Foundry
• Add agents to a workflow
• Apply Power Fx in workflows
• Maintain workflows
• Use workflows in code
• Exercise - Create an agent-driven workflow

Develop an AI agent with Microsoft Agent Framework

• Introduction
• Understand Microsoft Agent Framework AI agents
• Create an Azure AI agent
• Add tools to Azure AI agent
• Exercise - Develop an Azure AI agent

Orchestrate a multi-agent solution using Microsoft Agent Framework

• Introduction
• Understand the Microsoft Agent Framework
• Understand agent orchestration
• Use concurrent orchestration
• Use sequential orchestration
• Use group chat orchestration
• Use handoff orchestration
• Use Magentic orchestration
• Exercise - Develop a multi-agent solution

Discover Azure AI Agents with A2A

• Introduction
• Define an A2A agent
• Implement an agent executor
• Host an A2A server
• Connect to your A2A agent
• Exercise - Connect to remote Azure AI Agents

Develop natural language solutions in Azure

Analyze text with Azure Language

• Introduction
• Azure Language in Foundry Tools
• Detect language
• Extract entities
• Extract personally identifiable information (PII)
• Exercise - Analyze text

Develop a text analysis agent

• Introduction
• Understand the Azure Language MCP server
• Connect and use the Language MCP server
• Exercise - Develop a text analysis agent

Develop a speech-capable generative AI application

• Introduction
• Choose a speech-capable model
• Transcribe speech
• Synthesize speech
• Exercise - Use speech-capable AI models

Create speech-enabled apps

• Introduction
• Azure Speech in Foundry Tools
• Use the Speech to Text API
• Use the Text to Speech API
• Configure audio format and voices
• Use Speech Synthesis Markup Language
• Exercise - Create a speech-enabled app

Develop a speech agent

• Introduction
• Understand the Azure Speech MCP server
• Connect and use the Speech MCP server
• Exercise - Use Azure Speech in an agent

Develop an Azure Speech Voice Live Agent

• Introduction
• Explore the Azure Voice Live API
• Explore the AI Voice Live client library
• Create a Voice Live agent
• Exercise - Develop a Voice Live agent

Translate text and speech

• Introduction
• Translation in Microsoft Foundry
• Translate text
• Translate speech
• Exercise - Translate text and speech

Extract insights from visual data on Azure

Develop a vision-enabled generative AI application

• Introduction
• Use a vision-capable model
• Develop a vision-based chat app
• Exercise - Develop a vision-enabled chat app

Generate images with AI

• Introduction
• What are image-generation models?
• Explore image-generation models
• Create a client application
• Exercise - Generate images with AI

Generate videos with Microsoft Foundry

• Introduction
• Deploy a video generating model
• Generate video from a prompt
• Generate video in Python
• Exercise - Generate video

Analyze images with Content Understanding

• Introduction
• What is Content Understanding?
• Analyze images
• Exercise - Analyze images

Create a multimodal analysis solution

• Introduction
• What is Azure Content Understanding?
• Create a Content Understanding analyzer
• Use the Content Understanding API
• Exercise - Extract information from multimodal content

Create a Content Understanding client application

• Introduction
• Prepare to use the API
• Create a Content Understanding analyzer
• Analyze content
• Exercise - Develop a client application

Extract data with Azure Document Intelligence

• Introduction
• What is Azure Document Intelligence?
• Use the Document Intelligence Studio
• Use prebuilt models
• Train and use custom models
• Exercise - Analyze documents

Create a knowledge mining solution with Azure AI Search

• Introduction
• What is Azure AI Search?
• Extract data with an indexer
• Enrich data with AI skills
• Search an index
• Persist data in a knowledge store
• Exercise - Create a knowledge mining solution