Data Pipelines for LLM Training: Building Production ETL Systems

Building production ETL pipelines for LLM training is complex. After building pipelines processing 100TB+ of data, I’ve learned what works. Here’s the complete guide to building production data pipelines for LLM training. Figure 1: LLM Training Data Pipeline Architecture Why Production ETL Matters for LLM Training LLM training requires massive amounts of clean, processed data: […]

Read more →

Workflows: Graph-Based Agent Orchestration in Microsoft Agent Framework – Part 6

Build graph-based workflows connecting multiple agents. Learn executors, edges, conditional routing, and checkpointing for complex business processes.

Read more →

Multi-Turn Conversations & Agent Threads in Microsoft Agent Framework – Part 5

Master multi-turn conversations with Agent Threads. Learn context management, persistence patterns, and human-in-the-loop workflows.

Read more →

Tools & Function Calling in Microsoft Agent Framework – Part 4

Deep dive into AI agent tools and function calling. Learn MCP integration, external API patterns, error handling, and tool chaining in Microsoft Agent Framework.

Read more →

Building Your First AI Agent with Microsoft Agent Framework (Python) – Part 3

Build a production-ready Research Assistant AI agent using Python. Complete tutorial covering async patterns, @ai_function decorators, multi-turn conversations, and best practices.

Read more →

Building Your First AI Agent with Microsoft Agent Framework (.NET) – Part 2

Build a production-ready Customer Support AI agent using C# and .NET 8. Complete tutorial covering project setup, tools, multi-turn conversations, middleware, and error handling.

Read more →