Skip to main content
AIDevOps
  • Learn
  • Learning Paths
  • Practice
  • Open Source
  • Books
  • Engineering

    AI DevOpsThe full map of building and operating AI servicesLLMOpsLLM deployment · evaluation · observabilityHands-on ProjectsBuild AI Agent projects

    Knowledge

    DocsTechnical documentationBlogEngineering articlesPloggerDevelopment log feed

    Validate

    Certification3-level skills certification · coming soon
AI Models
LlamaTutorial|MistralTutorial|GemmaTutorial|DeepSeekTutorial|QwenTutorial
🧠 AI Core
AI Intro & RoadmapML FundamentalsLLM Fundamentals|Python AIC++|PyTorchTensorFlowJAX
🤖 AI Applied Development
Applied AI Intro & RoadmapHugging FaceLangChainLlamaIndexLLMOps|LangGraphMCPMulti-AgentAgent Evaluation
🧠 AI Agent Development
Finance AI AgentLLM API ServerStock Investing AgentAIOps AI AgentEducation AI AgentCoding AI Agent
🌱 Spring Cloud
Spring Intro & RoadmapSpring Cloud GatewaySpring BootJava|Spring AISpring SecuritySpring BatchSpring JPA
🐳 DevOps
DevOps Intro & RoadmapLinuxDockerCI/CD|Kubernetes BasicsK8s AdvancedPrometheusGrafana
🧱 Infrastructure
Infrastructure Intro & RoadmapNginxRedis
☁️ Cloud
Cloud Intro & RoadmapAWSGCPAzureNCPCloudflare
🎨 Frontend
Frontend Intro & RoadmapJavaScriptTypeScript|ReactNext.js|VueNuxt|Electron
📱 Mobile
Mobile Intro & RoadmapKotlinAndroidFlutter
⚙️ Backend
Backend Intro & RoadmapPython BasicsFastAPIDjangoFlask|CGoGinNode.js
💾 Database
DB Intro & RoadmapCore SQLOracleMySQLPostgreSQL|MongoDBVector DB
🧪 Testing
k6JMeternGrinder
AIDevOps

Engineering AI. From Code to Production.
An engineering learning platform for building and operating AI and AI Agents

Learn

  • All Guides
  • Learning Paths
  • AI Tutorial
  • Practice
  • Books

Resources

  • AI DevOps
  • LLMOps
  • Hands-on Projects
  • Docs
  • Blog
  • Plogger
  • Open Source
  • Certification (coming soon)

Start Here

  • AI Core Roadmap
  • AI Applied Development Roadmap
  • Spring Cloud Roadmap
  • DevOps Roadmap
  • Infrastructure Roadmap

 

  • Cloud Roadmap
  • Frontend Roadmap
  • Mobile Roadmap
  • Backend Roadmap
  • Database Roadmap
© 2026 AIDevOps. All rights reserved.
Terms of ServicePrivacy PolicySitemaptestforge.kr
AI Agent POC

Hands-on AI Agent development projects

Visitors

Practical AI Agent documents that let you start developing right away, from building a laptop LLM API server to the finance, education, coding, and AI Ops domains. They are organized around deliverables: what to build first, which APIs to fix, and how to verify that the result can be operated.

Learn Agent developmentLLMOps operating standards

Practical Build Flow

Order of hands-on development

Starting an AI Agent with sweeping automation blurs validation. The first version starts with a small task, clear tools, a fixed response schema, and repeatable tests.

1. Define the problem and the user

  • Pick one user role.
  • Target only one repetitive task for the Agent.
  • Write 20 success/failure example questions first.

2. Lock down the data and tools

  • Decide where the RAG documents live and how often they refresh.
  • Limit the tool APIs the Agent can call to 3 or fewer.
  • Separate read, write, and approval-required actions.

3. Build a thin API first

  • Start with `/health`, `/chat`, `/rag/query`, and `/agent/run`.
  • Fix the response schema and error codes.
  • Log the trace id and model name.

4. Validate, then expand

  • Run regression tests against the golden set.
  • Record p95 latency and the failure rate.
  • Open up automatic execution without human approval last.

Delivery Checklist

Deliverables to produce in the first week

With the items below, a project turns from an explanatory document into an executable development document.

Required deliverables

  • Project README and local run commands
  • Sample environment variables and rules for separating secrets
  • FastAPI or Worker API skeleton
  • 10 sample RAG documents and their chunking results
  • A golden set of 30 representative questions
  • curl tests and a k6 smoke test
  • Agent response JSON schema
  • List of operational risks and fallbacks

Definition of done

  • A new developer can get the local server running within 30 minutes from the README alone.
  • Browser, cloud API, laptop API, and LLM/RAG logs are linked by the same trace id.
  • When there is no answer or the evidence is weak, the Agent returns a limited answer instead of guessing.
  • You can compare golden set results before and after a model change to check for quality drops.

Sample Project Line

AI Agent projects by domain

Start the first implementation small, but design it to include operational validation and regression testing from day one.

LLM InfraAGT

Laptop LLM API Server

A Docker Compose guide to building a fully private AI Agent & RAG API server on a laptop at zero cost

Separates the TypeScript-based cloud AI Agent from the private API server on the laptop. The cloud handles the user touchpoint, authentication, sessions, routing, and policy checks, while the laptop runs the Ollama LLM Engine, the FastAPI auth API, the Chroma Vector DB, and LangChain/LangGraph orchestration under Docker Compose.

Data

  • Local model files
  • Chroma vector collections
  • RAG source documents
  • API request/response logs
  • Performance measurements
  • Environment variables and docker-compose settings

Agent Tools

  • ollama_llm_engine
  • fastapi_private_gateway
  • chroma_vector_search
  • langchain_rag_chain
  • langgraph_agent_flow
  • api_key_auth_guard
  • latency_benchmark

AI Agent scope

  • Set up the cloud AI Agent API facade
  • Set up the laptop Docker Compose stack
  • Download the Ollama models
  • Run the Chroma Vector DB
  • Apply FastAPI API key authentication
  • Ingest RAG documents
  • Call the private API from the TypeScript cloud backend

Validation criteria

  • Verify the cloud/laptop responsibility boundary
  • docker compose health checks pass
  • LLM model list call succeeds
  • Chroma collection is created
  • Requests without an API key are blocked
  • RAG retrieval and answer generation succeed
  • Cloudflare/Next.js backend integration succeeds
Docker ComposeOllamallama3.1gemma2FastAPIPythonChromaLangChainLangGraphTypeScript ClientCloudflare Tunnelk6
View the project ABCs
FinanceAGT

AutoTrading AI Investment Agent

A hands-on stock investing AI agent that combines a local SQLite screener DB with pgvector RAG

Reads the quantitative scores (SQLite) of the existing AutoTrading system, synthesizes stock reports with the Qwen 2.5 3B model, generates 768-dimension embeddings with nomic-embed-text, and loads them into pgvector (PostgreSQL). A LangChain ReAct agent then combines real-time Yahoo Finance tool calls with semantic RAG search to deliver detailed investment analysis.

Data

  • AutoTrading SQLite screener results (autotrading.db)
  • AI-synthesized stock summary reports
  • 768-dimension embedding vectors
  • yfinance real-time price/financial data

Agent Tools

  • get_stock_financials
  • get_stock_price_history
  • search_screener_reports
  • get_latest_top_screener_stocks
  • analyze_user_portfolio

AI Agent scope

  • Build the SQLite screener DB connector
  • Build the local Ollama summary and embedding pipeline
  • Implement FastAPI data sync (/api/autotrading/sync)
  • Implement pgvector natural-language search (/api/autotrading/search)
  • Integrate the LangChain ReAct investing AI agent and Chat API (/api/chat)

Validation criteria

  • SQLite data is extracted correctly
  • Qwen 2.5 3B summarization and nomic-embed-text vectorization succeed
  • pgvector similarity search (Cosine Distance) accuracy
  • The agent picks the right Tool for each situation and the final answer quality is good
FastAPIOllamaqwen2.5:3bnomic-embed-textPostgreSQLpgvectorSQLiteLangChain-ClassicyfinanceDocker Compose
View the project ABCs
AI OpsAGT

AIOps Runbook Agent

An incident response Agent that connects alerts, logs, metrics, and runbooks

When an operations alert fires, summarizes the related logs and metrics and presents a safe recovery procedure and the points the owner needs to confirm.

Data

  • Prometheus metrics
  • Application logs
  • Deployment history
  • Incident response runbooks

Agent Tools

  • metric_query
  • log_search
  • deploy_lookup
  • runbook_retriever

AI Agent scope

  • List candidate causes of the alert
  • Check the impact of recent deployments
  • Summarize related logs
  • Suggest a recovery procedure

Validation criteria

  • Blocking of wrong command execution
  • Runbook evidence included
  • MTTR reduction
  • Tool restrictions by permission
FastAPIPrometheusGrafanaOpenTelemetryLangGraphk6
View the project ABCs
EducationAGT

EduLab Tutor Agent

An education Agent that connects learning diagnosis, tailored question generation, and explanatory feedback

Provides a personal learning path and feedback based on the learner solution history, error patterns, and curriculum documents.

Data

  • Curriculum documents
  • Question bank
  • Solution history
  • Error notebook

Agent Tools

  • curriculum_retriever
  • quiz_generator
  • answer_checker
  • learning_path_planner

AI Agent scope

  • Diagnose the learning level
  • Generate 5 tailored questions
  • Explain the cause of wrong answers
  • Recommend the next learning path

Validation criteria

  • Answer grading accuracy
  • Difficulty fit
  • Rate of explanations with evidence
  • Minimal personal data collection
Next.jsFastAPIPydanticPostgreSQLpgvectorPlaywright
View the project ABCs
CodingAGT

CodeOps AI Agent

A development Agent that connects codebase analysis, issue resolution, test generation, and PR review

Based on the Git repository, issues, test logs, and CI results, helps developers quickly grasp the scope of a change and carry out safe code changes and verification.

Data

  • Git repository
  • Issue/PR descriptions
  • Test failure logs
  • Coding convention documents

Agent Tools

  • repo_search
  • code_reader
  • test_runner
  • patch_planner
  • pr_review

AI Agent scope

  • Summarize the issue and analyze its impact
  • Find the related files/functions
  • Generate a change plan
  • Draft test cases and a PR review

Validation criteria

  • Build success rate
  • Blocking of test regressions
  • Blocking of insecure patterns
  • Review comment accuracy
Next.jsFastAPILangGraphTree-sitterGitHub APIPlaywright
View the project ABCs