🟡 Instrument & Debug a RAG Pipeline: Adventure 03 | Intermediate is Live!

In Adventure 03: The AI Observatory, you are a rogue SecUnit aboard the Perihelion (ART). You need to jump to RaviHyral, but ART is “multitasking” and refusing to calculate the coordinates.

Your mission? Diagnose the distraction, quantify the obsession, and fix the navigation system.

:yellow_circle: Intermediate: The Distracted Pilot

In this level, you will dive deeper into RAG (Retrieval-Augmented Generation) observability and custom metrics.

:brain: What You’ll Learn:

  • RAG Instrumentation: How to trace a full RAG pipeline (LangChain + Qdrant) with OpenLLMetry.
  • Custom Metrics: How to implement OpenTelemetry Counters in Python to track specific business logic.
  • PromQL & Recording Rules: How to write Prometheus queries to calculate a “Distraction Ratio”.
  • Debugging RAG: How to use traces and metrics to find and fix retrieval issues.

:hammer_and_wrench: The Tech Stack:

:new_button: New Verification System: Verify your solution instantly inside your Codespace and get your Certificate of Completion!

:rocket: Ready to Start?

Start the Challenge

Good luck, SecUnit. ART is waiting (and watching Sanctuary Moon). :robot::television:


:books: Credits: The characters of this adventure are borrowed from the fantastic Murderbot Diaries series by Martha Wells! :robot::heart:

2 Likes

— CERTIFICATE START —
Adventure: 03-the-ai-observatory
Level: intermediate
User: Gerald Sigmund
Repo: unknown
Date: Sat 21 Feb 2026 05:59:20 PM UTC
Url: Solved Challenge · gsigmund/open-ecosystem-challenges@a7ea16b · GitHub
— CERTIFICATE END —

2 Likes

Expert is now live :slight_smile:

:red_circle: Reduce Telemetry Noise: Adventure 03 | Expert is Live!

— CERTIFICATE START —
Adventure: 03-the-ai-observatory
Level: intermediate
User: rohitbc23
Repo: rohitbc23/open-ecosystem-challenges
Date: Tue 03 Mar 2026 08:13:10 PM UTC
Url: Solved Challenge · rohitbc23/open-ecosystem-challenges@9ada59a · GitHub
— CERTIFICATE END —