Skip to main content
A document processing pipeline that fetches content, extracts key information, summarizes it with an LLM, and formats the final output. Each step depends on the previous one’s output.

Workflow

pipeline.py

How It Works

  1. fetch_content — fetches raw HTML from the URL
  2. extract_metadata — parses title and text from the HTML (waits for fetch_content)
  3. summarizer — LLM summarizes the extracted text (waits for extract_metadata)
  4. format_report — combines title and summary into a report (waits for both extract_metadata and summarizer)
Each lambda creates an automatic dependency. No step runs until its dependencies are resolved.

Running

With the offline fetcher above and a test model, the report is the page title plus the model’s summary text. A live model replaces that summary with the three bullets you asked for.