Skip to main content
A document processing pipeline that fetches content, extracts key information, summarizes it with an LLM, and formats the final output. Each step depends on the previous one’s output.

Workflow

pipeline.py

How It Works

  1. fetch_content — fetches raw HTML from the URL
  2. extract_metadata — parses title and text from the HTML (waits for fetch_content)
  3. summarizer — LLM summarizes the extracted text (waits for extract_metadata)
  4. format_report — combines title and summary into a report (waits for both extract_metadata and summarizer)
Each lambda creates an automatic dependency. No step runs until its dependencies are resolved.

Running

The output will be similar to: