Skip to navigation

Transcript Sidecar

A transcript sidecar is an external service that turns a video URL into a transcript. Summarize uses it alongside its local pipeline (captions, yt-dlp, Cobalt, Whisper). It helps when that pipeline is blocked, for example YouTube refusing requests from cloud servers.

The sidecar is off by default. When on, it only receives URLs of YouTube Video and Video URL sources. Local files, text files, Google Drive and Dropbox links always stay on your machine. Any other http(s) video link can be sent as-is, including signed or intranet media URLs, so turn the sidecar off when summarizing links you would not share with a third party.

Not to be confused with Cobalt, the download fallback that runs next to the app as a Docker sidecar.

TranscriptFetch

TranscriptFetch returns transcripts for YouTube, TikTok, Instagram, and direct media URLs. Videos without captions are transcribed with AI. See pricing.

  1. Create an API key at transcriptfetch.com and add it to .env:

    TRANSCRIPTFETCH_API_KEY = tf_live_YOUR_KEY
  2. Turn it on in summarizer.yaml:

    defaults:
    sidecar: transcriptfetch # or none
    sidecar-order: fallback # or first

Order

sidecar-orderBehavior
fallback (default)Run the local pipeline. Ask the sidecar only if it fails.
firstAsk the sidecar first. Run the local pipeline only if it fails.

If both fail, the error lists both reasons; see Transcript Sidecar Errors. Sidecar transcripts are cached like any other transcript, so re-summarizing the same video does not call the sidecar again.

Every interface

InterfaceSetting
summarizer.yamlsidecar, sidecar-order under defaults
CLI--sidecar transcriptfetch --sidecar-order first
HTTP API"sidecar": "transcriptfetch", "sidecar_order": "first"
StreamlitSettings → Transcript sidecar and Sidecar order, saved to summarizer.yaml
RaycastExtension preferences → Transcript Sidecar and Sidecar Order

The CLI, API, and Raycast settings apply to one run and fall back to summarizer.yaml.

Adding a sidecar

A sidecar is one module in summarizer/sidecars/ that satisfies the Sidecar protocol defined in summarizer/sidecars/__init__.py:

# summarizer/sidecars/example.py
LABEL = "Example"
def fetch(url, config):
"""Return [(start_seconds, text), ...] or raise a SummarizerError."""

Register it in summarizer/sidecars/__init__.py:

SIDECARS: dict[str, Sidecar] = {"transcriptfetch": transcriptfetch, "example": example}

It then becomes a valid sidecar value in the YAML, CLI, HTTP API, and Streamlit. To offer it in Raycast, add it to the sidecar dropdown in extensions/raycast-summarize/package.json. The pipeline handles order, fallback, timestamps, and caching.