feat: Add cookies support as scrape options for Scout configuration

[sykuang]

Summary

Adds the ability to configure cookies and other scrape options per Scout, enabling scraping of authenticated or protected content.

Features

• Cookies Support: Users can now configure custom cookies to send with scrape requests
• Scrape Options UI: New settings section in Scout configuration modal for managing scrape options
• Per-Scout Configuration: Each Scout can have its own scrape settings

How to Configure Cookies

1. Open your Scout's settings by clicking the gear icon
2. Scroll down to the Cookies section
3. Click the pencil icon to edit
4. Enter your cookies in the format: cookie_name=value; another_cookie=value
5. Click Save Changes

Changes

Frontend

• components/scout-settings-modal.tsx: Added cookies input field in the Scout settings modal with edit mode toggle

Backend (Supabase Edge Functions)

• supabase/functions/scout-cron/types.ts: Added ScrapeOptions interface with support for cookies, headers, waitFor, and timeout
• supabase/functions/scout-cron/tools.ts: Updated executeSearchTool and executeScrapeTool to accept and apply scrape options
• supabase/functions/scout-cron/agent.ts: Pass Scout's scrape options to tool execution

Database

• supabase/migrations/20260108000000_add_scout_scrape_options.sql: Added scrape_options JSONB column to scouts table

Scrape Options Structure

{
  "cookies": "session_id=abc123; auth_token=xyz789",
  "headers": {"Authorization": "Bearer token"},
  "waitFor": 2000,
  "timeout": 30000
}

[vercel]

@sykuang is attempting to deploy a commit to the SideGuide Team on Vercel.

A member of the Team first needs to authorize it.