Skip to content

Conversation

@abimaelmartell
Copy link
Member

@abimaelmartell abimaelmartell commented Jan 31, 2026

Summary

  • Add new agent command that leverages Firecrawl's AI agent endpoint for intelligent web data extraction
  • Support natural language prompts to describe what data to extract
  • Enable structured output via JSON schemas (inline or from file)
  • Allow targeting specific URLs for focused extraction
  • Include async job handling with polling, progress display, and timeout controls

Usage

# Basic usage
firecrawl agent "Find YC W24 dev tool companies"

# With specific URLs
firecrawl agent "Compare pricing" --urls https://stripe.com,https://square.com

# With JSON schema for structured output
firecrawl agent "Find companies" --schema-file schema.json

# Wait for completion with progress
firecrawl agent "Find YC W24 dev tool companies" --wait

# Check job status
firecrawl agent <job-id>

Test plan

  • Build passes with no TypeScript errors
  • All existing tests pass (244/244)
  • firecrawl agent --help displays correct usage
  • Command appears in main help output
  • Manual testing with real API calls

🤖 Generated with Claude Code

Implement the agent endpoint that allows users to extract data from the web
using natural language prompts. Supports structured output via JSON schemas,
URL targeting, credit limits, and async job handling with polling.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@abimaelmartell abimaelmartell changed the title Add agent command for AI-powered web data extraction Implement /agent Jan 31, 2026
abimaelmartell and others added 8 commits January 30, 2026 18:24
Support selecting between fire-1 (default) and fire-1-mini (faster, cheaper)
models for agent extraction tasks.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Upgrade @mendable/firecrawl-js from 4.10.0 to 4.12.0
- Update model types to match SDK: spark-1-mini and spark-1-pro

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Add spinner utility for CLI feedback
- Show animated spinner while agent is starting and processing
- Display success/fail indicators when complete
- Remove --progress flag (spinner now always shown)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
When user interrupts with Ctrl+C while waiting for agent completion,
show helpful message with the command to check job status later.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Now you can use `firecrawl agent <job-id> --wait` to continuously
poll an existing job until it completes, with the same spinner
animation and Ctrl+C handling.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Stop spinner before showing error messages
- Extract detailed error messages from API responses
- Show full error details to help debug issues

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Show helpful error messages like "Invalid option: expected one of
spark-1-pro|spark-1-mini" instead of just "Bad Request".

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Show clear error message for invalid models instead of waiting
for API rejection.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants