Skip to main content

CrawlDesk Default AI Provider

The CrawlDesk Default AI Provider is a built-in, fully managed AI configuration that enables projects to use CrawlDesk’s AI capabilities without integrating an external Large Language Model (LLM).

CrawlDesk manages the underlying AI infrastructure, including model access, provider integrations, scaling, and reliability. This allows teams to immediately use AI-powered features without configuring external providers or managing API keys.

The Default AI Provider powers several core AI features within CrawlDesk, including:

  • Ask AI for Documents — CrawlDesk’s flagship feature that allows users to ask natural language questions over crawled documents and retrieve relevant answers.
  • Support Copilot — AI-assisted responses generated using your crawled knowledge base to help support teams respond faster.
  • AI-powered document understanding — interpreting crawled content for downstream workflows.
  • Metadata and structured data extraction from crawled pages and documents.

By providing a managed AI layer, CrawlDesk allows teams to adopt AI-driven workflows quickly while the platform handles the complexity of AI infrastructure.

Business Use Cases​

The CrawlDesk Default AI Provider is suitable for a wide range of scenarios where teams want to use AI without managing external providers.

  • Quick Platform Adoption: Organizations evaluating CrawlDesk can start using AI features immediately without setting up external AI services.
  • Managed AI Infrastructure: Teams that prefer a fully managed AI solution can rely on CrawlDesk to handle provider integrations, reducing operational complexity.
  • Faster Project Onboarding: New projects can start using AI processing instantly, avoiding delays caused by provider configuration or API key management.
  • Reduced Operational Overhead: Companies that want to avoid maintaining AI provider integrations can use the Default AI Provider and let CrawlDesk manage the AI infrastructure.

Integration Guide​

Using the Default AI Provider requires no external configuration.

To enable it for your project:

  1. Open Project Settings
  2. Navigate to AI Config
  3. Select Default AI as the configuration mode
  4. Save the configuration

Once enabled, CrawlDesk will automatically use the Default AI Provider for AI-powered processing during crawling workflows.

Note: No API keys or provider credentials are required.

Best Practices​

  • Use the Default AI Provider when you want a fully managed AI setup
  • Start with Default AI when onboarding new teams or projects
  • Use Default AI for rapid prototyping and early-stage workflows
  • Monitor project workflows to ensure AI processing meets your requirements
  • Switch to BYOLLM if you require custom providers, specific models, or direct control over AI billing