Trigger sync real-time scrape

Trigger a synchronous real-time Scraper Studio scrape. POST /dca/crawl holds the request open until the scraper finishes or times out, then returns JSON.

POST /dca/crawl

cURL

cURL

curl --request POST \
  --url 'https://api.brightdata.com/dca/crawl?collector=c_abc123&timeout=50s' \
  --header "Authorization: Bearer YOUR_API_KEY" \
  --header "Content-Type: application/json" \
  --data '{"url": "https://www.ebay.com/itm/326972541236"}'

200

[
  {
    "product_title": "Apple iPad 11th Gen, 128 GB, Wi-Fi + 5G, 11 in - Silver - BRAND NEW SEALED",
    "price": {
      "value": 324.99,
      "currency": "USD",
      "symbol": "$"
    },
    "condition": "New: A brand-new, unused, unopened, undamaged item in its original packaging (where packaging is ...",
    "seller_feedback_percentage": "100% positive feedback",
    "seller_items_sold": "173 items sold",
    "seller_since": "Joined Nov 2012",
    "item_specifics": {
      "brand": "Apple",
      "model": "Apple iPad (11th generation)",
      "processor_model": "Apple A16 Bionic",
      "operating_system": "iPadOS"
    },
    "storage_options": [],
    "seller_ratings": {
      "accurate_description": "--",
      "shipping_cost": "--",
      "shipping_speed": "--",
      "communication": "4.9"
    },
    "product_images": [
      "https://i.ebayimg.com/images/g/4a8AAeSw7x5pboS0/s-l1600.webp",
      "https://i.ebayimg.com/images/g/4a8AAeSw7x5pboS0/s-l1600.webp"
    ],
    "feedback_count": 36,
    "financing_options": {
      "monthly_payment": {
        "value": 13.99,
        "currency": "USD",
        "symbol": "$"
      },
      "payment_plan_duration": "(12 monthly payment plan)",
      "apr": "13.99%"
    },
    "input": {
      "url": "https://www.ebay.com/itm/326972541236"
    },
    "seller_namestest": "jwc8109"
  }
]

{
  "error": "crawl_results_timeout",
  "message": "Timed out waiting for crawl results (timeout=NaNs). The page crawl is continuing in the background, you can poll a GET request to https://api.brightdata.com/dca/get_result?response_id=ID until the result is ready",
  "response_id": "RESPONSE_ID"
}

The synchronous real-time endpoint keeps the HTTP request open until the scraper finishes or the timeout is reached, then returns the collected data directly as JSON. This is the difference from the async real-time endpoint, which returns a response_id immediately.

You can trigger only single-input APIs. Make sure the payload is an object, not an array of objects.

Timeout behavior

The timeout query parameter must be between 25s and 50s.

• If the scraper finishes within the timeout, the response returns 200 OK with the collected data.
• If the scraper is still running when the timeout is reached, the response returns 202 Accepted with a response_id. Use that response_id with the Realtime Data endpoint to retrieve the result asynchronously.

When to use synchronous real-time

Use synchronous real-time (POST /dca/crawl) when:

• You need the result in the same HTTP request.
• You are sending a single input.
• Your client can keep the request open until the scrape finishes.
• The scrape normally completes within the configured timeout.

Use async real-time (POST /dca/trigger_immediate) when:

• You want to trigger the scrape and retrieve the result later.
• You do not want to keep the HTTP request open.

Use batch collection when:

• You need to process multiple inputs in one run.

Authorizations

Authorization · string · header · required

Use your Bright Data API Key as a Bearer token in the Authorization header.

How to authenticate:

1. Obtain your API Key from the Bright Data account settings at https://brightdata.com/cp/setting/users
2. Include the API Key in the Authorization header of your requests
3. Format: Authorization: Bearer YOUR_API_KEY

Example:

Authorization: Bearer b5648e1096c6442f60a6c4bbbe73f8d2234d3d8324554bd6a7ec8f3f251f07df

Learn how to get your Bright Data API key: https://docs.brightdata.com/api-reference/authentication

Query Parameters

collector · string · required

A unique identification of the collector to run

Example:

"c_abc123"

timeout · string · required

How long the request stays open while waiting for the result. Must be between 25s and 50s. If the scraper finishes within the timeout, the response returns 200 OK with the collected data. If the scraper is still running when the timeout is reached, the response returns 202 Accepted with a response_id.

Example:

"50s"

version · string

Set to dev to trigger the development version of the scraper

Body

application/json

A single input object. The fields must match the input schema defined for the collector. A URL-based scraper may require url, while a search scraper may require fields such as keyword and location.

Single input object whose fields match the collector input schema.

url · string<uri>

Example field for collectors that take a target URL. Replace with the fields your collector expects.

Response

200

application/json

OK