Qoest Logo Qoest for Developers

Web Scraping

Web Scraping Pricing and Options

#Pricing

  • standard request: 1 credit
  • with proxy_country: 2 credits
  • with bypass_captcha=true: 3 credits

Credits are only deducted for successful requests.

#Request Example

curl -X POST /v1/web \
  -H "Authorization: Bearer your-token" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://example.com",
    "method": "GET",
    "request_headers": {
      "Accept": "application/json"
    }
  }'

#Request Body

{
  "url": "https://example.com",
  "method": "GET",
  "request_headers": {
    "Accept": "application/json"
  },
  "request_body": {
    "key": "value"
  },
  "proxy_country": "us",
  "bypass_captcha": "false"
}

#Fields

  • url required, must start with http:// or https://
  • method or request_method: GET, POST, PUT, PATCH, DELETE
  • request_headers optional object
  • request_body optional object, required when using POST
  • proxy_country optional proxy country from the configured allow-list
  • bypass_captcha optional string true or false

#Important Rules

If bypass_captcha=true, you cannot also send:

  • custom non-GET methods
  • custom headers
  • request body
  • proxy_country

#Response

{
  "response": "<html>...raw response body...</html>"
}