AI agent instructions
AI agent instructions
Fields
string | null | undefined
Additional instructions to use for the scrape. E.g. ‘Extract only the title, date and content of the articles.’
boolean | undefined
Whether to only scrape the main content of the page. If True, navbars, footers, etc. are excluded.
string | null | undefined
Playwright selector to scope the scrape to. Only content inside this selector will be scraped.
boolean | undefined
Whether to only scrape images from the page. If True, the page content is excluded.
boolean | undefined
Whether to scrape links from the page. Links are scraped by default.
boolean | undefined
Whether to scrape images from the page. Images are scraped by default.
string[] | null | undefined
HTML tags to ignore from the page
boolean | undefined
Whether to use link/image placeholders to reduce the number of tokens in the prompt and hallucinations. However this is an experimental feature and might not work as expected.
Record<string, unknown> | ZodLikeSchema<T> | null | undefined
A Zod schema or a JSON Schema object describing the data to extract.
Record<string, unknown> | undefined
JSON Schema to send instead of converting
response_format. Only used with a Zod schema.boolean | undefined
When true (default) a failed structured extraction throws
ScrapeFailedError
and the extracted data is returned directly. When false the StructuredData
wrapper is returned so callers can inspect .success.