intellibrix v1.0.0
    Preparing search index...

    Type Alias FetchUrlToolOptions

    type FetchUrlToolOptions = {
        allowHosts?: string[];
        allowPrivateNetwork?: boolean;
        maxBytes?: number;
        needsApproval?: boolean;
        respectRobotsTxt?: boolean;
        timeoutMs?: number;
        userAgent?: string;
    }
    Index
    allowHosts?: string[]

    Only these hosts may be fetched: exact names (docs.example.com) or *.example.com for any subdomain. Applies to redirects too.

    allowPrivateNetwork?: boolean

    Allow loopback, private and link-local addresses. Leave off unless you are testing locally.

    false
    
    maxBytes?: number

    Largest body to read, in bytes.

    1048576
    
    needsApproval?: boolean

    Require approval for each fetch. Defaults to true, or false when allowHosts is set.

    respectRobotsTxt?: boolean

    Obey each site's robots.txt: refuse paths it disallows for userAgent.

    false
    
    timeoutMs?: number

    Overall time limit per fetch, in ms.

    15000
    
    userAgent?: string

    Sent as User-Agent.

    'intellibrix-agent-tools'