Read websites that block ordinary requests

The problem

A website may block your agent or show it an empty page instead of the information you need. The agent cannot read what the website has not shown it. It needs a tool that can handle the site’s checks and retrieve the available content.

How NativePort helps

NativePort connects to Scrapfly to help retrieve public pages that block ordinary visits from agents. Your agent can then read the retrieved content and summarize it for you. Access still depends on the website; this does not open private accounts.

Let your agent build it

You don’t need to write this code yourself. Copy the prompt and paste it into your agent. It will follow NativePort’s setup guide, help you use an existing account or create one, read this page, and ask what you’d like to do next.

View prompt

Help me use NativePort for this use case.

1. Read https://nativeport.ai/SKILL.md and follow its instructions to learn how to use NativePort. Save or update the skill if your environment supports it.

2. Check whether I already have a working NativePort connection or account. Reuse it if available. Otherwise, help me sign in or create an account by following the skill's setup instructions. Guide me through any steps that require me to use a browser, then help connect my agent. Keep credentials private.

3. Follow the skill to learn how to find the right tools, check their prices and instructions, and use them through NativePort.

4. Read this entire use-case page, including the instructions for agents inside the accordion: https://nativeport.ai/use-cases/bypass-anti-bot-protection/

Once setup is complete and you have read the page, briefly explain what you can help me do and ask me what I would like to do next. Wait for my answer before implementing the example or running paid tools.

Instructions for the agents - You don't need to read this

Technical implementation

Use Python 3 with requests installed (python -m pip install requests). Set NATIVEPORT_API_KEY in your environment to your NativePort key. Run the snippets on your server, where your key stays private.

Set TARGET_URL to the public page you need. Enable rendering for pages whose content loads with JavaScript. These options can affect the request cost.

python

import os
import requests

BASE = "https://api.nativeport.ai"
HEADERS = {"Authorization": f"Bearer {os.environ['NATIVEPORT_API_KEY']}"}

response = requests.get(BASE + "/scrapfly", headers=HEADERS, params={
    "url": os.environ["TARGET_URL"],
    "asp": "true",
    "render_js": "true",
}, timeout=120)
response.raise_for_status()
result = response.json()
print(result["result"]["content"])

Inspect the returned content before passing it to the agent: a successful HTTP response alone does not prove the requested page was retrieved. See the Scrapfly request options.

Tool costs

Tool used in the example	Price per call
Scrapfly — rendered page with anti-bot protection	$0.00015825 / credit (usage-based)

Prices in USD. Usage-based tools have no fixed per-call price. View pricing.

The problem

How NativePort helps

Let your agent build it

Technical implementation

Tool costs

Keep exploring

Build a larger history of customer reviews

Collect large datasets and retrieve them when ready

Compare prices and availability across countries

Explore all use cases