Free tool
HTML link extractor
Every anchor on the page as JSON: text, resolved href, rel, and whether it points off-site.
HTML input
JSON output
0 B · 0 linesExtracted locally in your browser — nothing is uploaded.
How it works
What this tool does
- Relative hrefs are resolved against the base URL you set, so the output is ready to enqueue in a crawler.
- Each link is flagged internal or external against the base URL's host.
- rel values come through untouched — handy for auditing nofollow and sponsored links.
- javascript: pseudo-links are skipped so they do not pollute your frontier.
With Irmu
When you also need to fetch the page
A browser cannot fetch arbitrary URLs. Irmu returns the HTML — rendering, proxies and retries included — and you run the same extraction over it.
crawl_and_extract.py
# 1. Fetch the page with Irmu — rendering, proxies and retries handled for you
# 2. Extract the fields you need locally
import os, json, requests
from bs4 import BeautifulSoup
resp = requests.get(
"https://app.irmu.com/api/crawl",
headers={"Authorization": f"Bearer {os.environ['IRMU_API_KEY']}"},
params={"url": "https://store.example.com/products/acme-headphones", "render": "true"},
timeout=60,
)
resp.raise_for_status()
soup = BeautifulSoup(resp.text, "html.parser")
data = {
"name": soup.select_one("h1").get_text(strip=True),
"price": soup.select_one(".price").get_text(strip=True),
"reviews": [r.get_text(strip=True) for r in soup.select(".review")],
}
print(json.dumps(data, indent=2))Code examples
Do the same thing in your own pipeline
The equivalent extraction with the standard HTML parser in each language.
# pip install beautifulsoup4
import json
from bs4 import BeautifulSoup
soup = BeautifulSoup(html, "html.parser")
data = {"links": [{"text": el.get_text(strip=True), "href": el["href"], "rel": el.get("rel")} for el in soup.select("a[href]")]}
print(json.dumps(data, indent=2))FAQ
Questions about this tool
Turn any URL into clean JSON
Fetch, render and extract with one API. 1,000 free credits every month, no card required.