Irmu
Free tool

HTML link extractor

Every anchor on the page as JSON: text, resolved href, rel, and whether it points off-site.

HTML input
JSON output
0 B · 0 linesExtracted locally in your browser — nothing is uploaded.
How it works

What this tool does

  • Relative hrefs are resolved against the base URL you set, so the output is ready to enqueue in a crawler.
  • Each link is flagged internal or external against the base URL's host.
  • rel values come through untouched — handy for auditing nofollow and sponsored links.
  • javascript: pseudo-links are skipped so they do not pollute your frontier.
With Irmu

When you also need to fetch the page

A browser cannot fetch arbitrary URLs. Irmu returns the HTML — rendering, proxies and retries included — and you run the same extraction over it.

crawl_and_extract.py
# 1. Fetch the page with Irmu — rendering, proxies and retries handled for you
# 2. Extract the fields you need locally

import os, json, requests
from bs4 import BeautifulSoup

resp = requests.get(
    "https://app.irmu.com/api/crawl",
    headers={"Authorization": f"Bearer {os.environ['IRMU_API_KEY']}"},
    params={"url": "https://store.example.com/products/acme-headphones", "render": "true"},
    timeout=60,
)
resp.raise_for_status()

soup = BeautifulSoup(resp.text, "html.parser")

data = {
    "name": soup.select_one("h1").get_text(strip=True),
    "price": soup.select_one(".price").get_text(strip=True),
    "reviews": [r.get_text(strip=True) for r in soup.select(".review")],
}

print(json.dumps(data, indent=2))
Code examples

Do the same thing in your own pipeline

The equivalent extraction with the standard HTML parser in each language.

# pip install beautifulsoup4

import json
from bs4 import BeautifulSoup

soup = BeautifulSoup(html, "html.parser")

data = {"links": [{"text": el.get_text(strip=True), "href": el["href"], "rel": el.get("rel")} for el in soup.select("a[href]")]}

print(json.dumps(data, indent=2))
FAQ

Questions about this tool

Turn any URL into clean JSON

Fetch, render and extract with one API. 1,000 free credits every month, no card required.