Fetch URL as Clean Text API

Fetch any public URL and extract clean, human-readable text via REST API. Strips HTML tags, JavaScript, CSS, navigation menus, and ads — returning just the main textual content of the page, like what a screen reader would present.

How it works

POST a URL. The API makes an HTTP GET request, parses the HTML, removes boilerplate elements (nav, footer, scripts, styles), and returns the main content as clean text. Also returns the page title, word count, and a list of headings.

Use cases

• Feed web content into LLM prompts without HTML noise
• Build content monitoring that detects when a page changes
• Extract article text for summarization or translation pipelines
• Scrape competitor pricing pages or product descriptions programmatically
• Power research agents that can read and process any web page

API Reference

POST https://slopshop.gg/v1/sense-url-content
Authorization: Bearer YOUR_API_KEY
Content-Type: application/json

Input parameters

Example response

{
  "data": {
    "result": "success",
    "processed": true
  },
  "meta": {
    "credits_used": 3,
    "engine": "real",
    "ms": 4
  }
}

Examples

Three real-world scenarios showing how developers use Fetch URL as Clean Text in production.

curl -X POST https://slopshop.gg/v1/sense-url-content \
  -H "Authorization: Bearer $SLOPSHOP_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://techcrunch.com/2024/01/15/some-article"}'

curl -X POST https://slopshop.gg/v1/sense-url-content \
  -H "Authorization: Bearer $SLOPSHOP_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://competitor.com/pricing"}'

curl -X POST https://slopshop.gg/v1/sense-url-content \
  -H "Authorization: Bearer $SLOPSHOP_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://store.example.com/products/widget-pro"}'

Code examples

curl

curl -X POST https://slopshop.gg/v1/sense-url-content \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"input": "your data here"}'

Python

import requests

response = requests.post(
    "https://slopshop.gg/v1/sense-url-content",
    headers={"Authorization": "Bearer YOUR_API_KEY"},
    json={"input": "your data here"}
)
result = response.json()
print(result["data"])

Node.js

const response = await fetch("https://slopshop.gg/v1/sense-url-content", {
  method: "POST",
  headers: {
    "Authorization": "Bearer YOUR_API_KEY",
    "Content-Type": "application/json"
  },
  body: JSON.stringify({ input: "your data here" })
});
const { data } = await response.json();
console.log(data);

CLI

# Install the Slopshop CLI
npm install -g slopshop

# Set your API key
export SLOPSHOP_KEY=your_api_key

# Call sense-url-content
slop sense-url-content '{"input": "your data here"}'

Pricing

Credits are purchased in bundles starting at $1 for 1,000 credits. All compute APIs like this one use 3 credits per call — that's $0.003. See all pricing tiers.

Related APIs in Sense: Web

• Extract Links from URL API — Fetch a URL and extract all hyperlinks (href attributes), returning absolute URLs with their anchor text and whether they are internal or external.
• Get URL Metadata API — Fetch a URL and extract meta information: page title, meta description, Open Graph tags (og:title, og:image, og:description), Twitter card tags, and canonical URL.
• Detect Website Tech Stack API — Fetch a URL and detect technologies in use: JavaScript frameworks (React, Vue, Angular), CMS generators (WordPress, Ghost), analytics tools, CDNs, and server software from headers and HTML patterns.
• Measure URL Response Time API — Make multiple HTTP requests to a URL and return min, max, and average response times in milliseconds. Useful for detecting latency patterns and slowdowns.
• Fetch and Parse Sitemap API — Fetch a domain's sitemap.xml (or sitemap index), parse it, and return all listed URLs with their last-modified dates and change frequencies.

View the full API catalog · Try in playground · Documentation