---
title: SK Scraping Schutz
url: https://sk-reg.de/index.php/sk-scraping-schutz
markdown_url: https://sk-reg.de/index.php/sk-scraping-schutz.md
date: 2026-11-16T21:36:13+00:00
modified: 2026-11-17T01:45:34+00:00
author: Stephan Krohn
category:
  name: Blog
  url: https://sk-reg.de/index.php/index.md
image_intro: https://sk-reg.de/images/blog_header/joomla_6_sicherheit__schutz_vor_scrapern.png
image_fulltext: https://sk-reg.de/images/blog_header/hader_beitrag_750.png
---

# SK Scraping Schutz

🌐 Translated automatically

Reliably protect your website’s content from being automatically extracted by external computers, bots and scrapers. Genuine search engines are accurately recognised and always allowed through, ensuring that your SEO ranking remains unaffected.

JOOMLA 6 · SECURITY

## SK Scraping Protection

Protects your website’s content from being automatically scraped by external computers, bots and scrapers. Genuine search engines are recognised and always allowed through, so your SEO remains unaffected.

### Key points at a glance

- **Search engines remain unrestricted:** Google, Bing, Yandex, Baidu, Apple and Seznam are verified via DNS reverse lookup and are never throttled.
- **Scrapers are blocked:** download programmes, scripts, headless browsers, AI crawlers and SEO analysis tools are redirected to a block page.
- **Automatically active:** Once installed, the protection works immediately with sensible default settings.
- **With statistics:** An admin view shows who was blocked, when and why.

### Features

1

**Search engine verification**

Anyone claiming to be Googlebot is verified via reverse DNS (forward-confirmed). Genuine bots are allowed through without restriction; fakes receive a 403 error.

2

**Bot filter**

Blocks scraper programmes (curl, wget, Python, Scrapy, HTTrack, Selenium, Puppeteer and more), AI crawlers (GPTBot, ClaudeBot, CCBot, Bytespider, etc.), SEO analysis tools (Semrush, Ahrefs, MJ12, etc.) and requests without a user-agent. Each group can be enabled or disabled individually, and each has its own block list.

3

**Permitted bots**

Custom exceptions, such as DuckDuckBot or Claude users. These take precedence over all blocklists and are only throttled to one-third of the standard limit. Link preview bots (Facebook, WhatsApp, LinkedIn, Slack, etc.) can be permitted separately.

4

**Rate limit**

Anyone who accesses a conspicuously large number of pages in a short space of time will be throttled and blocked for a configurable period (Error 429, default: 60 requests per minute, 30-minute block).

5

**Honeypot trap**

A link invisible to humans, which only bots follow. Anyone who clicks on it will be immediately blocked for 24 hours. Search engines do not receive this link.

6

**Copy protection (optional)**

Makes it more difficult for visitors to copy content: either for images only (right-click, drag) or for images and text (select, copy). Input fields remain usable.

7

**Exceptions**

IP whitelist with individual IP addresses and networks (CIDR, IPv4 and IPv6); logged-in users are never restricted. The IP header can be specified for Cloudflare and other proxies.

8

**Custom block message**

The text on the blocked page can be freely edited. Blocked pages are served with *the noindex tag* and never appear in search engine indexes.

> - [![01 sk scraping schutz](https://sk-reg.de/images/skgallery-cache/dc15746caff6a05316b970cf8fb99e80.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/01_sk_scraping_schutz.png)
> - [![02 sk scraping schutz](https://sk-reg.de/images/skgallery-cache/f923f4d004d6b86854930c9ea7386899.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/02_sk_scraping_schutz.png)
> - [![03 sk scraping schutz](https://sk-reg.de/images/skgallery-cache/af795e1ba47ace3e823e257d857fa4eb.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/03_sk_scraping_schutz.png)
> - [![04 sk scraping schutz](https://sk-reg.de/images/skgallery-cache/cf0b0cffe3b4c3b4eb39ef39439092bd.png)+5](https://sk-reg.de/images/gallery/sk_scraping_schutz/04_sk_scraping_schutz.png)
> - [![05 sk scraping schutz](https://sk-reg.de/images/gallery/sk_scraping_schutz/05_sk_scraping_schutz.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/05_sk_scraping_schutz.png)
> - [![06 sk scraping schutz](https://sk-reg.de/images/gallery/sk_scraping_schutz/06_sk_scraping_schutz.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/06_sk_scraping_schutz.png)
> - [![07 sk scraping schutz](https://sk-reg.de/images/gallery/sk_scraping_schutz/07_sk_scraping_schutz.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/07_sk_scraping_schutz.png)
> - [![08 sk scraping schutz](https://sk-reg.de/images/gallery/sk_scraping_schutz/08_sk_scraping_schutz.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/08_sk_scraping_schutz.png)
> - [![09 sk scraping schutz](https://sk-reg.de/images/gallery/sk_scraping_schutz/09_sk_scraping_schutz.png)](https://sk-reg.de/images/gallery/sk_scraping_schutz/09_sk_scraping_schutz.png)

### Statistics in the admin panel

Under **Components → SK Scraping Protection,** you will find the statistics:

- Key figures: blocks in the last 24 hours, in the last 7 days and in total; different IP addresses and currently blocked IP addresses
- Bar chart for the last 14 days
- Analysis by reason (scraper programme, AI crawler, honeypot, rate limit, etc.)
- The most notable IPs over the last 30 days
- Currently blocked IPs with block end date and *Unblock* button
- The last 100 blocks with time, IP, reason, user-agent and URL, filterable by reason
- Clear statistics with a single click; old entries are automatically deleted (default: after 30 days)

The view adapts to both the light and dark admin themes.

### Setup

1. 1
   Install the **pkg_skscrapeguard** package in the Joomla admin panel under *System → Install →* Upload *Extensions*. The plugin will be activated automatically.
2. 2
   Add the following line to the **robots.txt** file `Disallow: /skguard-falle` so that legitimate bots never trigger the trap.
3. 3
   Add your **own IP address** to the whitelist if you’re testing the site using scripts or tools.
4. 4
   If you’re using Cloudflare or a proxy, set the **header name** (e.g. `CF-Connecting-IP`), otherwise the plugin will only see the proxy IP.

### Good to know

- A scraper that masquerades as a normal browser and fetches data very slowly can never be completely ruled out. The protection keeps the vast majority of bots and tools out and slows down anything that stands out.
- The User-Agent can be spoofed. Bots in the ‘Allowed Bots’ list are therefore only subject to the rate limit. For maximum security, it is better to use the IP whitelist.
- The copy protection in the browser is merely a hurdle for casual users and offers no protection against scrapers.
- Only front-end requests are blocked. The administrator area and logged-in users remain unaffected, as do *robots.txt* and the sitemaps.
- Blocked access attempts are also recorded in the Joomla log `skscrapeguard.log.php`.

 [Download under Plugins:](https://sk-reg.de/index.php/component/skdownloads.md)
