Tag: crawler

WordPress get the URL of the Blog View

If you read SEO Errors on Page Web Analytics “Speed Insights” you should: Switch your WordPress Blog to a “Static” Homepage, see section “Read” Create a “Custom” Link for the Blog View at Appearance, then go “Menus” Check after Changes again with SEO Tools !! Following Day’s My custom Blog URL: https://www.linuxonlinehelp.eu/?post_type=post Echo:             The Problem is that Web Crawler or Robots cant read the dynamic generated Pages of the WordPress Blog View    

Apache: Analyse Logs Spam Bots

If you admin a Apache Webserver, you see often weekly thousand of visits a day on your Blogs. Background: These are no real users, this visits are made by Spam Bots in my Logs like Xovi.de or xovibot.net Bots! On info pages this Company says Admins should disallow crawl by robots.txt, but they IGNORE the settings! This x-guys is in my opinion against German Law “Datenschutz”. "Mozilla/5.0 (compatible; XoviBot/2.0; +http://www.xovibot.net/)" Solution: On Linux Setup a Firewall like ufw and block these IP Ranges To find out the IPs do: $sudo cat /var/log/apache2/access.log|grep xovibot.net| awk '{ print $2 }' | sort | […]

Impressum Datenschutz-DSGVO-GDPR

Last Update 08.10.2023 www.linuxonlinehelp.eu - Nonprofit Linux PC & Server Support since 2004 Tags: Linux Online Help, Linuxonlinehelp, Linux Support, Linux Hilfe