Maxx Kremer Web Development

News - Maxx Kremer Web Development


Removing Bad Bots .htaccess

If you need to stop bad bots from scrapping your site, the best way to achieve this is to use .htaccess directives. Everyone, whether human or robot, must go through the .htaccess file. Some users use the robots.txt file to do this, but some bots just ignore it, even Google has been known to ignore the robots.txt file.

Using the following rewrite conditions at the end of your .htaccess will stop them in their tracks.

Read more...

Follow Me

Scroll to top
Internet bots, also known as web robots, WWW robots or simply bots, are software applications that run automated tasks over the Internet.
In several web servers (most commonly Apache), .htaccess (hypertext access) is the default name of a directory-level configuration file that allows for decentralized management of web server configuration.