Bot traffic has gotten so bad, I don't think any of them have gotten through, and the site has remained stable, but the traffic costs were going to be up to an extra 30USD per month.
I've had to blanket ban all of AWS Singapore to deal with this.
Webmaster's Blog
Moderator: Moderators
-
mknz
- Site Admin - MR2OCNZ
- Posts: 1188
- Joined: Thu Apr 03, 2014 1:17 am
- Stomping Ground: Auckland
- Prime Mover: More than one MR2
- First name: Michael
- Contact:
-
mknz
- Site Admin - MR2OCNZ
- Posts: 1188
- Joined: Thu Apr 03, 2014 1:17 am
- Stomping Ground: Auckland
- Prime Mover: More than one MR2
- First name: Michael
- Contact:
Re: Webmaster's Blog
Having to escalate to requiring the captcha to access the site to control the cost of hosting. AI data scraping is terrible
-
mknz
- Site Admin - MR2OCNZ
- Posts: 1188
- Joined: Thu Apr 03, 2014 1:17 am
- Stomping Ground: Auckland
- Prime Mover: More than one MR2
- First name: Michael
- Contact:
Re: Webmaster's Blog
CloudFlare has added AI [scraping] bot blocking to free tier and it's now enabled on the site. This should fix it and I can remove the aggressive "Are you a human?" without our hosting costs going back up again.