Setting up readypivs with nginx

To use readypivs with nginx, you need to configure nginx as a reverse proxy.

Use readypivs for bots only

To use readypivs for bots only, check the value of the $http_user_agent variable. If it looks like a bot, send the request to readypivs, otherwise send the request directly to your web application.

Example of configuration for bot

To enable readypivs for a list of bot agents, you can map $http_user_agent to a custom variable that indicates whether you consider this user agent to be a bot. To do this, add this to your nginx.conf.

Setting up readypivs with apache

To use readypivs with Apache, set up a conditional URL rewrite based on the user agent. You can do this either in an .htaccess file, the VirtualHost configuration or the main configuration file.

Sending multiple bot user agents to readypivs

To make your Apache web server send requests from a list of bots to your readypivs instance, use this syntax:

Separate the bot names with the pipe (|) character. This configuration is case-sensitive, so googlebot works while Googlebot doesn't.