Question 1

How do I set up Vanity with Redis in a Rails app?

Accepted Answer

Add the Redis gem to your Gemfile, configure a `vanity.yml` file with Redis adapter details, and ensure Vanity is initialized in your application. The README provides sample YAML configurations and reconnection tips for forking servers.

Question 2

Vanity vs Split: which is better for A/B testing in Rails?

Accepted Answer

Vanity offers more datastore flexibility (Redis, MongoDB, SQL) and built-in JavaScript bot filtering, while Split is Redis-only but may have simpler setup. Vanity is ideal if you need multi-datastore support; Split suits teams already using Redis for everything.

Question 3

Can I use Vanity without JavaScript for participant registration?

Accepted Answer

Yes, but bot traffic won't be filtered, potentially skewing results. The README notes that JavaScript registration is optional, but enabling it via `config.use_js = true` and including `<%= vanity_js %>` in views is recommended for accuracy.

Question 4

How to track conversions outside of Rails controllers with Vanity?

Accepted Answer

Use `Vanity.track!` with an identity object that responds to `vanity_identity`, such as in Rack handlers or background jobs. The README shows examples with a custom context object for non-Rails use.

Question 5

Does Vanity support multivariate testing beyond simple A/B splits?

Accepted Answer

Vanity supports multiple alternatives in experiments (e.g., A/B/C tests) via the `alternatives` method, but it doesn't natively handle complex interactions or automated optimization like some advanced tools. It's best for straightforward multivariate setups.

Question 6

How to reset or disable an experiment in Vanity?

Accepted Answer

Use the Rails dashboard routes (e.g., POST to `/vanity/reset` or `/vanity/disable`) or programmatically via Vanity playground methods. The dashboard setup in the README includes routes for managing experiments.

Question 7

Is Vanity compatible with ActionMailer for email A/B testing?

Accepted Answer

Yes, Vanity integrates with ActionMailer by setting a `Vanity.context` that responds to `vanity_identity`, as mentioned in the 'Other' section of user identification. This allows tracking experiments in emails similarly to web views.

Vanity

What is Vanity?

Overview

Use Cases

Best For

Related Projects

Found a gem we're missing?

Not Ideal For

Pros & Cons

Pros

Cons

Frequently Asked Questions