New A/B Testing Feature — Create, Run, and Measure Without Code

HeatMapX Engineering Team3 min read
  • ab-testing

We've added A/B testing to HeatMapX. Once a heatmap has shown you "where the problem on the page is," the next step is to test "what change makes it better" and confirm it with data. A/B testing lets you serve two versions of a page (A and B) to visitors and compare, with real numbers, which one drives more results — such as clicks or sign-ups.

No technical expertise or code required. You can use it right from the same screen where you set up heatmap tracking with a single tag.

⚙ Create Experiments Without Code

  • Choose a site: Select the site you want to test from your registered sites.
  • Specify a target page: Similar to Search Console, the domain stays fixed and you only enter which page to target (leave blank for the homepage). Only the specified page is affected.
  • Create your changes: Select and specify changes to headlines, button copy, colors, and more directly on the page (visual editor). For pages where the visual editor doesn't work well, a manual specification method is also available.

🎯 Choose How to Measure "Success"

You can choose from three types of success metrics:

  • Click: A specific button or link was clicked
  • Page reached: A visitor reached a page such as a sign-up completion page
  • Scroll: A visitor scrolled down a certain percentage of the page

⚖ Separate Settings for "Traffic Allocation" and "A/B Split"

In line with industry standards, we keep these two settings separate.

  • Experiment inclusion rate: What percentage of all visitors are included in the experiment (e.g., start by testing with just 20% of all traffic)
  • A/B split: Among the visitors included in the experiment, what ratio sees A versus B (e.g., 50/50)

👁 Preview the Changed Appearance

Before publishing, you can preview what Variant B (the changed version) will look like applied to the actual page. This preview has no effect on live traffic, so you can check it with confidence.

▤ See Running Experiments at a Glance

  • The experiment list shows the current number of running experiments and the limit.
  • Experiments can be paused, stopped, or resumed, with clear labels for each state.

🌐 Japanese and English Support

From the experiment creation screen through the list and detail views, both Japanese and English displays are supported.

Scope of Impact

A/B testing uses your existing tracking tag as-is. No additional tag installation is required. You can get started without registering a credit card.

Heatmaps you run from Claude Code — free to start.

Drop in one tracker tag. Analyze and ship CRO improvement PRs from the CLI. No credit card · 30-second setup.