Frequently asked questions

Getting started

How do I get an account?

Varly is in private beta. Join the waitlist and we'll email you a personal link when your spot is ready. If a colleague invites you to their team, you can create an account with that invitation right away. See Quick start.

Do I need a developer to install Varly?

Usually not. You paste one snippet into the <head> of your site, and the Install page shows where that is for platforms such as Shopify, WordPress, Webflow and Framer. See Install the snippet.

How soon do I see data?

Turning tracking on (Install → 3. Turn tracking on) takes effect within a minute. The Install page shows under 4. Check that data comes in how many pageviews and clicks came in during the last 24 hours. Heatmaps and click impact get useful once a few days of visits are in. See Check that Varly is working.

I have shops on several domains. How do I add them?

Add each domain as a separate site, for example example.nl and example.de. Subdomains such as www. are included automatically. See Site settings.

Can I switch between an agency and a brand account?

No. You choose Brand / web shop or Agency right after you sign up, and you can't change it later. Both work the same way; an agency has one extra level for clients. See Quick start.

Why don't I see my cart or checkout pages?

Pages listed under Settings → Tracking & privacy → Never track these pages are never tracked or recorded. New sites start with /checkout, /cart, /winkelwagen and /afrekenen in that list. See Site settings.

Pricing

What does Varly cost?

$99 per website per month. Team members are unlimited: 4 are included, and each extra member is $10 a month. Agencies find their price per website on the page for agencies. See Pricing and billing.

Data & privacy

Does Varly show its own cookie banner?

No. Varly follows the visitor's choice in your own consent tool, which you pick under Consent banner. It only measures visitors who accept. See Cookie consent.

What happens to visitors who don't accept cookies?

Varly doesn't measure them at all. They also don't take part in A/B tests and don't see surveys. They always see your original site. See Cookie consent.

Is Varly GDPR compliant?

Varly stores data in the EU, counts visitors with a random ID and never stores their name or IP address. Whether your setup fits your privacy policy is for you to decide, with your own privacy advisor. See Privacy and GDPR.

How long does Varly keep my data?

Pageviews and events for 13 months, clicks for heatmaps for 6 months, and orders, test results and survey answers for 25 months. Recordings are kept for 30 days, and favorite recordings for 13 months. See Privacy and GDPR.

How do I keep my own visits out of the data?

Open the link under Exclude your own visits on this device once in each browser you use. You can also add your office under Exclude IP addresses. See Exclude your own visits.

How do I delete data?

An owner can delete a single recording, a whole site with all its data under Settings → Delete site, or the whole organization in Organization settings. You can delete your own account under Account → Delete account. See Delete data.

Tests

How long does an A/B test run?

At least two full weeks, so every weekday counts at least twice. Varly calculates how long your page needs based on its traffic, and you can plan up to 12 weeks. If a test would need more than 8 weeks, Varly warns you and suggests ways to get a clearer answer, such as a goal that happens more often than an order. You can still launch it; the result will just be less certain. See Launch a test.

One version looks better after a week. Can I stop?

Varly gives no verdict before the planned duration ends, and shows Keep running until then. Early numbers swing a lot, so stopping early often picks a false winner. See Read your test results.

Do I need to connect my orders for tests?

Yes. A test picks its winner on orders placed after a visitor first saw the test. Without orders, Varly can't pick a winner. See Orders and revenue.

Can I build a test without an AI key?

Yes, with the visual editor. Select a part of your page and choose Edit directly to change the text, a link, an image or the style yourself; that needs no AI key. From an idea, click Create test and edit it myself. Letting the AI build a test, or building changes you describe in words, needs an AI key. See Build a test by selecting parts of your live page.

Can I use my own JavaScript or CSS in a test?

Yes. Every A/B test has a Custom code card, and the visual editor has a Code button. Write JavaScript or CSS for a variant, or describe the change and let AI write it. Only Owners and Editors can change code. Varly blocks risky code, never runs it on checkout pages, catches errors so your page keeps working, and checks the code on every device before the test can launch. See Write your own JavaScript and CSS.

Can I see a test before visitors do?

Yes. Every test has a link under Preview on your site that shows it on your real site, with a bar to switch between versions. Only you see it, and nothing is measured. See Preview and check a test.

What is a dry run?

Visitors are split over the versions, but the page doesn't change. You can check that the split works before anyone sees the variant. Each test has its own dry run or live setting. When you're ready, click Go live: show the new version to visitors on the test page; the count then starts again, so the results only include live visitors. See Launch a test.

Do returning customers count in a test?

Yes. A visitor counts as converted when they order after first seeing the test during its live period, also if they already ordered from you before. See Read your test results.

Can I see my A/B tests in Google Analytics 4?

Yes. Varly can tell GA4 which version each visitor saw, with Google's standard event experience_impression. Set it up under Settings → Experiments → Send test data to GA4. Varly's own results stay the place to pick a winner. See See your A/B tests in Google Analytics 4.

Bayesian or frequentist: which should I pick?

Bayesian shows the chance that a variant beats the original, which is easiest to read. Frequentist shows a p-value. Change it under Settings → Experiments. See Read your test results.

What does "Split check: Uneven split" mean?

Visitors aren't split over the versions as planned (sample ratio mismatch). The results can't be trusted until you find the cause. See Read your test results.

Surveys

Why is my survey not showing?

Check that the survey says Live, that Show on matches the page, and that you accepted cookies. Surveys also don't show on a device where you excluded your own visits, or to visitors outside the sample. See Why is my survey not showing?.

How many questions should a survey have?

One to three. A survey can have up to 12 questions, but short surveys get the most answers. See Create a survey.

Which languages can surveys use?

You write the questions yourself. Buttons and standard texts can be English, Dutch, German, French or Spanish, or follow the page with Same as the page. See Design a survey.

Can I see what a respondent did on my site?

Yes. With recordings on, each written answer has a Watch the recording link. You can also filter answers by Placed an order and No order. See Read survey results.

Recordings

Are recordings on by default?

Yes. New sites record All visits, with Balanced text hiding. You can choose a lower share, or Off, under Settings → Session recordings. Check this when you add a site, so it matches your privacy policy. See Set up session recordings.

Can I see what visitors type?

No. What visitors type in form fields is always hidden, and the setting Hide text in recordings decides how much other text is hidden too. Text is hidden in the visitor's browser, and the same setting applies to the texts of clicked elements in heatmaps. See Recording privacy.

How do I keep a recording longer than 30 days?

Click Add to favorites. Favorite recordings are kept for 13 months. Adding a note also adds the recording to your favorites. If you remove it from your favorites, the normal 30 days apply again. See Watch session recordings.

AI

Do I need AI to use Varly?

No. Heatmaps, recordings, surveys, click impact, rule-based ideas and tests you edit directly in the visual editor work without AI. You need an AI key to let the AI build tests, write AI summaries and get AI ideas. See Add your AI key.

Which AI does Varly use, and who pays?

Varly runs on your own API key from Anthropic (Claude), OpenAI (ChatGPT models), Google Gemini, DeepSeek or Mistral. An owner adds it in the AI key card of Organization settings. You pay the provider directly; Varly adds nothing on top. See Add your AI key.

Does the AI see data from my other clients?

No. The AI only ever sees the research of the site it works on. See Add your AI key.

Can I use Varly from Claude or ChatGPT?

Yes. Under Account → Connect Claude or ChatGPT you find the address to add. Before launching a test, the assistant shows you the preview link and test plan and waits for your yes. See Connect Claude and Connect ChatGPT.

Account

How do I invite a colleague?

An owner goes to Team, fills in Invite a colleague and clicks Create invitation. Varly emails the invitation and shows the link too, so you can also send it yourself. It works for 14 days. See Team roles.

Can a client see only their own data?

Yes. Invite them as Viewer and choose Only these clients under Client access. See Give clients access.