You can now run
native A/B split tests directly inside Vidalytics
— no spreadsheets, no external tools, no messy attribution.Compare two videos on a single placement (embed), choose one primary goal (like CTA Click, Opt-in, or Conversion Rate), and get a clear, directional readout showing who’s ahead.
Built for performance marketers who care about conversions — not just views.
🆕
What’s New
Video vs Video A/B Testing (Single Placement)
Run
Control vs Variant (Challenger)
tests on one embed/placement.Default
50/50 traffic split
(customizable).Choose a
single primary goal metric
, such as:- Conversion Rate
- Click Rate
- Opt-in Rate
- Avg % Watched
- Unmute Rate
- Bounce Rate
Add a
test hypothesis or notes
directly inside the experiment.Experiments Hub
A centralized dashboard to manage all your tests:
- View status (Draft, Running, Paused, Finished)
- See running period and viewers
- Track simple Impact(difference between variants on the primary goal)
- Search by test name
- Open any test profile instantly
Dedicated Test Profile (Setup + Reporting in One Place)
Each experiment includes:
- Scope, goal, and traffic allocation
- Start/end dates
- Variant previews
- Side-by-side reporting modules
- Engagement graphs per video (switchable between audience & conversion metrics)
Embed-Based Testing (No Extra Work Required)
- If the Control video is already embedded — just start the test.
- No need to re-embed anything.
- Otherwise, copy the embed code directly from the test profile.
Safe Execution Controls
- Start– Allocate traffic immediately.
- Pause– Automatically falls back to Control.
- Resume– Preserves sticky allocation.
Sticky Allocation + Clean Attribution
- Visitors are randomly assigned on page load.
- Allocation remains sticky for the duration of the test.
- All events and metrics are attributed to the assigned variant.
- Prevents viewers from seeing multiple variants mid-funnel.
Finish Flow + Winner Selection
When ready:
- Finish the test from Running or Paused.
- Declare a Winneror mark asInconclusive.
- Optionally apply winner to 100% trafficautomatically.
> If 100% traffic is applied to the Variant, Control and Variant embeds swap internally — no page changes required.
Directional Reporting (Without Heavy Stats)
- Summary view focused on your chosen goal metric
- Impact shown after minimum duration and play thresholds
- Engagement graphs per variant
- No heavy statistical certification in this beta — reporting is directional and threshold-based
🛠️
How to Use It

- Go to Experiments → Create Experiment.
- Enter your test name and optional description.
- Select: Control video; Variant (challenger); Traffic split (defaults to 50/50)
- Choose your primary goal metric.
- If the Control video is already embedded on the page, you’re ready to go. Otherwise, copy the embed code from the test profile and paste it on your target page.
- Click Start.
- Monitor performance in: Summary report; Engagement graphs
- When ready, click Finishand declare a winner.
- Optionally apply winner to 100% of traffic.
💡
Benefits
- Native video split testingfocused on performance, not vanity metrics.
- Optimize creatives against CTA clicks, opt-ins, conversions, and more.
- Faster decisions with simplified, directional reporting.
- Production-safe testing with sticky allocation.
- Pause safely without breaking funnels.
- No spreadsheets or external testing tools required.
⚠️
Restrictions
- Available starting on ourPro Planand up.
- Beta scope: Regular videos only
- Smart Vids not supported
- No A/B/n or feature tests
- One primary goal metric per test
- No 95% statistical certification in this beta
- The same video cannot be included in two running tests simultaneously
- Draft tests can be deleted; archiving for finished tests is coming soon
If you have questions or feedback, reach out to hi@vidalytics.com