Celoria Marketing Experiment Platform

A/B Testing: Compare AI Voice vs AI SMS vs Human Outreach Effectiveness

Demo Version
2026.02

Platform Overview

Strategy Library
Create & manage outreach strategies
Audience Targeting
Tag-based precision targeting
A/B Experiments
Compare strategy effectiveness
Analytics
Data-driven decisions

Workflow

1
Build Strategy
Design outreach workflow
2
Select Audience
Tag-based filtering
3
Run Experiment
A/B test strategies
4
Analyze Results
Pick the winner

Strategy Builder

Create multi-step outreach strategies with branching and conditions

Strategy Library

Lapsed Customer Win-back
4 steps · Used 12 times
New Customer Welcome
2 steps · Used 8 times
VIP Personal Follow-up
3 steps · Used 5 times
Appointment Reminder
3 steps · Used 20 times

Lapsed Customer Win-back

Edit strategy steps
AI SMS Step 1: Send Win-back Message
Hi {{guest.first_name}}, we miss you! It's been a while since your last visit. Book this week and enjoy 20% off your next service!
Sent successfully → Continue to Step 2 | Failed → Retry 2 times then end
Wait Step 2: Wait for Response
Wait for 24 hours
Wait complete → Continue to Step 3
Condition Step 3: Check Response
Condition: Did customer reply?
Yes → End flow (responded)
No → Continue to Step 4
AI Voice Step 4: Voice Follow-up
Script:
Hi {{guest.first_name}}, this is Celoria Nail Spa. We noticed you haven't visited us in a while and wanted to personally invite you back...
Call complete → End flow

Available Node Types

Action Nodes

AI SMS
Send smart text messages with variables
AI Voice
Intelligent voice calls with custom scripts
Human Task
Assign tasks to staff members

Control Nodes

Wait
Condition
Retry
Parallel
Time Filter
Rate Limit

Audience Targeting

Target customers precisely using tags with complex logic combinations

Audience Builder

Estimated reach: 1,234 customers
Condition Group
Inactive 30+ days
AND
In another experiment
AND
Nested Condition Group
Spent $500+
OR
VIP Customer
Logic Expression Preview
(Has "Inactive 30+ days") AND (NOT "In another experiment") AND ((Has "Spent $500+") OR (Has "VIP Customer"))

Available Tags

Active 7 days Inactive 30+ days Inactive 60+ days New Customer VIP Customer Spent $500+ Spent $1000+ Birthday this month Weekend preference Had manicure Had spa Never cancelled View all →

Experiment Setup

Create A/B experiments to compare different strategies

Leave empty for no limit - all matching customers will participate

Group Configuration Preview

Control 33%

Group A: SMS Only

Strategy: New Customer Welcome
Est. 411 participants
Treatment 33%

Group B: SMS + Voice

Strategy: Lapsed Customer Win-back
Est. 411 participants
Treatment 34%

Group C: Human Follow-up

Strategy: VIP Personal Follow-up
Est. 412 participants
Total participants: 1,234

Analytics

Real-time experiment tracking and data-driven insights

Overall Reach Rate
87.3%
↑ 12% vs previous
Overall Response Rate
34.2%
↑ 8% vs previous
Overall Conversion Rate
12.8%
↑ 3% vs previous
Overall ROI
4.2x
↑ 0.8x vs previous

Strategy Performance Comparison

Group Reach Rate Response Rate Conversion Rate Avg. Ticket ROI Confidence
Group A: SMS Only (Control)
92.1% 18.5% 6.2% $85 2.1x
Group B: SMS + Voice Winner
89.3% 42.8% 18.5% $92 5.8x 98.2%
Group C: Human Follow-up
78.4% 48.2% 15.6% $128 3.2x 72.5%

Funnel Analysis - Group B: SMS + Voice

411
Total Participants
100%
367
SMS Delivered
89.3%
176
Responded
42.8%
95
Voice Follow-up
23.1%
76
Booked
18.5%

Time Metrics

Avg. Response Time 2.3 hours
Avg. Time to Conversion 18.5 hours
Human Task Completion Time 4.2 hours

Risk Metrics

Opt-out Rate 0.8%
Complaint Rate 0.2%
Human Task Completion Rate 78.4%

AI Recommendation

Based on experiment data analysis, Group B: SMS + Voice strategy performs best with a conversion rate 198% higher than control, ROI improvement of 176%, and statistical confidence of 98.2%. We recommend rolling out this strategy for all lapsed customer win-back campaigns.