Statistical analysis · About 8 min

DataCello ProThis workflow requires Pro.

Test whether average order value differs between A and B

Run DataCello Pro's t-test for two A/B groups and read the p-value, Cohen's d, group summaries, and box plot together.

Outcome
Evaluate a two-group mean difference with a p-value and effect size
Verified against
DataCello 4f9fe8d
Hypothesis-test results and group summaries in DataCello
Hypothesis-test results and group summaries in DataCello

This analysis requires DataCello Pro

Running the test requires DataCello Pro. The dataset needs a group field with exactly two values and a numeric order-value field. Also confirm that each row can be treated as an independent observation.

Configure the t-test

  1. Select the A/B dataset, click the Analysis tab, and choose Hypothesis Test.
  2. Select t-test from the method menu.
  3. Set order value as Target and the A/B field as Group.
  4. Resolve the run checklist at the top and click Run.
Detailed hypothesis-test result with group summaries
Detailed hypothesis-test result with group summaries

DataCello uses Welch's t-test here, rather than Student's t-test with an equal-variance assumption.

Read p-value and effect size together

The result includes the test statistic, p-value, Cohen's d, group count, mean, median, standard deviation, and a box plot.

  • The p-value relates the observed result to a no-difference assumption.
  • Cohen's d standardizes the size of the mean difference.
  • Summaries and the box plot show spread and possible outliers.

Decision limits

A test result alone does not prove the causal effect of a treatment. Review random assignment, observation period, repeat users, attrition, and sample size. A paired t-test is not part of this workflow.

DataCello for Mac

Try it with your own data.

Start by importing and inspecting your dataset.

Download on the Mac App Store