Clearwinner App Installation Guide

The Clearwinner Marketplace app in Contentstack automates the post-test cleanup process for A/B test experiences run through Contentstack Personalize.

When an A/B test concludes, the traditional process requires manually merging variant changes into baseline entries, publishing updates, and archiving the test. ClearWinner eliminates this manual effort by identifying winning variants and executing a single-click merge and publish workflow.

• Efficiency: Automatically merges winning content into baseline entries in the background.
• Accuracy: Reduces human error by automating data cleanup and variant deletion.
• Streamlined Workflow: Publishes updated entries to your live environment and archives the test in a single step.

• Contentstack account
• Access to the Contentstack Organization/Stack as the Owner/Admin
• At least one active A/B test experience set up in Contentstack Personalize

To install the app in Contentstack, log in to your Contentstack account and follow the steps below:

1. Navigate to the App Switcher icon in the top-right corner and click Marketplace.
   
   Click to enlarge
   
   
2. Click Apps from the left panel.
3. Within the Marketplace, you can see the available apps. Hover over the Clearwinner app and click Install.
4. In the pop-up window, select the stack where you want to install the app, accept the Terms of Service, and click Install.
5. On the App Configuration screen, click Authorize to allow Clearwinner to access your Contentstack data via the OAuth flow.
   
   Click to enlarge
   
   
6. On the UI Locations tab, you can see the predefined app location (Stack Dashboard Location). You can use the toggle button corresponding to enable or disable it based on your requirements.
   
   Click to enlarge
   
   

   Additional Resource

   • For more information on UI location, please refer to the Installed Apps guide.

Note Authorization is performed once per organization. Once authorized, ClearWinner is accessible to all users in the organization and operates with the permissions of the authorizing user. There are no per-user permission controls at this time.

To use the Clearwinner app, log in to your Contentstack account and follow the steps below:

1. Navigate to the App Switcher icon in the top-right corner and click Clearwinner.
   
   Click to enlarge
   
   
2. Use the dropdown menu to choose the Personalize project containing the A/B tests you want to manage.
   
   Click to enlarge
3. Review your A/B tests across the following three tabs on the dashboard:
   • Ready to merge: Tests where Personalize has identified a winning variant.
   • Pending A/B tests: Tests that are still running with insufficient data to determine a winner.
   • Merged A/B tests: A read-only historical log of tests already processed by Clearwinner.

   For each test in the Ready to merge tab, the dashboard displays the test name, status, leading variant with its statistical confidence level, and the last modified date.

   Clearwinner surfaces the statistical confidence levels reported by Contentstack Personalize:

   • Has_Won: The variant has reached full statistical significance (strongest signal).
   • Leading Significantly: The variant is substantially ahead but below the final threshold.
   • Leading: The margin is currently ahead but not yet statistically significant.
     
     Click to enlarge
4. Select one or more tests on the Ready to merge tab using the checkboxes and click Review and Merge.

   Note

   • Only one merge job can run at a time. If a merge is already in progress, an error will be displayed and you cannot start a new job until the current one completes.
   Click to enlarge
5. Review the summary of tests, winning variants, and updated entries, then click Merge.
   
   Click to enlarge
   
   
6. A final confirmation dialog will appear, stating that the following actions will occur:
   • Winning variant content changes will be merged into baseline entries.
   • Updated entries will be published to the live environment.
   • The A/B test will be archived in Personalize.
   • All variant entries and variant groups will be permanently deleted.
7. In the final confirmation dialog, click Confirm.

   Warning This action is irreversible. The variant data will be permanently deleted once the merge completes.
   

   Click to enlarge
8. Monitor the merge job's live progress via the indicator. You may navigate away; the background process will continue.

   Note

   • Entries are merged one at a time. For tests with a large number of entries, the merge job may take several minutes.
9. Verify completed merges in the Merged A/B tests tab, which provides a read-only record including:
   • Test name and description
   • The merged winning variant
   • Number of entries updated
   • Timestamp of the merge
     
     Click to enlarge

• Sequential Entry Processing: Entries are merged one at a time. Tests with many variant entries will take longer to complete.
• Shared Authorization: Once authorized, the app is available to all users in the organization and operates with the permissions of the user who performed the authorization.
• One Merge Job at a Time: Only one merge job can run per project at a time. Attempting to start a second job while one is in progress will result in an error.

If you encounter an authorization error, navigate to Settings > Apps > Clearwinner > App Configuration and click Authorize again to refresh the OAuth token.