Performing User Acceptance Testing (UAT) on a Collection

Overview

User acceptance testing (UAT) allows you to test your collection from the perspectives of site staff and study participants. We recommend that you perform UAT on a collection before approving it for use to confirm that your collection and its surveys, schedules, notifications, events, and translations align with your study protocol.

A collection must have all of the following items before you can start UAT and approve it for use:

At least one survey
At least one schedule for each survey
Complete translations for all languages in the collection

In addition, you need a ePRO Vault sandbox in which you’ll perform UAT. Contact your Veeva Professional Services team if you do not already have a ePRO Vault sandbox.

Setting up the Sandbox

You can add a study in the ePRO Vault sandbox after UAT has been started. Create a new study in the sandbox instance using the method below.

Use a UAT Code

You can only use this option when no collections are in the sandbox study yet.

In the production instance of Studio, open the approved collection.
Select the ellipsis button next to the version number, and select Copy UAT Setup Code.
Open the sandbox instance of Studio.
Select Use UAT Code, enter the code from Step 1, and select Connect. All collection versions from the production version are displayed in the sandbox version, and the New Version button is disabled. If the study has previously had a collection created, a new study will be required.

The sandbox information automatically updates when collection versions are changed and new rounds of UAT are begun on the production study.

Note: You can only connect a production study to a single study in the sandbox.

Performing UAT

Once UAT is set up, the collection will already be activated when you log in to the Veeva ePRO sandbox as a site user. During UAT, you can use the sandbox to complete the same workflows that site staff use to submit surveys and manage survey activities for study participants and/or caregivers. You can also test how study participants and/or caregivers receive notifications and submit surveys in MyVeeva for Patients. To test both user roles and create an end-to-end test of your collection, complete the following steps. See ePRO Help for more information about each step.

Note: If you do not allow caregivers to answer surveys as part of your study, you do not need to test their survey access.

#	Step	Testing User Role	Instructions	Additional Resources
1	Add Countries, Sites, and Site Users	Sponsor/CRO Staff	Create any countries and sites and site users that you want to use for testing. Ensure that the supported languages are selected at the country and site level that meet your UAT requirements.	Adding Studies, Study Countries, and Study Sites.
2	Create Participants	Site Staff	Create study participants to test surveys, schedules, and notifications. To test email notifications from MyVeeva for Patients, you must create the participant record using an email account you can access. Note: Emails must be unique across participants. We recommend using email aliases if you create more than one participant for testing. For example, if Participant 1’s email address is jane.doe+1@veeva.com and Participant 2’s email address is jane.doe+2@veeva.com, notifications for both participants are sent to jane.doe@veeva.com. Not all email providers support email aliases. Veeva recommends using Gmail.	Managing Study Participants in ePRO Help
3	Register and Log In To MyVeeva for Patients	Study Participant	MyVeeva for Patients is the application that study participants and caregivers use to receive, complete, and submit surveys. After a participant has been added, the participant and/or caregiver receives a MyVeeva for Patients welcome email. You can register the account of the participant and/or caregiver by following the link from the email. You must use a sandbox MyVeeva for Patients environment to test surveys with the participant and/or caregiver account you created. See the Logging In to the MyVeeva for Patients Android, iOS, and Web Apps section to set up access to the sandbox environment.	See the following pages in ePRO Help: Completing Registration Answering Surveys
4	Add Participant Event Dates and Times	Site Staff	Enter datetimes for participant events to trigger surveys and notifications as defined in the collection. You can enter participant event datetimes in the past to simulate how schedules appear to a participant and/or caregiver in the future. For example, if a survey schedule has a delay of 1 hour before the survey is made available to the participant, you can add a participant event that's 59 minutes in the past. After one minute, the survey will be available.	Viewing, Activating, and Updating Events in ePRO Help
5	Submit Surveys in MyVeeva for Patients	Study Participant	When you add participant event datetimes for the study participant, the participant and/or caregiver receives notifications and surveys in MyVeeva for Patients as defined in the collection. Confirm that the participant and/or caregiver receives the expected notifications. Log in to MyVeeva for Patients at the appropriate time to receive, complete, and submit surveys.	Submitting Surveys in ePRO Help for Sites
6	Submit Site Surveys in ePRO	Site Staff	After you add participant event datetimes for the study participant, any site surveys associated with those events are available for site staff to submit.	Completing an In-Person Survey in ePRO Help
7	Export UAT Data from Study Home	Site Staff and Sponsor/CRO Staff	After study participants, caregivers, and site staff submit or miss surveys, the survey and compliance data is available to sites and sponsor users through either Veeva ePRO (Sites) or Study Home (Sponsor) in the ePRO Vault Sandbox. Site Staff: Run the reports from the Study Details tab in ePRO to export Survey and Compliance data. Sponsor Staff: Using Study Home, export Survey and Compliance data from the reports tab.	See the Running Reports section on the Viewing Compliance in Study Home page for information on how to export site-facing UAT survey data.
8	Complete UAT	Sponsor/CRO Staff	When UAT is complete, navigate to the collection in Studio and select Finish UAT, then select the appropriate outcome depending on the outcome of your testing. If UAT passes, select Yes, Complete UAT. If changes are needed, select No, Make Changes. Editing is unlocked and you can resume making changes to the collection. After you make changes, you can start UAT again. If you need to make changes after you have completed UAT, you can select the All Actions button and select Back to Draft to make additional edits. The summary of changes entered before is retained, and you'll have to start and complete the UAT again to move it back to the UAT Passed status. You can't make any more changes after you approve the collection.	Approving an ePRO Collection

Logging In to the MyVeeva for Patients Android, iOS, and Web Apps

Once a collection has been approved in your ePRO Vault sandbox, you can test participant and caregiver survey actions in the MyVeeva for Patients Android, iOS, or web app. To test in the apps, complete the following steps

Android or iOS

Download the MyVeeva for Patients Android app from Google Play or the MyVeeva for Patients iOS app from the App Store.
Create a participant or caregiver. For more information, see Creating a Participant on the Onboarding Participants page in ePRO Help for Sites.
Enter the username from Step 2 with |sbx added to the end. For example, if your participant’s email is jane.doe+1@veeva.com, enter your username as jane.doe+1@veeva.com|sbx.
Enter your password.
When the app requests a multifactor authentication code, enter any six digits. You’re now logged in.

Web

Go to https://patients-sbx.myveeva.com.
Enter your username and password.
When the app requests a multifactor authentication code, enter any six digits. You’re now logged in.