Rewards Program FAQs
1. What is the Record Rewards Program?
Record Rewards is the first step in an effort to grow Sleep ISR and address the needs of a changing Sleep Medicine field. In order to provide a range of diverse records for Sleep ISR scoring, and successfully evaluate machine learning software packages, a variety of sleep studies that are representative of our patient populations is needed. By uploading sleep studies, you are adding to that mix and are helping the field move forward and innovate in a way that promotes population health parity and oversight of emerging technologies. Starting soon, the AASM will be using these records to evaluate the performance of existing AI sleep scoring packages and compare them to records scored by humans.
2. Why has the Record Rewards Program been developed?
The AASM has recognized the increased use of automated scoring approaches in sleep disorders centers. A beta test has been developed that will evaluate these software packages to aid centers in their selections by setting a benchmark that each AI program must meet.
3. How does Record Rewards work?
The AASM will be collecting studies through the Sleep ISR platform and uploaded studies will be subject to a comparison process of manual scoring to AI scoring.
Starting soon, AI polysomnography software will be able to apply to receive stage-only auto-scoring certification from the AASM. To do so, the software manufacturer must demonstrate that their AI/auto-scoring system has comparable accuracy to records scored by humans.
In order to successfully evaluate these innovative software packages, a diverse collection of sleep studies that are representative of our diverse patient populations are needed. By uploading sleep studies, you are adding to that list of diverse patient populations and are helping the field move forward and innovate.
In exchange for your record submissions, we will give you points that can be redeemed for items such as Amazon gift cards. To make it fun, we even have bonus opportunities to earn points faster. We look forward to your participation!
4. How do I sign up for the Record Rewards Program?
To opt-in, you must be a Sleep ISR account administrator (if you are a standard user, contact your administrator about enrollment). Participation in the Record Rewards Program follows a brief “opt-in” process.
Admins first login to your ISR account and go to the Submit Sleep Study dropdown under the Rewards Program header. Click enroll in the prompted message below, review the AASM Participation Agreement, and check the box if you agree to these terms.
Next you will Select a Default Staff Permission level for users in your Sleep ISR account: Grant Access, which immediately allows all users to upload records, or No Access, the permission level where you will need to pick and choose users to add manually in the next step.
The final opt-in admin page is Manage Staff where you can individually establish settings for each of your users using the dropdowns in the Rewards Access column.
Once the opt-in process is completed, you and users who have been granted access will be able to select either of the the following dropdowns: Submit Sleep Study or Submission History, under the Rewards Program header on Sleep ISR. (It is recommended that you notify active standard users about the program to begin uploading records.)
5. How do I submit a sleep study?
Make sure you have permission / approval to submit a sleep study either on your facility account (if you are not an administrator, you will need to ask for access). Once you are given permission, go to Submit Sleep Study under Rewards Program header. Each record should meet EDF Requirements before it is uploaded for a quality check.
Record Submission Qualification:
-
Full polysomnogram (accepted types: Diagnostic and Therapeutic, Type I or Type II) with all PHI removed and converted to EDF+ format.
-
Study has at least 200 continuous epochs with all recorded signals present.
-
Sleep record has not been exposed to AI clinical scoring application or AI research
Full polysomnogram (accepted types: Diagnostic and Therapeutic, Type I or Type II) with all PHI removed and converted to EDF+ format.
Study has at least 200 continuous epochs with all recorded signals present.
Sleep record has not been exposed to AI clinical scoring application or AI research
Next, upload your study on the Submit Sleep Study tab from the dropdown menu in the Rewards Program section of your account. Once the upload process is completed, click Submit for Review and check on the Submission dropdown where you will see a dashboard displaying the review status. (Please allow approximately 5-30 minutes to see results.)
6. How do you ensure that patient information is secure?
During the EDF conversion process, you will only export raw data and will select de-identify to remove all identifying information from the study in the output file before it is uploaded and sent to the AASM. Some sleep software systems use an “Anonymize” checkbox to remove PHI from the exported file before exporting. If for some reason PHI is not removed before uploading, the AASM automatically processes each study to remove PHI.
7. Why did my record submission fail to earn points?
Points are not awarded if a record fails to meet EDF Requirements as part of our standardized quality check. It must be a full PSG that has not been previously uploaded to the Rewards Program, with all PHI removed and converted to EDF+ format. It must have at least 200 continuous epochs with all recorded signals present, and it must not have been exposed to AI clinical scoring application or AI research.
8. Is there an agreement that I can send to my Compliance and Legal team for approval or to participate in this program?
Yes, you can download and print a copy of the Sleep ISR Record Review agreement by clicking Enroll Now on the Submit Sleep Study or Get Rewards dropdown under the Rewards Program section of your Sleep ISR account.
9. I am not an administrator but would like to know how to submit a study as a staff scorer?
You will need to contact your administrator for permission and guidance on how to enroll in order to submit sleep studies to the sleep study submission program.
10. I am enrolled in Sleep ISR as an individual user not associated with a facility. How can I submit a sleep study to the Rewards Program?
The Rewards Program is currently only available to Sleep ISR institutions that have an administrator account associated with it.
11. How do I earn and redeem rewards?
One (1) point is awarded for every record submission that passes all quality checks. There is a 20-point bonus for a first successful submission. A 50-point bonus will be awarded for every record used in Sleep ISR. Each point is worth approximately $1 in value. Points would expire two years after being issued.
Currently, rewards points can be cashed in for Amazon gift cards for a $25 minimum. These cards will be sent to the instutition subscribed to Sleep ISR to be distributed in whatever manner decided upon by them.
12. Who is eligible to receive the rewards?
Administrators will have the ability to redeem rewards, which will be mailed to the address provided during checkout. Each institution may distribute rewards in whatever manner is decided upon by the institution.
13. How can I check to see if a sleep study has already been uploaded?
The Submission History drop-down tab under the Rewards Program header will show a list of any sleep studies your facility submitted to Sleep ISR along with its status.
14. If my record is selected for Sleep ISR or the AI Scoring Certification Program, will the identity of my institution be revealed?
No. If one of your records is chosen, the AASM will not release your information in any way that identifies your institution or employees. See the Participant Agreement on the Sleep ISR website for more information.
15. Why are you supporting an AI scoring project that may help eliminate jobs for sleep technologists?
The AASM is not trying to eliminate sleep technologist jobs. The AASM is looking into auto-scoring technology and has not made a decision on its role in the future of sleep medicine. That’s why we are starting a limited pilot program evaluating the stage scoring accuracy of AI software packages.
One of the things we hope to learn/accomplish through the pilot program is how best to manage a certification program that causes the LEAST amount of disruption within a sleep lab as possible. The reality is that auto-scoring software has already been developed and is innovating rapidly thanks to advances in AI and machine learning. The AASM believes the field is likely better off with oversight of these systems than without.