Frequently asked question relating to Inter-scorer reliability programs and AASM network accreditation requirements.
Where can I obtain information about the Network accreditation standard for Inter-scorer Reliability?
The AASM Standards for Accreditation, page 16, provides details regarding the Inter-Scorer Reliability Standard (N-24). The ISR Fact Sheet provides additional information.
Which sleep staff are required to participate in an Inter-scorer Reliability program?
All scoring technologists: Technical staff members who score sleep studies for the sleep facility. This includes:
- Those who score even a single record.
- Subcontracted scorers.
What are the requirements for conducting an Inter-scorer Reliability program?
Technical scoring staff must complete the following for ISR assessment:
- Twelve polysomnograms (PSGs) are conducted annually, analyzing 200 consecutive epochs per study.
- Score four parameters: staging, respiratory events, leg movements, and arousals.
- The Network Director must sign and date the quarterly report, confirming review and noting any corrective actions taken, if necessary.
Are we required to use the Sleep ISR platform to meet the AASM accreditation standard for Inter-Scorer Reliability (N-24)?
No, using the Sleep ISR platform is optional if an inter-scorer reliability program is utilized and meets the standard.
What are the benefits of using the Sleep ISR platform to meet the AASM accreditation standard for Inter-Scorer Reliability (N-24)?
The Sleep ISR platform offers several key benefits for achieving compliance with the standard:
- Streamlined Compliance: The platform simplifies adherence to the N-24 ISR by providing effective reporting tools. Administrators can generate detailed performance reports that align with the AASM Gold Standard Panel.
- Improved Accuracy and Continuing Education: Sleep staff can score monthly sleep records and watch review videos that enhance their understanding and accuracy while earning continuing education credits (Technologist CEC and Physician CME).
- Performance Tracking and Tailored Training: Administrators can review individual staff performance to identify strengths and areas for improvement, enabling customized training.
- Training Resources for New Staff: The Sleep ISR Scoring Course offers interactive learning modules, and archived records provide practical scoring practice, helping new staff build confidence and refine their skills.
What is the Sleep ISR Gold Standard level of agreement required to pass the monthly assessment records overall?
The Gold Standard passing average is 85%, based on four scoring parameters: staging (evaluated epoch by epoch), respiratory events, leg movements, and arousals.
How long are Sleep ISR records accessible after their release?
Sleep ISR records are accessible for 90 days to score and submit for a grade. Adult records are released on the 1st of each month, and pediatric records on the 15th. Expiration dates are posted under each record title noted on the Scoring Dashboard.
Are Sleep ISR records required to be scored and graded on their opening date?
No, Sleep ISR records are not required to be scored and graded immediately upon opening. Sleep staff can access a record, start scoring, save their progress, and return to complete and submit it for grading any time before the 90-day expiration date.
What are the AASM’s rules for failing to complete and submit an ISR record before the 90-day expiration date?
According to AASM Sleep ISR rules, active sleep staff must score and submit an Adult or Pediatric record within 90 days of its release by the expiration date. If this is not done, the following consequences will occur:
- Unfinished or incomplete records will automatically close at 11:59 PM CT on the expiration date and will be graded. This grading could result in a failing grade, and once a record has been graded, the outcome is final. The record cannot be reopened, rescored, or removed.
- Unopened records will be automatically deleted at 11:59 PM CT on expiration. Once deleted, a record cannot be re-added to the staff member’s account, nor can it be made up by scoring a record from our Archive Record library.
Are sleep staff allowed to retake the Sleep ISR record to improve their score if they did not achieve the Gold Standard passing average of 85%?
No, the Sleep ISR records are designed to assess the proficiency of sleep staff by requiring them to complete 200 consecutive epochs of a masked PSG study, which will result in a pass-or-fail outcome. Once the record has been graded, the overall score will be final, and the record cannot be reopened for improvement.