Clinical Pharmacy Services Inter-rater
Customize your policy alerts
Sign up for Peach State Health Plan Policy GA.PHAR.04 alerts
Get alerted when Policy GA.PHAR.04 changes without checking for updates manually.
Monitor payer policy activity
Defines Peach State Health Plan's process for assessing clinical pharmacists' consistency and validity in prior authorization (PA) application and decision making; applies to the Pharmacy Department clinical pharmacists reviewing PA requests for Peach State products (Medicaid, Ambetter).
No material clinical or coverage changes in this revision.
Inter-rater Reliability Assessment
Inter-rater reliability (IRR) assessment
Inter-rater reliability testing is conducted at least annually and follows the NCQA '8/30' methodology. Reviewers must reach 90% agreement on the initial sample or a resample is required.
Follows NCQA UM elements and the NCQA '8/30' methodology; final consensus and action plans (guideline development, training, process improvement) are documented and submitted to NCQA if inconsistencies are identified.
Sampling and Threshold Details
Reviewer Responsibilities and Risks
Inter-rater review requirement (annual NCQA 8/30 assessment)
Clinical pharmacists must be assessed at least annually using identical prior authorization cases selected by the Vice President of Clinical Pharmacy Services or designee following the NCQA '8/30' methodology: an initial sample of 8 identical PA cases is reviewed; if reviewers fail to reach 90% agreement on the initial 8 cases, 22 additional cases are presented for resampling.
- Annual testing required
- Initial sample: 8 identical PA cases
- Agreement threshold: 90% on initial sample
- If <90%, resample with 22 additional cases (8/30 rule)
Reviewer evaluation categories for IRR testing
Each reviewer must evaluate the selected test cases across specified categories including timeliness, clinical soundness, application of clinical criteria, medical necessity denials, relevance of clinical information, intent/meaning in provider letters, and clarity of denial language.
- Timeliness of pharmacy decisions/determinations (UM-5C)
- Decision is clinically sound
- Appropriate/consistency of use of clinical criteria (UM-2C)
- Appropriate medical necessity pharmacy denials (UM-4E)
- Relevant clinical information provided for pharmacy decision (UM-6C)
- Intent of meaning in provider letters
- Easily understood language/Criteria Reference on member denials (UM-7G)
Submission and record-keeping of IRR results
Reviewers must submit their decisions for each test case to the Vice President of Clinical Pharmacy Services and/or their designee; final consensus ratings and minutes will be documented and submitted to NCQA.
- Each reviewer submits decisions to the VP of Clinical Pharmacy Services/designee for evaluation
- If inconsistency is identified, findings and action plans are presented at a Clinical Staff Meeting
- Final documentation of consensus ratings will be included in meeting minutes and submitted to NCQA
Risk from inconsistent PA decisions and required remediation
Inconsistent application of prior authorization criteria by clinical pharmacists can lead to incorrect denials or approvals; IRR testing identifies variability so that action plans (guideline development, training, process improvement) can be implemented to ensure consistent decisions.
- Inconsistencies that prevent reaching 90% agreement trigger presentation of findings to all clinical pharmacists
- Required corrective actions include guideline development, training measures, and process improvement
Policy Context and Purpose
Inter-rater reliability (IRR) testing evaluates the consistency and validity of clinical pharmacists’ prior authorization (PA) decision-making against accepted standards to support quality assurance, minimize variation in guideline application, and identify process improvement opportunities.
Peach State conducts IRR testing on an at least annual basis following NCQA methodology (the "8/30 rule"). The process requires selecting 8 identical PA cases for all reviewers; each pharmacist submits decisions across specified categories (timeliness, clinical soundness, criteria application, medical necessity denials, relevant clinical information, intent/clarity of provider communications) to the Vice President of Clinical Pharmacy Services or designee for evaluation.
Reviewers must achieve 90% agreement on the initial 8-case sample. If consensus is not achieved, the policy requires presenting 22 additional cases for resampling. Any inconsistency (less than 90% agreement) will be addressed at a Clinical Staff Meeting and an action plan (e.g., guideline development, training, process improvements) will be implemented with documentation submitted to NCQA.
Key Terms
OpenPayer is powered by Trek Health's payer performance platform. Trek continuously ingests, validates, and normalizes Transparency in Coverage data alongside payer policies and other commercial payer data to create a structured payer intelligence foundation. OpenPayer uses this foundation to deliver personalized search results, dynamically generated policy pages, and tailored policy monitoring based on each user's payers, specialties, billing codes, and areas of interest. The same intelligence powers broader payer performance workflows, including reimbursement benchmarking, contract evaluation, payer negotiations, and financial decision-making.