Clinical Pharmacy Services Inter-Rater Reliability
Customize your policy alerts
Sign up for Ambetter Georgia Policy GA.PHAR.04 alerts
Get alerted when Policy GA.PHAR.04 changes without checking for updates manually.
Monitor payer policy activity
Defines the Ambetter Georgia (Peach State Health Plan) Pharmacy Department process for annual inter-rater reliability testing of clinical pharmacists performing prior authorization reviews to ensure consistent application of PA criteria and clinical decision making.
No material clinical or coverage changes in this revision.
Coverage & IRR Testing Criteria
IRR sampling and agreement criteria
IRR testing is conducted at least annually and follows the NCQA '8/30' methodology.
If >=90% agreement among raters on these 8 cases, IRR considered acceptable
Process follows NCQA '8/30' rule
Review criteria categories
Each reviewer will assess each case across specified categories and submit decisions for evaluation.
Each reviewer submits their decisions to the Vice President of Clinical Pharmacy Solutions (or designee) for evaluation
This policy applies to the annual assessment of clinical pharmacists who perform prior authorization (PA) reviews for Ambetter Georgia (Peach State Health Plan). It defines the Department of Pharmacy process for conducting inter‑rater reliability (IRR) testing of pharmacists’ PA decision‑making to ensure consistent application of PA criteria and clinical determinations. The policy is informational regarding the IRR process and does not define coverage for specific drugs or therapies.
Referenced Standards & Thresholds
| UM-2C | Appropriate/consistency of use of clinical criteria |
| UM-4E | Appropriate medical necessity pharmacy denials |
| UM-5C | Timeliness of pharmacy decisions/determinations |
| UM-6C | Relevant clinical information provided for pharmacy decision |
| UM-7G | Easily understood language/Criteria Reference on member denials |
Operational Actions, Sampling & Documentation
PA case sampling (8/30 NCQA methodology)
PSHP will select eight prior authorization requests for the initial IRR test and present identical cases to clinical pharmacists; if reviewers do not achieve >=90% agreement on those 8 cases, PSHP will present 22 additional cases for resampling (total 30) following the NCQA '8/30' rule.
- Initial sample: 8 PA requests selected by PSHP Vice President of Clinical Pharmacy Services or designee
- If <90% agreement on initial 8 cases → present 22 additional cases (total 30) for resampling
Step therapy applicability — not applicable
Step therapy rules do not apply in this policy; the document addresses inter-rater reliability testing of PA decision-making rather than imposing specific step therapy requirements.
Audit documentation and record retention
Document consensus outcomes, meeting minutes and action plans, and retain electronic approval records; final documentation of consensus and minutes will be included and submitted to NCQA, and electronic approval retained in the system is considered equivalent to a signature.
- Record minutes from Clinical Staff Meeting that documents inconsistencies, agreed action plans (guideline development, training, process improvement) and final consensus
- Submit documented minutes and action plans to NCQA
- Retain electronic application/approval records (electronic approval considered equivalent to a signature)
Risk from inconsistent PA application
If consistent application of PA criteria is not achieved (IRR <90%), the IRR process may identify potentially avoidable utilization and lead to inconsistent medical necessity determinations; identified inconsistencies must be addressed at a Clinical Staff Meeting with an action plan to correct variation.
- Present findings demonstrating inconsistency at a Clinical Staff Meeting with all clinical pharmacists
- Develop and document an action plan (e.g., guideline development, training, process improvements) to reduce variation
Background & Purpose
The purpose of this policy is to evaluate and improve the consistency and validity of clinical pharmacists’ prior authorization decisions by conducting annual IRR testing. The IRR program supports adherence to NCQA standards, minimizes variation in application of clinical guidelines, identifies potentially avoidable utilization and opportunities for process improvement, and documents reliability of decision/recommendation‑making related to PA reviews.
Key Definitions
OpenPayer is powered by Trek Health's payer performance platform. Trek continuously ingests, validates, and normalizes Transparency in Coverage data alongside payer policies and other commercial payer data to create a structured payer intelligence foundation. OpenPayer uses this foundation to deliver personalized search results, dynamically generated policy pages, and tailored policy monitoring based on each user's payers, specialties, billing codes, and areas of interest. The same intelligence powers broader payer performance workflows, including reimbursement benchmarking, contract evaluation, payer negotiations, and financial decision-making.