














Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
uses the Global Initial Patient Population, use sampling methodology number one. Specifications Manual for National Hospital Inpatient Quality Measures.
Typology: Exercises
1 / 22
This page cannot be seen from the preview
Don't miss anything!















Last Updated: Version 5.
Population and Sampling Specifications
Introduction
Population
Defining the population is the first step to estimate a hospital’s performance. A population is generally defined as a collection of patients sharing a common set of universally measured characteristics, such as an ICD-10 principal diagnosis or procedure code. The Initial Patient Population and diagnosis codes meet this description for the national quality measures. For the purpose of measuring national quality measures, the term “Initial Patient Population” is defined below:
An “Initial Patient Population” refers to all patients (Medicare and non-Medicare) who share a common set of specified, administratively derived data elements, with a length of stay less than or equal to 120 days ( Admission Date minus Discharge Date less than or equal to 120 days). This may include ICD-10-CM diagnosis codes or other population characteristics such as age. For example, the population for the Sepsis measure includes all patients with an ICD-10-CM Principal or Other Diagnosis Code as defined in Appendix A, Table 4.01 and a Patient Age ( Admission Date minus Birthdate ) greater than or equal to 18 years.
Cases identified as being in the Initial Patient Population for the measure set, strata, or sub-population are eligible to be sampled. For the definition of the Initial Patient Population(s) for each measure set, refer to the appropriate Initial Patient Population discussion in the Measure Information section of this manual.
Sampling
Sampling is a process of selecting a representative part of a population in order to estimate the hospital’s performance, without collecting data for its entire population. Using a statistically valid sample, a hospital can measure its performance in an effective and efficient manner. Sampling is a particularly useful technique for performance measures that require primary data collection from a source such as the medical record. Sampling should not be used unless the hospital has a large number of cases in the Initial Patient Population because a fairly large number of sample cases are needed to achieve a representative sample of the population. For the purpose of sampling national quality measures, the terms “sample” and “case” are defined as below:
Specifications Manual for National Hospital Inpatient Quality Measures
To obtain statistically valid sample data, the sample size should be carefully determined and the sample cases should be randomly selected in such a way that the individual cases in the population have an equal chance of being selected. Only when the sample data truly represent the whole population can the sample-based performance measure data be meaningful and useful.
Each hospital is ultimately responsible that sampling techniques applied for their hospital adhere to the sampling requirements outlined in this manual. ORYX®^ Vendors are responsible for ensuring that the sampling techniques are applied consistently across their client hospitals.
Sampling is done by national quality inpatient measure set, except for the following measure sets. Both Venous Thromboembolism (VTE) and Stroke (STK) are sampled by sub-populations. Sampling for the Global (GLB) measure sets, which includes Emergency Department (ED), Immunization (IMM), Substance Use (SUB), and Tobacco Treatment (TOB) is done once for all the cases that fall into the Global and not for each individual measure set. For The Joint Commission, hospitals must submit the same case for all applicable measure sets (i.e., ED, IMM, SUB and TOB) under the Global Initial Patient Population.
Example: Joint Commission Data Warehouse: If a hospital has elected to submit ED, TOB and IMM to The Joint Commission, for every ED case, the hospital is encouraged to submit the same case also as a TOB case and an IMM case. The same holds true regardless of the combination of measure sets (ED, IMM, SUB, TOB) the hospital has elected to submit to The Joint Commission.
For CMS, if the hospital is submitting both ED and IMM as chart abstracted measures, the hospital is encouraged to submit the same case to the CMS Clinical Warehouse for both measure sets. For measures requiring medical record abstraction, sampling must be done using available databases that contain all discharges for the transmission quarter.
Note: Hospitals are NOT required to sample their data. If sampling offers minimal benefit (i.e., a hospital has 80 cases for the quarter and must select a sample of 76 cases) the hospital may choose to use all cases.
Order of Data Flow The required sampling methodology is dependent upon the measure sets being submitted to the CMS Clinical Warehouse and/or Joint Commission’s Data Warehouse.
Specifications Manual for National Hospital Inpatient Quality Measures
1. Hospitals Submitting Measure Sets Under the Global Initial Patient Population to Both the CMS Clinical Warehouse and The Joint Commission’s Data Warehouse For the submission of the Global Initial Patient Population and associated measure sets (i.e., ED, IMM, TOB, and/or SUB) the following data flow or process steps should be used to identify the data for all measure sets or stratum that are transmitted to the CMS Clinical Warehouse and Joint Commission’s Data Warehouse. These process steps are:
Identify Global Cases To Be Abstracted (ED, IMM, SUB, TOB)
Identify Cases To Be Abstracted For The Remaining Measure Sets, Strata, and Sub-populations (SEP, STK, VTE)
Specifications Manual for National Hospital Inpatient Quality Measures
Patient Population of each measure set, strata, and sub-population are collected in the appropriate Initial Patient Population Size data elements. o If the hospital is not sampling, collect or abstract from the identified medical records the general and measure specific data elements that are needed for the measure set(s), strata or sub-populations. The count of the number of cases used in this step is collected in the Sample Size data elements. o If the hospital is sampling, use the Initial Patient Population (N) identified above and pull the sample of medical records for the measure set, strata or sub-population using the “Sample Size Requirements” in the appropriate sampling discussion in the Measure Information section of this manual.
Example: For 4 th^ quarter the Global Initial Patient Population is 1550 and for SEP. If the hospital is sampling, the minimum number of cases that would be required to be sampled would be 306 for Global (ED, IMM, TOB, and/or SUB) and 30 for SEP.
Specifications Manual for National Hospital Inpatient Quality Measures
Medical Record (paper or electronic)
Abstract data for identified cases and run data through the algorithms for the measure set (SEP, STK, VTE)
Determine the number of cases that need to be sampled ( n ) from the cases in the other measure sets, strata, or sub-populations Initial Patient Population ( N ). Use the “Sample Size Requirements” in the appropriate Sampling discussion in the Measure Information section of this manual.
Using administrative data, identify cases in the Initial Patient Population of the other measure sets (SEP), strata or sub-populations (STK, VTE). For more information, refer to the appropriate Initial Patient Population discussion in the Measure Information section of this manual.
Is hospital sampling the Global population?
Using administrative data, identify cases in the Global Initial Patient Population. For more information, refer to theGlobal Initial Patient Population Section of this manual. Note: Done once for each Hospital. This is not performed for each measure set that utilizes the Global population.
Identify and count the number of cases already in the Global Sample that are also in the other measure sets (SEP), strata or sub-populations (STK, VTE) Initial Patient Population(s).
Pull identified medical records
Are there enough Initial Patient Population cases in the Global Sample?
Complete the Sample by pulling additional cases from the other measure sets, strata, or sub-populations Initial Patient Population(s). Use the “Sample Size Requirements” in the appropriate Sampling discussion in the Measure Information section of this manual.
Yes
No
Yes No additional Sampling required
No
Pull the Global Sample from the cases in the Global Initial Patient Population. Use the “Sample Size Requirements” in the Global Initial Patient Population Section to determine the number of cases to sample for the Global Sample. Note: Done once for each Hospital. This is not performed for each measure set that utilizes the Global population.
Medical Providers Identify Global cases to be abstracted (ED, IMM, SUB, TOB)
Identify cases to be abstracted for the remaining measure sets, strata, and sub-populations (SEP, STK, VTE)
Global Order of Data Flow/Process Steps
Abstract data for identified cases and run data through the algorithms for the measure sets under the Global Initial Patient Population (ED, IMM, SUB, TOB)
Add abstracted data to identified cases
Add abstracted data to identified cases
Is the hospital only submitting measure sets under the Global Initial Patient Population?
No
Stop. Process is Yes complete.
Specifications Manual for National Hospital Inpatient Quality Measures
2. Hospitals Not Submitting the Measure Sets Under the Global Initial Patient Population to The Joint Commission Only For hospitals not submitting the measure sets under the Global Initial Patient Population to The Joint Commission only, an independent sample pull should be used to pull the sample for the applicable measure sets (i.e., SEP, STK and VTE).
Each measure set, stratum, or sub-population has a unique definition of Initial Patient Population and sample size requirement. However, the same data flow or process steps can be used to identify the data that is transmitted to the Joint Commission’s Data Warehouse. These process steps are:
All ICD-10 diagnosis and procedure codes included in the appropriate Initial Patient Population definition must be applied. This identification process must be completed prior to the application of data integrity filter, measure exclusions, and the application of sampling methodology.
For specific measure set, strata, and sub-population definitions, refer to the appropriate Initial Patient Population discussion in the Measure Information section of this manual.
Specifications Manual for National Hospital Inpatient Quality Measures
Regardless of the option used, hospital samples must be monitored to ensure that sampling procedures consistently produce statistically valid and useful data. Due to exclusions, hospitals selecting sample cases MUST submit AT LEAST the minimum required sample size. The sample size tables for each option automatically build the number of cases needed to obtain the required sample sizes.
Hospitals that sample, should sample by their CMS Certification Number (CCN). For most organizations, there is a one to one correspondence between their CCN and the Joint Commission’s Health Care Organization Identifier. Sampling by CCN may cause those organizations that have chosen to be accredited such that they have multiple CCN combined under one Health Care Organization Identifier to over sample from the Joint Commission’s perspective. Organizations reporting data to CMS must sample at the level of the individual CCN. All data that are sampled (by CMS Certification Number ) must be transmitted to both CMS and The Joint Commission.
A hospital may choose to use a larger sample size than is required. Hospitals whose Initial Patient Population size is less than the minimum number of cases per quarter/month for the measure set, stratum, or sub-population, cannot sample. Hospitals that have five or fewer GLB (ED, IMM, SUB, TOB), STK and/or VTE discharges (both Medicare and non-Medicare combined) are not required to submit patient level data to the CMS Clinical Warehouse and Joint Commission’s Data Warehouse. Hospitals that have five or fewer SEP discharges (both Medicare and non- Medicare combined) are not required to submit patient level data to the CMS Clinical Warehouse. Refer to the Sample Size Requirement tables provided in each measure set’s Measure Information section to determine the minimum number of cases that need to be sampled for each population.
Specifications Manual for National Hospital Inpatient Quality Measures
Quarterly Example 1: Measure set is Not Stratified
Hospitals selecting sample cases for measure set ABC, which is not stratified, must ensure that its Initial Patient Population and quarterly sample size meet the following conditions:
Quarterly Sample Size Based on Hospital’s Initial Patient Population for the ABC Measure Set
Average Quarterly Initial Patient Population “N”
Minimum Required Sample Size “n” ≥ 1551 311 391 - 1550 20% of the Initial Patient Population 78 - 390 78 6 - 77 No sampling; 100% of the Initial Patient Population is required 0 - 5 Submission of patient level data is encouraged but not required:
Examples
Specifications Manual for National Hospital Inpatient Quality Measures
Quarterly Example 3: Measure set has sub-populations
For hospitals selecting sample cases for measure set DEF which contains 3 independent sub-populations a modified sampling procedure is required. The three sub- populations must be sampled independently from each other.
1 - Hospitals selecting sample cases for sub-population 1 must ensure that the Initial Patient Population and sample size for the sub-population 1 meet the following conditions:
Quarterly Sample Size Based on Hospital’s Initial Patient Population Size for the Patient Sub-Population 1
Average Quarterly Initial Patient Sub-Population Size “N”
Minimum Required Sub-Population Sample Size “n” ≥ 896 180 226 - 895 20% of Initial Patient Population size 45 - 225 45 < 45 No sampling; 100% Initial Patient Population required
2 - Hospitals selecting sample cases for sub-population 2 must ensure that the Initial Patient Population and sample size for sub-population 2 meet the following conditions:
Quarterly Sample Size Based on Hospital’s Initial Patient Population Size for the Patient Sub-Population 2
Average Quarterly Initial Patient Sub-Population Size “N”
Minimum Required Sub-Population Sample Size “n” ≥ 1796 360 451 - 1795 20% of Initial Patient Population size 90 - 450 90 < 90 No sampling; 100% Initial Patient Population required
3 – Sub-population 3 is not eligible for sampling and will use the entire Initial Patient Population for reporting.
Examples
Specifications Manual for National Hospital Inpatient Quality Measures
the minimum required quarterly sample size, so 100 percent (%) of this sub-population is sampled.
Monthly Example 1: Measure set is Not Stratified
Hospitals selecting sample cases for ABC measure set must ensure that its Initial Patient Population and monthly sample size meet the following conditions:
Monthly Sample Size Based on Hospital’s Initial Patient Population for the ABC Measure Set
Average Monthly Initial Patient Population “N”
Minimum Required Sample Size “n” ≥ 516 104 131 - 515 20% of the Initial Patient Population 26 - 130 26 < 26 No sampling; 100% of the Initial Patient Population is required
Examples
Specifications Manual for National Hospital Inpatient Quality Measures
1 - Hospitals selecting sample cases for sub-population 1 must ensure that the Initial Patient Population and sample size for sub-population 1 meet the following conditions:
Monthly Sample Size Based on Hospital’s Initial Patient Population Size for the Patient Sub-Population 1
Average Monthly Initial Patient Sub-Population Size “N”
Minimum Required Sub-Population Sample Size “n” ≥ 296 60 76 - 295 20% of Initial Patient Population size 15 - 75 15 < 15 No sampling; 100% Initial Patient Population required
2 - Hospitals selecting sample cases for sub-population 2 must ensure that the Initial Patient Population and sample size for sub-population 2 meet the following conditions:
Monthly Sample Size Based on Hospital’s Initial Patient Population Size for the Patient Sub-Population 2
Average Monthly Initial Patient Sub-Population Size “N”
Minimum Required Sub-Population Sample Size “n” ≥ 596 120 151 - 595 20% of Initial Patient Population size 30 - 150 30 < 30 No sampling; 100% Initial Patient Population required
3 – Sub-population 3 is not eligible for sampling and will use the entire Initial Patient Sub-Population for reporting.
Example
Specifications Manual for National Hospital Inpatient Quality Measures
percent of 387 equals 77.4 rounded up to the next whole number equals 78).
Sampling Approaches As previously stated in this section, hospitals have the option to sample from their population, or submit their entire population. Hospitals that choose to sample must ensure that the sampled data represent their Initial Patient Population by using either the simple random sampling or systematic random sampling methods and that the sampling techniques are applied consistently within a quarter. For example, monthly samples for a measure set, stratum, or sub-population must use consistent sampling techniques across the quarterly submission period.
Each hospital is ultimately responsible that sampling techniques applied for their hospital adhere to the sampling requirements outlined in this manual. ORYX Vendors are responsible for ensuring that the sampling techniques are applied consistently across their client hospitals.
Sampling Approach Examples For a hospital with an Initial Patient Population size of 350 ABC measure set discharges per quarter, the sample size would be 78. To select a random sample of 78 ABC patients:
Specifications Manual for National Hospital Inpatient Quality Measures
Sample indicates whether or not the hospital has sampled data for the specified time period. Sampling Frequency indicates if the hospital has sampled using the monthly or quarterly methodology, whether the entire population was used for the specified time period or the hospital had five or fewer discharges for the discharge quarter and did not submit patient level data.
Initial Patient Population Size – Medicare Only includes all patients that are billed under Medicare or Title 18. Medicare can be listed as a primary, secondary, tertiary or lower on the list of payment sources for the patient. In addition, patients who are participating as a member of a Medicare HMO/Medicare Advantage are included in the Medicare counts, e.g., Medicare Blue, Humana Gold, Secure Horizons, AARP, Coventry Advantra, etc.
Initial Patient Population and Sample Size Examples
Example 1 – Hospital does not sample A hospital uses the Initial Patient Population(s) for the ABC measure set to identify 120 cases in the ABC Initial Patient Population during the second quarter. The hospital does not sample the ABC measure set, so data for all 120 cases are collected and used to calculate the hospital’s rate for each ABC measure. 40 of the 120 cases in the ABC Initial Patient Population are Medicare patients.
The breakdown of data by month and Medicare/Non-Medicare is: Initial Patient Population and Sample Size April May June Total Initial Patient Population – Medicare patients 10 15 15 40 Initial Patient Population – Non-Medicare patients 20 30 30 80 Total Initial Patient Population Size 30 45 45 120 Sample Size – Medicare patients 10 15 15 40 Sample Size – Non-Medicare patients 20 30 30 80 Total Sample Size 30 45 45 120
The following is transmitted for each month in the quarter: Initial Patient Population and Sample Size April May June ICD Population Size (Initial Patient Population Size – Medicare Only + Initial Patient Population Size – Non-Medicare Only)
Initial Patient Population Size – Medicare Only (^) 10 15 15 Initial Patient Population Size – Non-Medicare Only 20 30 30 Sample (^) N N N Sampling Frequency (3 = not sampling) 3 3 3 Sample Size – Medicare Only 10 15 15 Sample Size – Non-Medicare Only 20 30 30
Specifications Manual for National Hospital Inpatient Quality Measures
Example 2 – Hospital samples monthly A hospital uses the Initial Patient Population(s) for the ABC measure set to identify 120 cases in the ABC Initial Patient Population during the second quarter. From these 120 cases, the hospital uses the monthly sample size requirements and randomly selects a sample of 26 cases for each month. Data for these 26 cases are collected and used to calculate the hospital’s rate for each ABC measure. 40 of the 120 cases in the ABC Initial Patient Population are Medicare patients and 24 of these cases were included in the sample.
The breakdown of data by month and Medicare/Non-Medicare is: Initial Patient Population and Sample Size April May June Total Initial Patient Population – Medicare patients 10 15 15 40 Initial Patient Population – Non-Medicare patients 20 30 30 80 Total Initial Patient Population Size 30 45 45 120 Sample Size – Medicare patients 8 9 7 24 Sample Size – Non-Medicare patients 18 17 19 54 Total Sample Size 26 26 26 78
The following is transmitted for each month in the quarter: Initial Patient Population and Sample Size April May June ICD Population Size ( Initial Patient Population Size – Medicare Only + Initial Patient Population Size – Non-Medicare Only )
Initial Patient Population Size – Medicare Only 10 15 15 Initial Patient Population Size – Non-Medicare Only 20 30 30 Sample Y Y Y Sampling Frequency (1 = sampling data monthly) (^1 1 ) Sample Size – Medicare Only 8 9 7 Sample Size – Non-Medicare Only (^) 18 17 19
Example 3 – Hospital samples quarterly A hospital uses the Initial Patient Population(s) for the ABC measure set to identify 120 cases in the ABC Initial Patient Population during the second quarter. From these 120 cases, the hospital uses the quarterly sample size requirements and randomly selects a sample of 78 cases. Data for these 78 cases are collected and are then used to calculate the hospital’s rate for each ABC measure. 40 of the 120 cases in the ABC Initial Patient Population are Medicare patients and 20 of these cases were included in the sample.
The breakdown of data by month and Medicare/Non-Medicare are: Initial Patient Population and Sample Size April May June Total Initial Patient Population – Medicare patients 10 15 15 40 Initial Patient Population – Non-Medicare patients (^20 30 30) 80 Total Initial Patient Population Size 30 45 45 120 Sample Size – Medicare patients 5 10 5 20 Sample Size – Non-Medicare patients 10 20 28 58 Total Sample Size 15 30 33 78
Specifications Manual for National Hospital Inpatient Quality Measures