[MADIE-2127] Test cases not meeting 100% Coverage Created: 02/04/25  Updated: 05/27/25  Resolved: 02/20/25

Status: Closed
Project: MADiE Issue Tracker
Component/s: Test Case List
Affects Version/s: None
Fix Version/s: None

Type: Bug/Issue Priority: Blocker
Reporter: Nayaab Baig Assignee: Heather Frideres
Resolution: Deferred for Future Release Votes: 0
Labels: Measure, TestCase
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Zip Archive CMS153-v13.0.000-QDM (2).zip     Microsoft Word CMS153-v13.0.000-QDM-TestCases.xlsx     PNG File Screenshot 2025-02-28 at 12.47.07 PM-1.png     PNG File Screenshot 2025-02-28 at 12.47.07 PM.png     PNG File image-2025-02-04-09-56-44-881.png     PNG File image-2025-02-04-09-56-50-574.png     PNG File image-2025-02-04-09-56-56-465.png     PNG File image-2025-02-04-09-57-01-563.png     PNG File image-2025-02-04-09-57-06-419.png     PNG File image-2025-02-04-09-57-11-723.png     PNG File image-2025-02-04-09-57-17-798.png    
Issue Links:
Duplicate
is duplicated by MADIE-2198 CMS1061 Test Case Coverage 99% Closed
Tool: MADiE
Tool Version: QDM
Measure/Library Title: Chlamydia Screening in Women
Measure/Library URL: https://madie.cms.gov/measures/662010050f0a9077c1d5b240/edit/details/
CBE Number: CMS153
Measure Model: QDM 5.6
Test Case URL(s): https://madie.cms.gov/measures/662010050f0a9077c1d5b240/edit/test-cases/list-page/662010050f0a9077c1d5b239?filter=&search=&page=0&limit=All
Help Desk Use Only Labels: DEV
MADiE Release Version: MADiE 2.2.3
Submitter Resolution Confirmed: Yes

 Description   

Hello MADiE team,

I am encountering an issue for the QDM measure, Chlamydia Screening in Women (CMS153v13). I noticed that the test cases are at 99% coverage despite all the coverage being highlighted and met in the coverage tab. I would appreciate your guidance on this issue. Please see screenshots below.

Thank you,
Nayaab









 Comments   
Comment by Nayaab Baig [ 05/27/25 ]

Hello cbiggs, I verified that this issue is resolved. I have set the SRC to yes. Thanks!

Comment by Christina Biggs [ 05/27/25 ]

nbaig2 good morning, if you could please check to see if the 2.2.3 release resolved your issue and set SRC = Yes if so.  Thank you!

Comment by Christina Biggs [ 05/13/25 ]

With the MADiE 2.2.3 release today this issue should be resolved.  Please try again and if so, set Submitter Resolution Confirmed to Yes.  Thank you!

Comment by Chandra Bartleman (Inactive) [ 03/06/25 ]

The MADiE team has reviewed all measures added to this ticket requesting confirmation if the issue identified for CMS153 (Chlamydia Screening in Women) impacting coverage is the same reason the measures have less than 100% coverage. Please review the team’s findings for each measure below.  

If, after reading the feedback, you have ongoing questions about your CQL or test cases for the measures below, please open a new ticket with the appropriate JIRA Issue Tracker for your specific questions. To help you identify where your questions should be directed, review the ticket submission guidance located in the MADiE Ticket Submission Guidance document here: ** https://www.emeasuretool.cms.gov/sites/default/files/2024-10/MADiE_TicketSubmissionGuidance_v4.pdf 

In addition, the MADiE team encourages you to consult your measure development lead and/or COR or federal sponsor to determine if the workaround(s) suggested should be implemented for your measure. 

CMS153 - Chlamydia Screening in Women – Yes, this measure is impacted by the coverage issue identified in this ticket and is targeted to be resolved following the AU release freeze.  

CMS129 - Prostate Cancer Avoidance of Overuse of Bone Scan for Staging Low Risk Prostate Cancer Patients – 98% coverage – Issue differs from ticket. First the SDE Sex is not cover due to the wrong value set – using 2.16.840.1.113762.1.4.1021.12 instead of the correct value set 2.16.840.1.113762.1.4.1021.121. The team also identified missing coverage within "Most Recent PSA Test Result is Low".  The Null check on the result of Global."NormalizeInterval"(PSATest.relevantDatetime, PSATest.relevantPeriod) is missing null scenario. You could consider modifying CQL to starts before start.  

CMS69 - Preventive Care and Screening Body Mass Index (BMI) Screening and Follow Up Plan – 98% coverage - Issue differs from ticket. The team identified missing coverage within "High BMI Interventions Performed". Null checks on both instances of OverweightObese.prevalencePeriod missing null scenarios. "Low BMI Interventions Performed". You could consider modifying CQL to starts before or on day of start of

CMS1157 - HIV Annual Retention in Care - 98% coverage - Issue differs from ticket. The team identified missing coverage within "Encounter During Measurement Period With HIV". Null check on HIVDiagnosis.prevalencePeriod missing null scenario. 

CMS2 - Preventive Care and Screening: Screening for Depression and Follow-Up Plan – 99% - Issue differs from ticket.  The team identified missing coverage within "History of Bipolar Diagnosis Before Qualifying Encounter" Null check on BipolarDiagnosis.prevalencePeriod missing null scenario. 

CMS832 - Hospital Harm - Acute Kidney Injury – 100% coverage - Not impacted by the issue in this ticket. 

CMS877 - Hospital Harm - Anticoagulant-Related Major Bleeding – 99% coverage - Issue differs from ticket. The team identified missing coverage within "Encounter with Decrease of 2 g dL Between Hemoglobin Lab Tests Done within 48 Hour Period with Confirmatory Decrease and within 5 Days of Anticoagulation Medication". Null check on Lab3Time in Lab3Time starts after Lab2Time missing null scenario. 

CMS1218 - Hospital Harm - Postoperative Respiratory Failure – 99% coverage - Issue differs from ticket. The team identified missing coverage within "Encounter with Tracheostomy Before Day of First OR Procedure". Null check on starts before day of missing null scenario. The team also identified missing coverage within "Extubation with Preceding Noninvasive Oxygen". 
Null check on ExtubationTime missing null scenario.  

Finally, there is a common thread identified to these issues. The common thread is comparing intervals to point-in-time values. A workaround to consider would be to modify the comparisons to only use point-in-time values.

Comment by Abdullah Rafiqi [ 02/28/25 ]

For CMS1218, It seems like i am not seeing the gaps in coverage because MADiE does indicate that the "noninvasive" conditions are being met while highlighted. I’ve confirmed this in both the latest expansion and the manifest (ecqm-update-2025-05-08).

I’ve attached the screenshots to confirm what I’m seeing in MADiE.

https://madie.cms.gov/measures/67b793b5abaa807a0818d1c3/edit/details)

Comment by Shardae Sims [ 02/28/25 ]

Good morning,

I wanted to confirm if CMS877 is impacted by this issue. In MADiE, the test case coverage is 99% with no apparent gaps in coverage highlighting.

Measure url: https://madie.cms.gov/measures/67b7800eabaa807a0818ce3b/edit/test-cases/list-page/67b7800eabaa807a0818cdd7?filter=&search=&page=0&limit=10

Thanks!

Comment by Shardae Sims [ 02/26/25 ]

Thanks p9g and Heather.Frideres, I will share this information with the measure team.

Comment by Paul Denning [ 02/26/25 ]

define "Serum Creatinine Normal":
if exists ( ["Patient Characteristic Sex": "Female"] ) then 1.02
else if exists ( ["Patient Characteristic Sex": "Male"] ) then 1.18
else null as Decimal

The red bold "null as Decimal" is not highlighted in MADiE.

Comment by Heather Frideres [ 02/26/25 ]

kimberlys shardaesims Please review Paul's comment, and check if there are any definitions not covered for the measures you are asking about, and verify the expansion is set as expected. If you confirm you do not have either of those impacting coverage and would like the team to look at your measures, please add a new comment and we will do so at that time.

Thank you

Comment by Paul Denning [ 02/26/25 ]

There are gaps in coverage apparent:
// this definition is not highlighted
define "Noninvasive Oxygen Therapy Procedure":
["Procedure, Performed": "Non Invasive Oxygen Therapy by Nasal Cannula or Mask"]

define "Noninvasive Oxygen Therapy":
"Noninvasive Oxygen Therapy Procedure" // this line not highlighted
union "Noninvasive Oxygen Therapy Assessment"

Note that Expansion is Latest, not Manifest with the 2025 expansion profile selected, which may change the coverage.

Comment by Shardae Sims [ 02/26/25 ]

Hello,

Now that the CQL error is resolved for CMS1218 and the test case coverage is 99% with no gap in coverage highlighting, we are suspecting that this measure may be impacted by this issue.

Measure URL: https://madie.cms.gov/measures/67b793b5abaa807a0818d1c3/edit/details/

cbartleman@telligen.com or Heather.Frideres, can you confirm if CMS1218 is impacted by this issue.

cc: kimberlys, moriahbauman, sgearhart12, abdullah.rafiqi@esacinc.com 

Thanks!

Comment by Kimberly Smuk [ 02/26/25 ]

Heather.Frideres  CMS832: https://madie.cms.gov/measures/67b78aeda8c16e2e237a045f/edit/details/

Comment by Heather Frideres [ 02/26/25 ]

HI kimberlys,

The team can look at CMS832, but please provide the measure URL to ensure we are looking at the correct version of the measure.

Thank you

Comment by Kimberly Smuk [ 02/26/25 ]

cbartleman@telligen.com Heather.Frideres  Can the helpdesk confirm if CMS832 is impacted or not? 

Comment by Kimberly Smuk [ 02/21/25 ]

Adding that we have identified 2 measures where this might apply - CMS832 and CMS877

 

cc: moriahbauman sgearhart12 

Comment by Chandra Bartleman (Inactive) [ 02/20/25 ]

AIR EC eCQM Team and nbaig2 

Thank you for providing the other measures impacted where coverage was impacted by this issue. As discussed in the cross contractor call on February 13th, the solution to this reported issue will be implemented after AU. Following implementation this ticket will be updated and you will have an opportunity to confirm resolution. Additionally, release notes that accompany future MADiE releases will communicate when this issue has been resolved. 

Sincerely, 

Comment by AIR EC eCQM Team [ 02/18/25 ]

Adding that this issue impacts four additional EC eCQMs 

  • CMS129 - 99% coverage
  • CMS69 - 99% coverage
  • CMS 1157 - 98% coverage
  • CMS2 - 99% coverage
Comment by Heather Frideres [ 02/17/25 ]

Hello Nyaab,

This ticket was discussed during the cross-contractor call last week, and a decision was made to hold off on a release with a fix until after the AU are complete. The team will continue to research the root cause, and if a Github ticket is needed for the translator that will be created. We will update this ticket as more information is available.

Thank you

Comment by Peter Muir [ 02/14/25 ]

M: Recommend checking Expected values for Stratification 1 and 2 since not set in test cases that I looked into. This may resolve pass/fail issue since the only 2 cases that pass are IPPFail (ages 15, 25).

Comment by Heather Frideres [ 02/14/25 ]

Hello,

The Measure Authoring and Development Integrated Environment (MADiE) version 2.1.3 Maintenance Release has been successfully released. QDM measures and test cases may be edited again. We will be updating this ticket regarding the issue you reported as more information is available.

Thank you

Comment by Heather Frideres [ 02/13/25 ]

Hello-

The MADiE team has identified the cause of QDM measures having test case expected values removed when any edit is made to the measure or test cases. The team is working on the solution which will be released as a hotfix, as well as a communication to send out to all MADiE users. We are asking that all MADiE users please STOP making any edits to QDM measures effective immediately to avoid additional measures being impacted by this issue. We will update this ticket as more information is available. 

Thank you

Comment by Paul Denning [ 02/13/25 ]

I don't know if what I'm seeing is related to MADIE-2132.

Comment by Kimberly Smuk [ 02/13/25 ]

p9g  so might be related to [MADiE-2132]?

Comment by Paul Denning [ 02/13/25 ]

When I run the tests, I'm getting only 2 of 94 tests passing, and it appears that the expected results are cleared out. The two tests that pass match because they are IPPFail and were designed to not be in any of the populations. Some of the IPPFail test cases fail because the actual Stratification is checked for some reason. I don't know if that is related to the 99% coverage when the highlighting shows everything apparently covered (no visible gaps in coverage, suggesting 100%)

Comment by Heather Frideres [ 02/11/25 ]

Thank you for that confirmation. The team continues to review this issue, and we will provide an update as more information is available. 

Comment by Nayaab Baig [ 02/11/25 ]

Hello Heather,

I am confirming that this issue is blocking our team's work for the current AU.

Thanks.
Nayaab

Comment by Heather Frideres [ 02/11/25 ]

Hello Nayaab,

Please confirm if this is blocking your work on this measure for AU. 

Thank you

Comment by Heather Frideres [ 02/04/25 ]

Thank you for submitting your bug/issue to the MADiE team. This ticket has been assigned to a team member. Please review the MADiE Ticket Submission Guidance on the Training & Resources tab under the MADiE Helpful Links heading on the public website (https://www.emeasuretool.cms.gov/training-resources) and attach supporting documentation as directed in the guide. Populating all applicable fields while creating the ticket will assist the MADiE team when processing this ticket.  

Generated at Sun Aug 31 08:15:39 UTC 2025 using Jira 10.3.8#10030008-sha1:cdaed80cecc964184c5b19b002388d56f96e274e.