Download COG280-04 Feb2025 Cogito Systems Administration I - Caboodle and SlicerDicer ETL latest and more Exams Biology in PDF only on Docsity!
COG280-04 Feb2025 Cogito
Systems Administration I -
Caboodle and SlicerDicer ETL
latest update with 100%
correct answers(graded A+)
CHAPTER 8 - Caboodle Record Matching What do you need to do to match non-Epic and Epic Records in Caboodle? HINT: answers to 2 Questions - answer CHAPTER 8 - Caboodle Record Matching To match records, Caboodle needs to know the answers to :
- What records are being matched (patients, providers, etc.) and what is the corresponding DMC?
- What specific business keys should be matched together? What is the best place in Chronicles to match records in Caboodle? (NOTE Chronicles as a place to match) - answer - Patient Load Utility owned by the Identity team
- Roster Management Engine owned by the Healthy Planet team What is the format for matching Chronicles IIT .1 and Caboodle IdType? HINT: EpicIdentityINI### - answer EpicIdentityINI### Example: SER records were matched with IT ID 885. The corresponding IdType in Caboodle would be EpicIdentitySer885. In Caboodle, how do you view the lineage of IdentityInfo Package that uses EpicIdentity IdType for matching records? - answer 1. In
the Dictionary Editor, open the IdentityInfo package Provider Identity Mapping Load
- On the Data Lineage form, note the expressions for the MapFromIdType and MapToIdType columns Which is the Main Patient Table in Caboodle DM? - answer - PatientDim is the Main Patient Table in Caboodle DM Name the two SlicerDicer dBs - answer - SlicerDicer DATA dB
- SlicerDicer STATS dB TRUE or FALSE It's possible that in our org SlicerDicer DATA dB and STATS dB could be the same dB, "The SlicerDicer dB", two-in-one - answer TRUE It's possible that in our org SlicerDicer DATA dB and STATS dB could be the same dB, "The SlicerDicer dB", two-in-one How do you query SlicerDicer for ResultCache? - answer use SlicerDicer Select * from ResultCache There is new SlicerDicer App called SD JumpStart. What is it for? - answer To monitor and pre-calcucalte a lot of various current and cached activities on Caboodle, SlicerDicer and elsewhere. What does JumpStart pre-calculate? Hint: 3 things - answer JumpStart pre-calculates THREE things:
- The count of records in each DM (i.e. FDM record)
- The results of all SlicerDicer components on Radar dashboards
- "When to Include" is unusual: DAILY regardless of Table Frequency (INCREMENTAL, WEEKLY etc)
- It exits GRACEFULLY In Caboodle, why do you need Match Rules? - answer Match rules can be created for many dimension DMCs in Caboodle. These rules are used by Caboodle to determine when NEW records match EXISTING records Where do you find Match Rules for PatientDim? - answer The match rules for a DMC can be found: Caboodle Console>Dictionary Editor>DMCs>Select a DMC on Left>Record Matching Hyperlink Example: match rule for PatientDim is - BirthdDate_FirstName_IsValid_LastName_Ssn In Caboodle ETL, when is DMC's Matching Procedure executed? - answer The DMC's matching procedure is executed as the last step of the ETL for the DMC TRUE or FALSE Data about ALL matched Business Keys is permanently stored in the IdentityInfoImport table - answer FALSE IdentityInfoImport, like all other general import tables, does NOT permanently store data TRUE or FALSE You can create custom match rules for Epic‐released DMCs. - answer TRUE You can create custom match rules for Epic‐released DMCs. TRUE or FALSE
Immediately after a record merge is completed, its entry is removed from the Epic.MergeQueue table - answer FALSE Completed merges remain in the Epic.MergeQueue table In Caboodle, what is Record Matching used for? - answer You need to decide on a strategy for matching the records in the NON‐Epic data source to its EPIC equivalent TRUE or FALSE Your Identity/Healthy Planet teams have to determine and approve your Patient Matching strategy - answer TRUE Your Identity/Healthy Planet teams have to determine and approve your Patient Matching strategy TRUE or FALSE To match records, Caboodle needs to know the answers to the following two questions:
- What records are being matched (patients, providers, etc.)?
- What specific business keys should be matched together? - answer TRUE To match records, Caboodle needs to know the answers to the following two questions:
- What records are being matched (patients, providers, etc.)?
- What specific business keys should be matched together? TRUE or FALSE You should never manually execute Epic.MergeAllRecords since this can cause the merge process to fail. Instead, use the API dbo.AlterMergeSchedule to change the schedule of the merge job (including to have it run immediately) - answer TRUE You should never manually execute Epic.MergeAllRecords since this can cause the merge process to fail. Instead, use the API
What dB does Caboodle require to store pre‐calculated results and usage data? - answer Tables in the SlicerDicer and SlicerDicer Statistics databases What are most common 3 tables in SlicerDices Statistics dB? - answer - Stats_Sessions (a new session every time User opens SD)
- Stats_Query (a new row every time SlicerDicer calculates or shows results by running a SQL query or loads them from Cache)
- Stats_SQL (SQL queries run by SlicerDicer directly against Caboodle) What 4 things does SlicerDicer Web Server run? - answer SlicerDicer Web Server runs:
- SlicerDicer JumpStart application
- SlicerDicer monitor service
- Two SlicerDicer application pools CHAPTER 10 - Monitoring Pre-emptive Builds What Galaxy Document details Clarity administration tasks? - answer CHAPTER 10 - Monitoring Pre-emptive Builds "Clarity Maintenance and Monitoring Guide" details Clarity administration tasks that should be completed on a regular basis, grouped by frequency https://galaxy.epic.com/Redirect.aspx?DocumentID= TRUE or FALSE Pre‐emptive Monitor activity in Hyperspace is a Reporting Workbench report that allows you to monitor your pre‐emptive builds and extracts - answer TRUE
"Pre‐emptive Monitor" activity in Hyperspace is a Reporting Workbench report that allows you to monitor your pre‐emptive builds and extracts CHAPTER 11 - Monitoring Delay Tracks and Backfills Which Caboodle document details Caboodle administration tasks that should be completed on a regular basis - answer CHAPTER 11 - Monitoring Delay Tracks and Backfills The "Caboodle Maintenance and Monitoring Guide" details Caboodle administration tasks that should be completed on a regular basis https://galaxy.epic.com/Redirect.aspx?DocumentID= Which Hyperspace Activity triggers Backfills? - answer "Trigger Backfill On Tables" activity Hyperspace-based Executions of type "ETL" can have TWO EXTRACT TYPEs. What are they? - answer - Normal ETL
- Continuous Backfill and Delay Depletion What type of tables should be included in both types of ETL Executions (Normal ETL, Backfill and Delay) -? - answer EACH TABLE on your Clarity database should be included in both types of executions How can you create a Backfill and Delay Execution as a copy of the ETL execution? - answer - Execution Management>ETL>Copy Execution
- Name it "Continuous Backfill and Delay Depletion"
- Configure it by going to ETL > Type>Extract type> Continuous Backfill and Delay Depletion
- Set the End time buffer (minutes) to "1"
- Tables> When to include>Every Time
In Caboodle, how the number of rows included in each backfill is set at the PACKAGE LEVEL? - answer This value can also be set at the package level. To do so, open a package in the Dictionary Editor>Edit button>Override>Enter values In Caboodle, what is an example of a LARGE TABLE? - answer FlowsheetValueFact might have hundreds of millions to billions of rows In Caboodle, what is best practice to keep the Backfill and Delay Track THRESHOLD? - answer The backfill threshold should be AS HIGH AS POSSIBLE without affecting ETL performance Define Deferred Records. How are they notified about? - answer After the threshold is reached, additional records are placed in Caboodle's delay track and are deferred to later executions. You'll see the Warning Message displayed in the Execution Manager How do you check on the number of Deferred Records? How do you deal with too frequent messages about deferred records? - answer - To check on the number of deferred records, open Executions > Status Report
- Epic recommends INCREASING the Delay Track row THREHOLD for the corresponding packages TRUE or FALSE Caboodle always loads data related to changes that were made in Chronicles the previous day, deferring only lower‐priority changes - answer TRUE Caboodle always loads data related to changes that were made in Chronicles the previous day, deferring only lower‐priority changes
Where do you manually trigger Clarity backfills? - answer Hyperspace > Trigger Backfill On Tables Where can you see the details of Clarity backfill execution runs? - answer Clarity Console Status board Where can you see the backfill progress for all outstanding Clarity backfills? - answer The Backfill Monitor activity in Hyperspace CHAPTER 12 - Reviewing ETL Executions In Caboodle Console, what are TWO places to monitor and prevent Errors? - answer CHAPTER 12 - Reviewing ETL Executions
- Executions>Manager (top menu)
- Executions>Error Log (top menu) In Caboodle Console, where is Health Check and how often should it run? - answer - Executions>Manager>Health Check (a simple ETL Execution in the "Scheduled" section)
- By default, every hour in Caboodle Console, how do you Suppress Health Check if it won't complete successfully, or for maintenance? - answer 1. Navigate to Executions > Manager.
- In the Scheduled Executions section, select Health Check.
- Click Edit.
- In the Suppress health check field, select Yes.
- In the Start [suppress] date and Start [suppress] time fields, enter the date and time you want the health check to stop running.
- In the End [suppress] date and End [suppress] time fields, enter the date and time you want the health check to resume running.
Hint: query a view - answer To see information about tasks that already completed, query the Service.GenericTaskProcessing_TaskAttemptsForCompletedGroups view. Filter on TaskAttempt_IsInteresting = 1 to exclude standard system tasks How do you resolve Caboodle ETL Issues? Hint: FIX - answer Run a FIX execution by:
- Caboodle Console>Executions
- Select the Execution that failed>Create Fix How do you investigate SlicerDicer ETL Issues? - answer - Use the daily JumpStart Health Report email to identify what JumpStart tasks need attention
- Log in to JumpStart
- Check the progress of Caboodle ETLs, HasEver builds, and Radar components
- If tables aren't completely processed, go to the Caboodle Console to determine why any ETLs for DMCs that SlicerDicer depends on aren't yet complete
- If HasEver builds haven't completed, or if users are unable to search for an option in SlicerDicer that should be available, open the HasEver Progress report, check Caboodle dependencies
- If Radar components aren't completely processed, it's likely they're waiting for Caboodle ETL dependencies to finish.
- If no tables have run and JumpStart is idle, it's likely that the SlicerDicer monitor service isn't running What SlicerDicer Metadata tables do you query to troubleshoot various ETL issues? - answer - SlicerDicer.ResultCache: Stores JumpStart results for Radar components.
- SlicerDicer.HasEver: Stores filter options for HasEver indexes. If a user can't find a filter option, such as a specific procedure, you can check if it's stored in this table. If not, check whether a HasEver task has completed for the filter.
- SlicerDicer.Timestamp: Logs the last time JumpStart completed building a HasEver index for a filter and the last time ETL completed for a dependent DMC. HasEver indexes are identified by a two‐ part identifier, where the first part is the data model ﴾ FDM ﴿ record ID and the second part is the filter ﴾ FDS ﴿ record ID. For example, identifier 1‐10 corresponds to the index for the Immunizations filter in the Patients data model How do you query Metadata tables in SlicerDicer Statistics db? - answer - SlicerDicer.Stats_JumpStartTasks: Tracks how long it takes for JumpStart tasks to complete. Each row represents one task.
- SlicerDicer.Errors: Contains information about errors related to JumpStart tasks, the SlicerDicer monitor service, and queries generated by users. Each row represents one time an error was encountered How does the Clarity Console service resolve duplicate primary key errors? - answer All but one of the rows with the same primary key values is discarded. A warning or error message is returned as configured .How does the Clarity Console attempt to fix an error on a non‐ primary key field? - answer Strings that are too long are truncated and numeric or date fields are nulled out if the field allows null value Up to how many load attempts does the Clarity Console service make for a given extract? - answer Up to 3 attempts When the cause of an error was bad data in Chronicles, what is the process to correct the data in Clarity AFTER the data has been
and more How do you deal with Caboodle Workqueue Items? - answer - Epic recommends reviewing the Work Queue each day at the same time you review your execution
- If you can't resolve the issue immediately, select DEFER In Caboodle Console Workqueue, how do you view deferred entries?
- answer Selecting the SHOW DEFERRED checkbox will display all deferred entries in the Work Queue TRUE or FALSE Caboodle Workqueue is PHI-secure because PHI will never show up there - answer FALSE Caboodle Workqueue MAY CONTAIN protected health information (PHI) In Caboodle, if a Category Value in the source changes, how is it moved to the Caboodle dB? - answer When a category value in a source system changes, Caboodle updates the database ALL AT ONCE TRUE or FALSE Duplicate Keys ONLY Apply to DMCs other than PatientDim and ProviderDim How do you handle Duplicate Keys? - answer TRUE Duplicate Keys ONLY Apply to DMCs other than PatientDim and ProviderDim
- DEFER them to deal with later
- If you see a few Dups, most likely, you'll need to merge them
- If you see HUNDREDS of Dups, resolve an issue with identity mappings (i.e. packages associated with IdentityInfo)
What is the SQL to find all Business Keys incorrectly mapped? - answer SELECT AllData.IdType, AllData.Id, AllData.DepartmentKey FROM Epic.DepartmentDim_IdLookup AllData INNER JOIN ( SELECT DepartmentKey FROM Epic.DepartmentDim_IdLookup WHERE IdType = N'<>' AND Id = N'<>' ) AffectedKey ON AllData.DurableKey = AffectedKey.DurableKey How do you access Record Matching? use PatientDim as an example
- answer Dictionary Editor > DMCs > PatientDim > Record Matching (Hyperlink on top) In Caboodle Workqueue, RECORD MATCH, how do you deal with records that match and that don't? HINT: you'll see Record Match heading the WORK QUEUE - answer - If the records are the same, select Merge to combine them.
- If the records are different, select Keep Separate In Caboodle, when will Record Match Errors occur? In Caboodle, what is the Maximum matches after which the Record Match Error occurs? - answer - Record match errors occur when the record match engine detects an incoming record matching an excessive number of existing records
- It should be > In Caboodle, How do you Resolve Pending ID Mappings? - answer - Run the API dbo.FindPendingIdMappings as described in the Work Queue message. It's safe to run, nothing changes in the dB.
- Review the IssueDescription and IssueFollowUpAction columns for details
In Caboodle SSIS Package, how do you resolve Data Model Changes Errors? - answer Update your custom package accordingly TRUE or FALSE A "Duplicate Key" entry appears in the Work Queue. After reviewing the entry, you choose to click the "Resolve" button. This will fix the issue that created the entry and prevent it from appearing again - answer FALSE. This will mark the issue as resolved in the Work Queue, but it is still your responsibility to investigate the data and correct the issue You select "Merge" on a "Record Match" entry in the Work Queue. You query the reporting database to check your work and notice that the relevant records have not been merged. What is the most likely explanation for this? - answer Record merges are performed on an hourly basis, not immediately What is the difference between Clarity Validations and Caboodle Validations? - answer - Validations in Clarity MARK discrepancies by adding records to the delay track
- Caboodle validation packages automatically FIX any identified discrepancies during the validation ETL, like: column differences rows missing from Caboodle additional Caboodle rows vs. Clarity rows incorrectly marked deleted in Caboodle In Caboodle, when should Validation and Datalink executions be run in relation to Clarity ETL execution? - answer After the main Clarity ETL execution
What is the difference between a Clarity Validation and a Clarity Metadata Validation? - answer - A Clarity Validation compares data VALUES
- A Clarity Metadata Validation compares database object STRUCTURES What type of Clarity validation is designed to run daily on most of your REQ‐loaded tables? - answer RANDOM SAMPLE validations To which section of a Console‐based Clarity execution do you add a Clarity Metadata Validation? - answer DATALINK Setup To which section of a Console‐based Clarity execution do you add a Validation? - answer VALIDATION setup A Clarity table that is typically extracted incrementally needs to be populated with data that has been in Chronicles for several months. What options do you have for populating the table? - answer - BACKFILL
- FULL EXTRACT What is CSF Master File? - answer Cogito Summarized Facts What is EHI Master File? - answer Electronic Health Information What is CRX master file? - answer Execution Runs ﴾ CRX ﴿ master file What is E0D master file? - answer Datalink actions (E0D) master file What is E0P master file? - answer Datalink action criteria (E0P) master file
