The Compare feature allows comparing a set of data objects against a base set of data objects to identify changes and data drift. As an example, you may want to compare how last week's data compares with the last three months' data and see if the data is similar or diverging. The Compare option is only available for Explore jobs and for the 'image' dataset type. All the data of old datasets are displayed with round dots, and the data of new datasets are displayed with plus dots.
.gif)
Prerequisites
- A compare job can be specified with a base job on the same dataset, and the base job must be of Explore type.
- The compare job and base job must be defined using the same catalog table.
- The base job must not use KSEGMENT as the embedder.
Job submission
The job creation flow is similar to any other job
- Navigate to the catalog, and click the 'Visualize' button.
- In the job submission screen, select 'Compare' type of job and the base job from a drop-down list of eligible base jobs
Compare job submission
- Click Submit.
- Navigate to Repo > Dataset.
- Once the job is in the 'Ready' state, click Visualize.
A sample visualization is as follows.
You can choose to view only Delta or Base points from the Point Set drop-down list.