Job Validation Panel

Use Job A job is a user-configured program in Spreadsheet consisting of functions and designed for specific applications. You can create and edit jobs using the Spreadsheet interface, and load them on a vision system for deployment in a live environment. Validation to confirm that a job is operating within expected parameters. Job Validation performs tests on the job and compares the results of those tests against expected values.

To access the Job Validation panel, select the View tab of the Menu Barand choose Job Validation.

Prerequisites

Before you start, you must meet the following prerequisites:

Configure Job Validation

To configure the Job Validation:

  1. Add Images

  2. Define Variants

  3. Optional: Set Cleanup Actions

After configuration, Run Job Validation to evaluate the results.

Add Images

To add images to the Job Validation:

  1. Open the Job Validation configuration dialog by clicking the Settings icon.

  2. Click Browse to open the image location.

  3. Click Select Folder to load images from the device location or PC.

Define Variants

A job can contain one or more inspections. For example, you can create jobs to handle multiple products. Each of those separate inspections is considered a variant.

Note: Most simple jobs require only a single Job Validation variant, and do not require Setup Actions, Setting Tests, or Cleanup Actions.

To define a variant: 

  1. Click Add and then click Rename.

  2. Provide a name for the variant.

  3. Click Next.

  4. Select the images. You can click on the image name to view it.

  5. Select the named Results cells from the spreadsheet.

  6. Click Next.

    Validation runs the images through the settings.

  7. Review the Expected Test Results and verify that the Actual (A) values are correct.

    In the example, "bad" equals zero, which is correct.

  8. Click Accept All or individually set results to Accepted by clicking on the values.

    Accepting the Actual value (A) updates the test with a new Expected value (E). Run a Job Validation Result Test to determine whether the Actual value from running the Job on the supplied image matches the Expected value saved in the test.

Optional: Set Cleanup Actions

The Cleanup Actions restore the job to a constant state. For example, when processing a large number of images, counters in a job can increment, which should not be included in production results. Cleanup Actions can reset the counters.

  1. Set the Cleanup Actions.

  2. Click OK.

Run Job Validation

After configuration, run Job Validation and examine the results.

  1. Click the Run ▶ button. The job runs through the Job Validation.

  2. Click on an item to expand the results.

  3. Select a test to see the confusion matrix. Depending on the test, the confusion matrix changes.

    JobPass Confusion Matrix ClassLabel Confusion Matrix
  4. An icon appears next to each result, showing the state.

    Icon State Description
    Valid All actual cell values match the configured expected cell values and no errors were encountered during the execution of Job Validation.
    Invalid Some actual cell values do not match the configured expected cell values and no errors were encountered during the execution of Job Validation.
    Error

    An error occurred while running Job Validation. This can be caused by several factors, including:

    • A named cell was not found.

    • The image was not found in the configured location.

    There is an error message that provides more details about the error.

    Note: Job Validation errors are separate from #ERR error cell results in the spreadsheet. Job Validation errors indicate that something unusual prevents Job Validation from running.
    NotRun Job Validation has not been executed since the last time it was configured.

    To fix a fail result:

    1. Go to the Expected Test Results under Settings.

    2. Accept results individually rather than selecting Accept All.