Home > Cloud Cruiser 4 > Administering > Jobs > Testing collection and deleting data loads

Testing collection and deleting data loads

Table of contents

This article is part of To collect, transform, and publish data:

5. Test, delete
bad loads

 

 

After configuring the collection, transformation, and publishing aspects of your workbook, test whether your workbook is delivering the usage information you need. 

If you want to run a schedule for the same day it completed successfully without errors or warnings, you must delete its previous data load prior to running it again, otherwise the schedule will fail with a Duplicate load detected error. You can also delete detail and summary data from older loads to recover database storage space.

To test a workbook

  1. Navigate to Data > Workbooks.
  2. Select the workbook you want to test.
  3. In the Workbook section of the Workbook tab click Run.
    The Run Workbook dialog box appears, enabling you run all or part of your workbook on demand. Specify run parameters and select which collections and flows to execute.
    RunWorkbook.png
     
    Parameter Description
    Select Date

    The date for which this run collects and processes data. This date is used to request data from data sources, but because data sources behave differently, the rows retrieved can have usage start and end times that fall outside of this date.

    The select date is used as the accounting date for these rows as they are processed by the workbook and published to a schema in the Cloud Cruiser database. When you run reports, this accounting date is what you specify in the report parameters and what appears in the report.

    Log Level The amount of data to write to the log for this run. INFO logs the least data, DEBUG more, and TRACE the most. Selecting (Default) gives you INFO logging.
    Publish Config Whether to execute steps that publish as system configuration (such as customers) as part of the run. When Yes, these steps are included and when No, they are skipped. The default is No.
    Publish Data Whether to execute steps that publish usage data to a schema as part of the run. The default is Yes. When developing or debugging data transformation steps, consider setting this option to No to avoid having to repeatedly delete data loads.
  4. Click Run.

    You cannot run a job from a workbook if one is already in progress for that workbook. If you attempt to do so, Cloud Cruiser will skip the job and provide a message in the Monitoring area.

  5. After the run finishes, click View Log at the bottom left of the dialog box to open the Monitoring window, where you can view the log for any specific collection or flow.
    DataLog.png
    For more infomation see Monitoring job results.
  6. If your workbook test run did not complete successfully, or if it did not provide the data you need, edit the workbook and then run another test.
  7. When you are done editing your workbook delete any test data loads.

To delete a data load

  1. Navigate to Data > Processing > Published Loads.
  2. Select one or more entry rows and click Delete Load(s) at the top of the page.
  3. Click Yes to confirm the deletion.

What to do next

To collect, transform, and publish data:

Last modified

Tags

This page has no custom tags.

Classifications

This page has no classifications.
© Copyright 2018 Hewlett Packard Enterprise Development LP