Dataflow Automation RecordSets

Table of Contents

• What is Dataflow Automation?
• What is a RecordSet?
• How do I transform my data?

What is Dataflow Automation?

Dataflow Automation provides organizations Big Data capabilities including long term storage, data management, processing and integration without having to invest millions of dollars and a dedicated team.

Click here for more information.

What is a RecordSet?

RecordSets are storage locations for data saved within a Dataflow. These RecordSets and the actions associated with them are the foundations for Dataflow Automation.

Click here for more information.

How do I transform my data?

Using Dataflow Automation, you can transform and manipulate data into an output that fits your needs. In this example, we'll be removing all the metadata included with an iFormBuilder record.

STEP 1. From inside the Zerion Console, select Dataflow Automation.

STEP 2. Dataflow Builder is the default screen, but if you're on a different page, you can click Dataflow Builder from the left-hand menu.

STEP 3. Click on the Dataflow that contains the data you'll be transforming.

STEP 4. Select the RecordSet that houses the data.

STEP 5. From the RecordSet drop-down menu, click Add RecordSet to Dataflow.

STEP 6. Name your RecordSet and provide a description. Click Save.

STEP 7. Select the original RecordSet.

STEP 8. Click the Record Data tab.

View the JSON data by click the eye icon.

Click Copy.

STEP 9. Highlight the new RecordSet (iForm_Data_Transform).

From the Data Refinery drop-down, click New Filter.

Click the Sample Data tab and paste in the JSON data copied in Step 8.

Click the Config Tab.

Under the Transformation section, click the Select All checkbox to deselect all fields.

Select the fields you want to show in the transformed RecordSet.

Click the Preview tab and Run Preview.

You'll see a preview of your transformed RecordSet. If all looks good, click Save.

STEP 10. Highlight the original RecordSet (Example_RecordSet_for_doc).

Under the RecordSet drop-down menu, select Manually Rerun Records.

From the Rerun drop-down menu, choose All.

Under the Records to Rerun drop-down menu, select All.

Click Rerun.

STEP 11. Your new RecordSet (iForm_Data_Transform) now contains the transformed records.