Dataflow Automation Common Questions
Table of Contents
Also, check out:
What is Dataflow Automation?
Dataflow Automation provides organizations Big Data capabilities including long term storage, data management, processing and integration without having to invest millions of dollars and a dedicated team.
What is a RecordSet?
RecordSets are storage locations for data saved within a Zerion Dataflow. These RecordSets and the actions associated with them are the foundations of Dataflow Automation.
How do I create a Dataflow?
Many different types of Dataflows can be created such as aggregating, filtering and transforming the data you collect which allow your data to work harder and more efficiently for your team.
To create a new Dataflow, please follow the instructions below. In this example, we'll be pushing data we collect in iForm to our Dataflow.
STEP 1. From inside the Zerion Console, select Dataflow Automation.
STEP 2. From the left-hand menu, click Dataflow Builder.
STEP 3. Click the +Create button on the right-hand side of the screen.
STEP 4. Give your Dataflow a name and description.
STEP 5. Click the checkbox to Create RecordSet. Remember the RecordSets are where you store the data that you'll be transforming through Dataflow Actions.
STEP 6. Once you've clicked the checkbox for Create RecordSet, the RecordSet fields will appear. Give the RecordSet a name and description.
STEP 7. Click the checkbox for Create Webhook for this RecordSet.
The webhook serves the role of allowing a web service to automatically send information to your Dataflow. Every DFA webhook has a unique identifier called a Webhook URL.
If you'd like to make the Webhook more secure, click the Secured Webhook checkbox.
The Secure Webhook option is for those who require additional security. Only data coming in from the verified source would get processed by the Dataflow, therefore, protecting unwanted data from entering the system.
STEP 8. Click Save.
STEP 9. With your Dataflow now created, click the Webhook you created within the Dataflow.
STEP 10. Copy the Webhook URL provided in the upper right-hand corner.
STEP 11. Remember that in this example we're using data we collected in iForm, which means we need to navigate over to the iFormBuilder Admin Console to create our Post Data Endpoint.
From the Admin Console, hover over the Forms tab and select Form Assignment.
Highlight the form that contains the data you'll be pushing to your Dataflow and click Assign.
Under the Post Data section, click + New Endpoint.
In the Endpoint URL field, paste the Webhook URL we copied from the Dataflow.
Click Create Endpoint.
STEP 12. Test your Dataflow by submitting some records through iForm.
Once you've submitted records to the form, you'll see that the RecordSet now has data in it.