Stream Tables

This article describes how to work with stream tables, and includes the following: 

• Overview
• Measure Columns
  • Aggregating Functions
  • Associating Measure Units
  • Ignoring/Deleting/Including Measures in the Streaming Process
  • Adding Arithmetic Functions
  • Adding Calculated and Constant Value Measure Columns
  • Renaming Measure Columns
• Dimension Columns
  • Fine-tuning Using Transform Functions and Filters
  • Ignoring/Deleting/Including Dimensions in the Streaming Process
  • Adding User-defined Dimensions with a Constant
  • Concatenating Dimension Columns
  • Copying Dimension Columns
  • Renaming Dimension Columns
  • Changing Dimension Columns to Tags
• Streaming Your Data
  
• Creating Alerts from Data Streams

Overview

In the Stream table you can modify Data Collector measures and dimensions and create your own metrics before streaming them into Anodot.

Measure values can be:

• Aggregated according to the aggregate function
• Associated with a measuring unit
• Ignored/Included in the streaming process
• Created using arithmetic operators and constant values
• Renamed 

Dimension values can be:

• Fine-tuned using transformers and filters
• Ignored/Included in the streaming process 
• Created by adding dimension columns with a constant    
• Joined by concatenating dimension columns
• Renamed

After making all the changes and additional metrics you want to make, stream the data into Anodot. In addition, you can create alerts from your data before you stream it.

• indicates that the aggregation type  [Average/Sum] has not been set.
• Error  An error is displayed if you will breach your metrics account limit. Streaming is disabled.
• To display a truncated column heading, click the heading. 
• Grayed out column headings are ignored during the streaming process.

Measure Columns

Aggregating Functions

1. In the Stream Table window, hover over the Measure column heading you want to edit and click the small arrow icon to display the Aggregation/Modify/Units/Exclude Column menu.
   
2. Choose Aggregation to produce the Average or Sum across all instances of the selected 'measure' at a single point. 

•  Average = the default 'measure' meter setting.
•  Sum = default 'measure' counter setting.
      Note:
  - Choose Apply to all metrics. [Optional]
  - The default settings can be overridden.
  - Streaming is disabled until the aggregation type is defined for all the values.
  - For uploaded files, Average/Sum must be specified for each value.

Associating Measuring Units

1. In the Stream Table window, hover over the Measure column heading you want to edit and click the small arrow icon to display the Aggregation/Modify/Units/Exclude Column menu.
2. Choose Units to add a measuring unit. Choose a unit from the dropdown menu.

Ignoring/Deleting/Including Measure Columns in the Streaming Process

1. In the Stream Table window, hover over the Measure column heading you want to edit and click the small arrow icon to display the Aggregation/Modify/Units/Exclude Column menu.
2. Choose Exclude Column for a measure column not to be included in the streaming process.
   To reinstate a column, repeat step 1 and choose Include.
   Notes:
   - Data Collector measure columns can be ignored (not streamed) and then included again in the streaming process.
   - User-defined measure columns are deleted.

Adding Arithmetic Functions

1. In the Stream Table window, hover over the Measure column heading you want to edit and click the small arrow icon to display the Aggregation/Modify/Units/Exclude Column menu.
2. Choose Modify to add an arithmetic function over the selected measure.
3. Select one of Addition (adds a defined value to the existing value), Multiply (multiplies the existing value by x), or Power (the exponent by which the measure is raised) from the dropdown menu.
   For example, if you select Addition, an additional field is displayed in which you enter the required value. This value is added to all the rows for the selected Measure column.
   
4. Click APPLY to implement your change.

Adding Calculated and Constant Value Measure Columns 

1. In the Stream Table window, click the Measures plus icon, to display the New Column dialog box.
2. Click Choose to select an operator:
   

   Operator	Description
   Constant	String output
   Divide	Divide one measure by another
   Multiply	Multiply one measure by another
   Subtract	Subtract one measure from another
   Add	Add one measure to another
   Min	Minimum between two measures
   Max	Maximum between two measures

3. Type a New Column Name.
4. i  For arithmetic operators, choose the measures you want to calculate from the Column dropdown menus.
   ii  For constant values, enter free text in the text field.
   iii Choose an Aggregation type [Average/Sum].
   iv Click Create New Column.
5. Click the down arrow next to the new column, to open the Units & Symbols dialog box and set the Units type. [Optional]
6. To add more new columns, repeat steps 1-5. 

Renaming Measure Columns

To rename a measure column heading, hover over the heading you want to rename and type a new name; the default data collector heading is displayed under the new name.

User-defined measure column headings can be renamed but the original names are not displayed.

Dimension Columns

Fine-tuning Using Transformer Functions and Filters

1. To transform and filter dimensions in the streaming process, hover and click the arrow icon next to the Stream table dimension column you want to change.
2. Choose Modify.
3. Click in the Transforms option list and select from the following:
   

   Transform Functions	Description
   Prefix	Extract prefix of defined length
   Suffix	Extract suffix of defined length
   Replace	Finds a 'target' substring and replaces it with 'replacement'
   Replace by Lookup Table	See Lookup Tables
   Replace no match	If no match is found, replace the column value with the replacing value
   Replace by regex	If the dimension value matches the regex, replace it with the 'replacement' value
   Change case	Change case of input string to all lower-case or all upper-case
   Extract	Extract the string between the Prefix and Suffix. Prefix and Suffix are defined by regex
   Remove	Remove the string between the Prefix and Suffix. Prefix and Suffix are defined by regex
   Remove accentuation	To replace accentuated characters with their ASCII replacements
   Trim Spaces	Remove all leading and trailing white spaces from dimension values
   Filter	Include values that
   Starts with	Start with the specified prefix. Use * as wildcards.
   Does not start with	Do not start with the specified prefix. Use * as wildcards.
   Ends with	End with the specified suffix. Use * as wildcards.
   Does not end with	Do not end with the specified suffix. Use * as wildcards.
   Equals	Are equal to the specified text
   Filter by Lookup Table	See Lookup Tables
   Contains	Contain the specified text. Use * as wildcards
   Does not contain	Do not contain the specified text. Use * as wildcards.
   Matches regex	Match the specified regex
   Does not match regex	Do not match the specified regex

4. Click APPLY.
5. To add more transformers and filters, click the Dimensions plus icon and repeat step 2
   and 3.

Ignoring/Deleting/Including Dimension Columns in the Streaming Process

1. In the Stream Table window, hover over the Dimension column heading you want to edit, to display the Modify/Exclude Column menu.
2. Choose Exclude Column for a dimension column not to be included in the streaming process.
   To reinstate a column, repeat step 1 and choose Include.
   Notes:
   - Data Collector measure columns can be ignored (not streamed) and then included again in the streaming process.
   - User-defined measure columns are deleted.

Adding User-defined Dimension Columns with Constant

1. Click the dimension panel plus icon.
2. Choose Constant from the Choose dropdown menu.
3. Type a New Column Name.
4. Type an output string;  for example the Web Site View set in the Stream Query page.
5. Click Create New Column.
6. To add more new columns, repeat steps 2-5. 

Concatenating Dimension Columns  

1. Click the dimension panel plus icon.
2. Choose Concatenate from the Choose dropdown menu.
3. Type a New Column Name.
4. Add a Delimiter - any delimiter can be used. 
5. From the Column dropdown menus, choose at least 2 properties.
   Note: To add more properties, click the plus icon.
6. Click Create New Column.
7. To add more concatenated columns, repeat steps 1-6.

Copying  Dimensions Columns

1. Click the Dimension + icon.
2. Choose Copy from the Choose dropdown menu.
3. Open the Column dropdown menu.
4. Choose the column you want to copy.
5. Rename it in the New Column Name field.
6. Click Create New Column.
7. Update the column using the fine-tuning functions and filters. See Fine-tuning Using Transformer Functions and Filters.

Renaming Dimension Columns 

To rename a dimension column heading, hover over the heading you want to rename and type a new name; the default data collector heading is displayed under the new name.

User-defined and concatenated dimension column headings can be renamed but the original names are not displayed.

 

Changing Dimension Columns to Tags

To change a dimension column to a tag column, you just need to add a hash sign ('#') before the current name.

Example: If the column name is 'CSM' and you want to turn it to a tag, change the name to be '#CSM'. This can be used on both user-defined columns and columns originating from the data source.

Streaming Your Data

1. Review the additions and changes you made to the Measures and Dimensions in the Stream table.
2. Click Stream. Streaming will take a few minutes - how long depends on your system and the amount of data to be processed.
   
   Note: To view the metrics created in the Stream table, navigate to the Anodot Metrics window.

Creating Alerts from Data Streams [Optional]

Note: Alerts can be created now or at a later stage.

1. Check that the Stream Table includes the measures and dimensions you want to include. Update it, if necessary, before you stream the data.
2. Click Stream. The Create Alerts from this Stream dialog box is displayed.
3. Click Create Alerts. The dialog box expands to display the measures in the stream.
4. Select the measures you want to be alerted on.
5. Select up to 3 dimensions per measure from the dropdown menu displayed.
   
6. Click Create.

See Also:
Guidelines by Data Source Type