Data streams
What is a data stream?
Data streams standardize data from all the different shapes and formats your tools use into a straightforward tabular format.
While creating a tile you can tweak data streams by grouping or aggregating specific columns.
Depending on the kind of data, SquaredUp will automatically suggest how to visualize the result, for example as a table or line graph.
Data streams can be either global or scoped:
- Global data streams are unscoped and return information of a general nature (e.g. "Get the current number of unused hosts").
- A scoped data stream gets information relevant to the specific set objects supplied in the tile scope (e.g. "Get the current session count for these hosts").
How do I get Data Streams?
- Pre-configured data streams - some data sources come with pre-configured data streams that are indexed when you add the data source.
- Configurable data streams - some data sources allow you to create new data streams using a form.
A configurable data stream allows you to easily create new data streams specific to your needs, by entering information into the Parameters section, such as metric names or queries.
- Advanced users can also write their own custom data streams (or edit a data stream created from a configurable data stream) see Custom Data Streams.
Using data streams
When adding or editing a tile on a dashboard you need to select a data stream, objects and visualization. See Dashboards
Help with configuring data streams specific to your data source can be found in each specific data source article:
List of documentation for data source plugins available
See also Scripts
Data stream shaping
Data can be filtered according to whether data in a column meets or does not meet specified text or numerical value conditions. Depending on the data you are filtering, available options include: Equals, Not equals, Contains, Doesn't contain, Less than, Greater than, Before now, After now, Is empty, Is not empty.
Dates can be filtered by Before now or After now (e.g. to show overdue orders). Text matching is case sensitive.
You are able to add multiple filter conditions. Available options are:
- AND: All conditions must be satisfied (e.g.
Status-Equals-ClosedANDType-Equals-Question). - OR: Any condition can be satisfied (e.g.
Status-Equals-PendingORStatus-Equals-Closed).
You can group and aggregate data by column.
For example, for AWS cost data you might configure the following settings to display a table or bar chart of cost per label:
- Group by:
label - Aggregation type:
Total - Aggregation column:
Amount
Which columns are available depends on the data stream you chose.
Configuring grouping enables different visualizations to be displayed, such as bar chart and donut. For example, grouping tickets by channel allows you to show a donut of how many tickets were logged by email vs web form.
Bucket by
If you group by a time column, and further grouping is possible, the Bucket by dropdown appears. Use this field to control how the time data is grouped, for example by hour, day, month etc.
Aggregation type and column
Use this dropdown to choose how to summarize your data, for example as a count, average or total.
For example, you could do the following:
- When creating a Bar Chart of ticket data you might configure the following settings to show a graph of tickets per day:
- Group by:
Date created - Bucketby:
Day - Aggregation type:
Count
- Group by:
- When creating Bar Chart of Azure Resource Group cost you could configure the following settings:
- Group by:Timestamp
- Bucketby:
Day - Aggregation type:
Total - Aggregate column:
Cost
The Sort section allows you to select a column to be displayed in Ascending or Descending order. While this sets the default sort order, but you can always click on a column heading to sort data in a table on the fly.
Enabling the Top toggle allows you to additionally specify the top n rows of data to display.