Visualise

Introduction

Visualise is the area of the platform where you can visualise, analyse and share all the data streamed into your workspace, both historic and live.

What the Visualisation is for

We are building the visualise pages as an internal tool to make it really simple and fast to manage and extract value from your data. The core areas of focus include:

Visual data discovery

Features that enable you to quickly locate regions of interest in your data and compare them to other relevant datasets. These should be accessible to all users in your team regardless of their data expertise.

Data preparation for machine learning

Features that let you prepare and segment datasets for training and back testing.

Analysing the results of data processing models

Features that let you compare results from multiple experiments of models and data. Quickly switching between model versions and datasets to optimise the performance of your models.

Building data-driven features into your products

Features that let you build simple data queries such as aggregates, groups, splits and filters, then export the query via our API to be called by your frontend.

Collaborating with colleagues across your product development team

Features that allow you to work with software engineers, data scientists, product owners and designers to build data-driven features.

What the Visualisation is not for

We are not intending the Visualise pages to be externally facing dashboards or data presentation, or robust tools for data analysis.

There are plenty of good tools that are freely available on the open market to do these tasks so we are not trying to duplicate features or functionality from those products. But we have made it very easy to connect to them with our API:

We have built some sample code to get you started with Microsoft PowerBI

We use our API to build our own monitoring on Grafana; the Swagger link will help you get started quickly.

We’ll continue to add integrations to third party products - drop us an email if you have a specific requirement.

Features

Waveform View

Our default data view, the waveform allows you to quickly explore historic and live streams, parameters and events in a single view. The waveform view consists of the following features: - Quick select of multiple streams, parameters and events with colour coded overlay - Timestamp on the X axis and auto-fit of the parameter values on the Y axis - Dynamic tooltip values in the context pane - Vertical cursor navigation line on the view - Dynamic pan, zoom and fit of stream - Live data view - Colour coded data grouping and splitting

Use the waveform view to navigate through a stream; find your significant data; and extract that specific data segment for further processing.

Aggregate View

The aggregate view provides a quick way to summarise data from several measurements; it consists of the following features: - Select any number of parameters (columns) in a stream - Aggregate by min, max, mean, first and last - Further aggregate by tags such as lap number, day, location, or any other predefined tag setup using our SDK

Use the aggregate view quickly summarise your data and extract that summary for sharing, presentation or further processing.

Event View

The event view provides a tabulated list of all events in the streams selected.

Use the event view to quickly find significant moments in your data.

Grouping

Data in the catalogue can be grouped by tag. Tags can be anything, and are defined by users with our SDK.

Download Data

You can download data as CSV or JSON. Downloading data from the Visualise pages will give you a file containing the exact data that you had in the visualise view.

This is great for sharing datasets with colleagues or third parties.

Connect to Historic Data

You can connect to any data using our query API. Connecting to data from the Visualise pages will give you pre-configured sample code for the exact data that you had in the visualise view.

For machine learning: This is very powerful for segmenting data for training and back testing on your client.

For app development: It provides pre-configured examples of how to call data from your external apps.

For reporting: Use our PowerBI integration to ingest data for visual presentation.

Live View

We have implemented a live view so that you can see data from open streams (whether that be raw data from sources or processed data from models) as it’s flowing through the topic.

You can perform the same data navigation, filtering and grouping on live data as historic data.

Working with Visualise

As previously mentioned the visualise page is designed to help you quickly locate regions of interest in your data and use those region for further processing and visualisation. Our goal is to make this code free so that your data becomes more accessible to more people across your teams.

We highly recommend that you use the tools available in Visualise to narrow down regions of interest, then use the connect and download buttons to get that specific data for sharing, processing, consumption in apps or visualisation in a BI or washboarding tool.

How-to

Select data

Use the streams, parameters and events buttons to add data from the catalogue. Use the data tree to find and select the data you are looking for; click close to visualise the data.

Change view

Click waveform, aggregates or events in the visualise sub-menu at the top of the page.

Aggregate data

On the aggregate view; use the dropdown boxes to select any combination of our standard aggregates and the grouping tags defined by you

Group data

On the waveform view; click the four squares in the top right hand side of the screen to open the grouping menu; select any combination of the grouping and splitting tags.

Use the buttons at the bottom of the view, or to pan and Zoom:

Pan: Hold left click and move the cursor left/right to pan

Zoom: Hold right click, drag and release the cursor to zoom to a region