Visualise is the area of the platform where you can visualise, analyse and share all the data streamed into your workspace, both historic and live.
What the Visualisation is for
We are building the visualise pages as an internal tool to make it really simple and fast to manage and extract value from your data. The core areas of focus include:
Visual data discovery
Features that enable you to quickly locate regions of interest in your data and compare them to other relevant datasets. These should be accessible to all users in your team regardless of their data expertise.
Data preparation for machine learning
Features that let you prepare and segment datasets for training and back testing.
Analysing the results of data processing models
Features that let you compare results from multiple experiments of models and data. Quickly switching between model versions and datasets to optimise the performance of your models.
Building data-driven features into your products
Features that let you build simple data queries such as aggregates, groups, splits and filters, then export the query via our API to be called by your frontend.
Collaborating with colleagues across your product development team
Features that allow you to work with software engineers, data scientists, product owners and designers to build data-driven features.
What the Visualisation is not for
We are not intending the Visualise pages to be externally facing dashboards or data presentation, or robust tools for data analysis.
There are plenty of good tools that are freely available on the open market to do these tasks so we are not trying to duplicate features or functionality from those products. But we have made it very easy to connect to them with our API:
We have built some sample code to get you started with Microsoft PowerBI
We use our API to build our own monitoring on Grafana; the Swagger link will help you get started quickly.
We’ll continue to add integrations to third party products - drop us an email if you have a specific requirement.
Our default data view, the waveform allows you to quickly explore historic and live streams, parameters and events in a single view. The waveform view consists of the following features: - Quick select of multiple streams, parameters and events with colour coded overlay - Timestamp on the X axis and auto-fit of the parameter values on the Y axis - Dynamic tooltip values in the context pane - Vertical cursor navigation line on the view - Dynamic pan, zoom and fit of stream - Live data view - Colour coded data grouping and splitting
Use the waveform view to navigate through a stream; find your significant data; and extract that specific data segment for further processing.
The aggregate view provides a quick way to summarise data from several measurements; it consists of the following features: - Select any number of parameters (columns) in a stream - Aggregate by min, max, mean, first and last - Further aggregate by tags such as lap number, day, location, or any other predefined tag setup using our SDK
Use the aggregate view quickly summarise your data and extract that summary for sharing, presentation or further processing.
The event view provides a tabulated list of all events in the streams selected.
Use the event view to quickly find significant moments in your data.
Data in the catalogue can be grouped by tag. Tags can be anything, and are defined by users with our SDK.
You can download data as CSV or JSON. Downloading data from the Visualise pages will give you a file containing the exact data that you had in the visualise view.
This is great for sharing datasets with colleagues or third parties.
Connect to Historic Data
You can connect to any data using our query API. Connecting to data from the Visualise pages will give you pre-configured sample code for the exact data that you had in the visualise view.
For machine learning: This is very powerful for segmenting data for training and back testing on your client.
For app development: It provides pre-configured examples of how to call data from your external apps.
For reporting: Use our PowerBI integration to ingest data for visual presentation.
We have implemented a live view so that you can see data from open streams (whether that be raw data from sources or processed data from models) as it’s flowing through the topic.
You can perform the same data navigation, filtering and grouping on live data as historic data.
Working with Visualise
As previously mentioned the visualise page is designed to help you quickly locate regions of interest in your data and use those region for further processing and visualisation. Our goal is to make this code free so that your data becomes more accessible to more people across your teams.
We highly recommend that you use the tools available in Visualise to narrow down regions of interest, then use the connect and download buttons to get that specific data for sharing, processing, consumption in apps or visualisation in a BI or washboarding tool.
Use the streams, parameters and events buttons to add data from the catalogue. Use the data tree to find and select the data you are looking for; click close to visualise the data.
Click waveform, aggregates or events in the visualise sub-menu at the top of the page.
On the aggregate view; use the dropdown boxes to select any combination of our standard aggregates and the grouping tags defined by you
On the waveform view; click the four squares in the top right hand side of the screen to open the grouping menu; select any combination of the grouping and splitting tags.
Navigate data in the waveform view:
Use the buttons at the bottom of the view, or to pan and Zoom: