Storing & Visualizing Time Series Data

What you will learn in the course

• How to process time series data from CSV files (e.g., air quality data)
• How to connect external APIs to obtain real-time weather data
• How to write data to InfluxDB 2.0 and query it using Python and the Flux language
• How to create and configure dashboards in Grafana: server installation, panel configuration, and access management

Course structure

Introduction

You will get an overview of the project, familiarize yourself with the data set being used and the InfluxDB interface: graphs, queries, and data structure. We will also discuss the platform architecture to understand how all components interact.

Data Schema Design

You will become acquainted with the features of relational and time series databases and understand when to use each. You will learn to design a storage schema based on the characteristics of the data and their usage methods.

Environment Setup

You will install and launch InfluxDB and Grafana using Docker. You will configure the Python library for working with InfluxDB, create an access token, and set up the development environment in VS Code.

Working with Test Data

You will learn how to load test CSV files and weather data into InfluxDB using Python. You will explore potential issues during data loading and how to solve them.

Working with Air Quality Data

You will load air quality data into InfluxDB, write queries in Python, and connect Grafana to InfluxDB to create visualizations. You will set up a data source and create a dashboard for air quality analysis.

Working with External Weather API

You will get acquainted with the weather API, obtain an access key, and learn to manage time zones. You will connect an external API, load data into InfluxDB, and visualize it on a Grafana dashboard.

Working with Grafana Dashboards

You will explore the capabilities of Grafana: multi-user mode, access rights management, user and organization settings. In the final part of the project, you will create two organizations in Grafana, connect weather data and air quality data to them, applying the skills you have acquired in practice.

This course will provide you with practical skills in working with modern tools for storing and visualizing time series data, which are in demand in real-world analytics and monitoring projects.