Building a Python Data Pipeline for Pricing Data

A webinar from the Data Analytics Team at Leeds Institute for Data Analytics.

This webinar offers an exposure to a complete Python‑based data pipeline, highlighting key stages such as data cleaning, transformation, filtering, aggregation, and visualisation. The workflow uses pricing data retrieved directly from the Azure API and illustrates how this information can be prepared for a tool that calculates Azure service costs.

Fojan Ilderem is a Research Software Engineer in the Data Analytics Team at LIDA, with experience in Azure services and data pipeline development. Work includes building a tool that estimates the cost of using LASER, an Azure-based Trusted Research Environment. Skilled in Python, cloud technologies, and workflow optimisation, with a keen interest in automation tools and emerging technologies. Continuously exploring new areas such as Retrieval Augmented Generation (RAG) to enhance data driven capabilities within the team.