£32.45

Azure Data Factory & Creating Custom Activities Workshop by Paul Andrew

Event Information

Share this event

Date and Time

Location

Location

The Møller Centre

Churchill College

Storey's Way

Cambridge

CB3 0DE

United Kingdom

View Map

Refund Policy

Refund Policy

No Refunds

Friends Who Are Going
Event description

Description

All proceeds will go to charity from this two-hour, hands-on interactive lab which is designed to prepare you for using Azure Data Factory.

PART I

This is not SSIS in Azure, it’s a start for our control flows. Let’s update our terminology and understand how to invoke our Azure data services with this new controller/conductor who wants to understand our structured datasets. Learn to create the perfect dependency driven pipeline with Azure Data Factory and allow your data to flow. What’s an activity and how do we work with time slices? Is a pipeline a pipeline? Who is this JSon person? All the answers to these questions and more in this introduction to working with Azure Data Factory. Plus, insights from a real-world case study where ADF has been used in production for a big data business intelligence solution handling log files for 1.5 billion users.

Attendees will need to register for this session, as numbers are limited. You must have a laptop with internet access and administrative rights, and have installed the prerequisites which will be shared prior to the session - this ensures we can get right to the fun stuff!

PART II

Having covered the basics in part 1 we’ll now go beyond the Azure Data Factory basic activity types and Azure Portal wizard. Extract and load are never the hard parts of the pipeline. It is the ability to transform, manipulate and clean our data that normally requires more effort. Sadly, this task doesn’t come so naturally to Azure Data Factory, as an orchestration tool so we need to rely on its custom activities to break out the C# to perform such tasks. Using Visual Studio, we’ll look at how to do exactly that and see what’s involved in Azure to utilise this pipeline extensibility feature. What handles the compute for the compiled .Net code and how can does this get deployed by ADF? Let’s learn how to fight back against those poorly formed CSV files and what we can do if Excel files are our only data source.

This year, all receipts (minus Eventbrite booking fee) goes directly and immediately to local Cambridgeshire School Little Thetford CE Primary School who are attempting to raise a £10,000 shortfall in funding! Help them get there.

About the Speaker

Paul is a Microsoft Data Platform MVP with 10+ years’ experience working with the complete on-premises SQL Server stack in a variety of roles and industries. Now as the Business Intelligence Consultant at Purple Frog Systems, he has turned his keyboard towards big data solutions in the Microsoft Cloud. Specialising in Azure Data Lake Analytics, Azure Data Factory, Azure Stream Analytics, Event Hubs and IoT, Paul is also a STEM Ambassador for the networking education in schools’ program, PASS chapter leader for the Microsoft Data Platform Group – Birmingham, SQLBits, SQL Relay, SQL Saturday speaker and helper. Currently, the Stack Overflow top user for Azure Data Factory. As well as a very active member of the technical community.

Share with friends

Date and Time

Location

The Møller Centre

Churchill College

Storey's Way

Cambridge

CB3 0DE

United Kingdom

View Map

Refund Policy

No Refunds

Save This Event

Event Saved