Collecting and Storing Data from Internet-based Sources

The Urban Big Data Centre (UBDC) is a research centre and national data service based at the University of Glasgow. We promote the use of big data and innovative research methods to improve social, economic and environmental well-being in cities.UBDC has been jointly funded by the Economic and Social Research Council (ESRC), which is part of UK Research and Innovation (UKRI), and the University of Glasgow since 2014.

Urban Big Data Centre

The <A HREF="http://ubdc.ac.uk/" TARGET="_blank" DATA-MSYS-CLICKTRACK="0" REL="nofollow noopener noreferrer">Urban Big Data Centre</A> at the University of Glasgow's next data skills training course will be held on Monday 11th June 2018.
Collecting and Storing Data from Internet-based Sources will be an afternoon session providing researchers with the essential skills required to effectively use Application Programming Interfaces (APIs) for downloading data from a variety of online data sources. It will then cover the use of databases for storing and retrieving data and demonstrate how to automate the collection processes. Full course details below.
Please contact <A HREF="mailto:keith.maynard@glasgow.ac.uk" TARGET="_blank" REL="nofollow noopener noreferrer">keith.maynard@glasgow.ac.uk</A> with any related queries.
 
<HR>
<H2 CLASS="MsoNormal">Collecting and Storing Data from Internet-based Sources</H2>
Course instructor: Peter Smyth, Reasearch Associate, University of Manchester
Course duration: half day (Monday 11th June, 2018, 1:15pm – 4:45pm)
Course location: Jura teaching lab, Level 4 Annexe, Glasgow University Library
Audience: Researchers who need to collect Internet based data, e.g. social media and store it over a period of time
Fees:  
£25 - For UK registered students      £35 - For staff at UK academic institutions, Research Council UK funded researchers, UK public sector             staff and staff at UK registered charity organisations £50 - For all other participants
Pre-requisite knowledge: Some knowledge of Python would be useful but not essential as all code used will be provided.
Course summary:
Many websites allow researchers and developers to download data using their Application Programming Interface (API). This data is often in formats that social scientists are unfamiliar with (e.g. JSON). Downloaded data can be processed immediately or stored in a database for later processing in a package like R or Stata. Data can be collected at regular intervals over a period of time, using the built-in functionality of the Windows or Linux operating systems.
Course content:
Course participants will be introduced to the following:
<UL>
<LI CLASS="MsoNormal">Understand the JSON data format</LI>
<LI CLASS="MsoNormal">Understand how to use APIs to collect data</LI>
<LI CLASS="MsoNormal">Data storage and retrieval using a database (SQLite)</LI>
<LI CLASS="MsoNormal">Ability to set up automated procedures to collect data</LI>
</UL>
Short Presenter Bio:
Peter Smyth is a Research Associate at the University of Manchester, based in the Cathie Marsh Institute. He has spent 35 years working in IT at various large and small commercial organisations before taking an MSc in Big Data Analytics at Sheffield Hallam University and moving into academia. In his previous roles he used any convenient programming environment to hand to solve problems. Now he teaches a variety of programming languages to help others to do the same.
He is a qualified Data and Software Carpentry instructor.
Payment and registration:
Payment by card preferred. 
If you are unable to pay by debit or credit card we are able to accept payment by invoice. Please supply the following information by e-mail to <A HREF="mailto:keith.maynard@glasgow.ac.uk" TARGET="_blank" REL="nofollow noopener noreferrer">keith.maynard@glasgow.ac.uk</A> within 14 days of registering on Eventbrite in order to confirm your place on the course:
<UL>
<LI>Contact name for invoice</LI>
<LI>Purchase Order number (note that the supplier is University of Glasgow)</LI>
<LI>Contact e-mail address for payment correspondence</LI>
<LI>Full name of organisation/department</LI>
<LI>VAT registration (if applicable)</LI>
<LI>Currency</LI>
<LI>Address for Invoice to be sent and telephone number</LI>
</UL>
To cancel your place and request a refund, please email <A HREF="mailto:keith.maynard@glasgow.ac.uk" TARGET="_blank" REL="nofollow noopener noreferrer">keith.maynard@glasgow.ac.uk</A>. Please note that a refund of course fees less 10% administrative charge can only be issued if you cancel your place in writing at least 7 days prior to the course after which time fees will be non-refundable. Substitutes can be made at no extra charge up until 5pm on the last working day before the course. 
 
<A HREF="https://www.eventbrite.co.uk/e/ubdc-summer-training-2017-introduction-to-areal-data-modelling-using-r-tickets-35177730539" TARGET="_blank" REL="noopener noreferrer"> </A>

Jura Teaching Lab, Level 4 Annexe

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Collecting and Storing Data from Internet-based Sources

More events from Urban Big Data Centre

Discover more events from Urban Big Data Centre, from Science & Tech to other experiences you might love.

Still looking for the right event?

Explore all events in Glasgow and filter by date, category, and more to find the perfect fit.

Collecting and Storing Data from Internet-based Sources

More events from Urban Big Data Centre

Discover more events from Urban Big Data Centre, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.

Still looking for the right event?

Explore all events in Glasgow and filter by date, category, and more to find the perfect fit.