Web data in official statistics: process, challenges, solutions

Welcome to the European Statistical System Collaborative Network (ESSnet) Web Intelligence Network project, which began in April 2020 and will run until March 2025. This is a continuation of the previous ESSnet Big Data and ESSnet on Big Data II projects, which commenced in 2016. The aim of the network is to contribute to National Statistical Institutes (NSI) understanding the need to change and advance the production of national statistics. New technologies and data sources have tremendous potential to improve statistical production. They offer a way to generate statistics in an effective, accurate, and cost-effective manner.

ESSnet Web Intelligence Network Project

The webinar will cover the main steps of web (internet) data acquisition and processing illustrated with the use-case of online real estate.

Trusted Smart Statistics – Web Intelligence NetworkBackgroundThe <a href="https://ec.europa.eu/eurostat/cros/WIN" target="_blank" data-msys-clicktrack="0" rel="nofollow noopener noreferrer">Web Intelligence Network</a> (WIN) project is creating an environment where an array of non-traditional data sources can be accessed by members of the European Statistical System (ESS) and beyond.This project works hand in hand with the Web Intelligence Hub (WIH), an analytical environment to produce statistics with web data. The WIH is designed to provide National Statistical Institutes (NSIs) exposure to new data sets, enabling data sharing within a trusted, secure environment. New data sets collated from modern technologies can help produce statistics more cost-effectively by harnessing the power of the digital era. The WIH will harness technology and, in turn, allows collaboration to benefit the modernisation of official statistics. The WIH will create a community of collaboration to: <ul><li>Learn together</li><li> Share knowledge, data, and methods </li><li>Build a partnership between NSIs </li><li>Enable cooperation and sharing of statistical solutions for NSIs</li></ul>Webinar ContentThe webinar will address the main steps of web data acquisition and processing illustrated with the use-case of online real estate sales/rental offers. It will be based on the experiences from the experimental research conducted by six European countries within the ESSnet Web Intelligence Network. The webinar will cover: <ul><li>Overview of the experimental research on web data from online real estate offers and steps already completed</li><li>Presentation of the approach to assessing a web data source</li><li> Guide on building a scraper• Discussion on methodological challenges of using web data in real estate statistics</li></ul>Learning ObjectivesThe webinar will lead participants step by step from assessing the content of the webpage, through creating data acquisition tool and presenting possible use of the collected data. The webinar will also present challenges with the acquisition and processing web data in official statistics. The webinar will cover:<ul><li>Practical aspects of web scraping</li><li>Methodological challenges</li><li>Limitations of the use of real estate web data in official statistics</li></ul>Learning OutcomesAfter completing the webinar, participants are expected to have basic knowledge of how to assess the website in order to retrieve necessary information, how to build a tool for web scraping the data and what methodological and quality-related challenges could be encountered.Target AudienceDomain experts, official statisticians considering the use of new data sources in statistical production, methodologists, data analysts and anyone interested in new data sources and intrigued by the challenges they entail in the realm of official statistics.Pre-requisites<ul><li>General knowledge of data acquisition, processing and analysis</li><li>Knowledge of new data sources, in particular web data, in statistical production would be helpful, but is not obligatory. </li></ul>Duration: Two hours Presenters:Dominik Dabrowski Klaudia Peszat

Presenters Biographies:Dominik Dabrowski joined Statistics Poland in 2009. His experience involves development and implementation of research in the domains of enterprise and social statistics, as well as data integration and exploration of new data sources. Klaudia Peszat joined Statistics Poland in 2017 and has worked on multi-domain regional studies, as well as the use of new data sources in official statistics and data integration. Klaudia holds a Ph.D. in Earth Sciences, specialised in socio-economic geography. Privacy noticeThe data you provide will be used by the Office for National Statistics to contact you in connection with the above event and to understand the attendance level and interest in the event. ONS will store your data securely on our IT infrastructure and your data will not be shared with other organisations. Personal data will be kept until the end of the project (March 2025) and then deleted. From time to time, we will contact you to keep you up to date with new events we have planned.If you have a question about how we process your personal data and you can’t find the answer on our website, you can contact our Data Protection Officer at DPO@statistics.gov.uk or 0845 6013034. To find out more about your rights under data protection legislation, or how to raise a concern with the Information Commissioner, see our website www.ons.gov.uk/dataprotection or the Information Commissioners Office at https://ico.org.uk.Your data will be processed by Eventbrite – please read their privacy policy.

Our {communityGuidelinesLink} describe the sort of content we prohibit on Eventbrite. If you suspect an event may be in violation, you can report it to us so we can investigate.

To report other categories of prohibited or illegal content, submit {link}

Web data in official statistics: process, challenges, solutions

More events from ESSnet Web Intelligence Network Project

Discover more events from ESSnet Web Intelligence Network Project, from Science & Tech to other experiences you might love.

Still looking for the right event?

Explore all online events to browse and filter by date, category, and more.

Web data in official statistics: process, challenges, solutions

More events from ESSnet Web Intelligence Network Project

Discover more events from ESSnet Web Intelligence Network Project, from Science & Tech to other experiences you might love.

You might also like...

Browse more events with different dates, prices, and formats to find your next great experience.

Still looking for the right event?

Explore all online events to browse and filter by date, category, and more.