Arthur Turrell, Bradley Speigner, James Thurgood, Jyldyz Djumalieva, and David Copple
‘Big Data’ present big opportunities for understanding the economy. They can be cheaper and more detailed than traditional data sources, and on scales undreamt of by survey designers. But they can be challenging to use because they rarely adhere to the nice neat classifications used in surveys. We faced just this challenge when trying to understand the relationship between the efficiency with which job vacancies are filled and output and productivity growth in the UK. In this post, we describe how we analysed text from 15 million job adverts to glean insights into the UK labour market.