Social media and the stock market

Is it possible to predict which way the stock markets will turn solely off internet search terms and Twitter mood states? The Bank of England thinks it might be - and has been analysing Google searches as a way of tracking the economy in real time. And one enterprising hedge fund has put its faith and money behind the idea. Simon Wilson reports.

Social media such as Twitter helped foment the Arab Spring and the London riots. But can they also help investors predict stock prices? asks Simon Wilson

When was this link first identified?

Can web-based data from search engines and social media be used to predict future behaviour? Interest in this idea took off after the publication of a paper in 2009 called Predicting the Present with Google Trends. In it, Google economist Hyunyoung Choi and her boss, the firm's chief economist Hal Varian, describe how peaks and troughs for particular products and services such as cars and holidays precede fluctuations in the sales of those products. In some sectors, the authors find an effect of only a few percentage points, but in others it's more substantial an 18% improvement in the predictions for the demand of motor vehicles and parts' and a 12% improvement for new housing starts'. Other academic researchers have found that mentions of political candidates on Twitter are good predictors of electoral outcomes. And firms such as Infegy have made social media-monitoring a buzz sector in branding and marketing.

Subscribe to MoneyWeek

Become a smarter, better informed investor with MoneyWeek.

Doesn't that sound a bit faddy?

The Bank of England doesn't think so. It revealed in June that it has been analysing data on Google searches for key economic terms as a way of tracking the economy in real time and the results are pretty extraordinary. Two bank analysts, Nick McLaren and Rachana Shanbhogue, have discovered, for example, that current searches for job seekers allowance' are closely correlated with official unemployment figures gathered by the Labour Force Survey a month later. The Bank also found that trends in searches for estate agents' may be a better guide to house-price changes than established surveys by the Royal Institute of Chartered Surveyors or the Home Builders Federation.

How is this information useful?

It gives the bank's monetary policy committee an early insight into where the economy is heading. As the two Bank of England economists put it, the Bank's quarterly bulletin's "official economic statistics are generally published with a lag" of one month, three months, or even longer. Analysis of search trends, by contrast, is immediate. That's especially useful where data takes a long time to arrive or is of questionable quality. In Italy, two economists affiliated with the Bank of Italy, Francesco D'Amuri and Juri Marcucci, also found that analysis of Google data improves unemployment nowcasts' and forecasts.

Advertisement
Advertisement - Article continues below

What about Twitter?

An academic paper was published in February with the self-explanatory title Twitter Mood Predicts the Stock Market. Three computer scientists Johan Bollen, Huina Mao and Xiao-Jun Zeng (two of them at Indiana University and one at Manchester) set out to examine whether societies as a whole experience mood states that affect their collective decision-making and whether these correlate with, and can predict, economic indicators. They did this by analysing the text content of tweets using two mood-tracking tools, OpinionFinder (which measures simple positive versus negative mood) and Google Profile of Mood States (which measures moods in terms of six positive dimensions; namely: calm, alert, sure, vital, kind and happy).

What did they discover?

Unless you are a computer scientist with a particular expertise in statistical analysis, you may well find the guts of the paper hard going (anyone for "bivariate Granger causality analysis"?). However, it boils down to whether measured Twitter mood states predicted changes in the closing value of the Dow Jones a few days later. The answer is yes 87.6% of the time. In particular, rises and falls in instances of "calm" words correlate with rises and falls in the stockmarket between two and six days later. Critics might think this isn't good enough: after all, it is more than possible even if you trust the power of fuzzy neural networks to be right 87% of the time and still lose lots of money on the stockmarket. Derwent Capital Markets, however, disagrees.

Who are Derwent Capital Markets?

Lots of hedge funds are rumoured to be using social media analytics to guide their thinking. Derwent is the only one so far to base an entire fund on it the Twitter Fund. Derwent is a small London-based investment firm that has signed an exclusive deal with the authors of the Twitter paper and in May launched the first hedge fund to base its decisions principally on "sentiment derived from real-time social media data analysis".

Paul Hawtin, the founder and fund manager, says: "For years investors have widely accepted that financial markets are driven by fear and greed, but we've never before had the technology or data to be able to quantify human emotion. This is the fourth dimension". Wish him luck.

Is this the future of forecasting?

The most striking and convincing research in the emerging field of nowcasting', suggests Tim Harford in the FT, was published by Nikolaos Askitas and Klaus Zimmermann as an IZA working paper in February. Askitas and Zimmermann used data from a new system designed to collect road tolls: most heavy vehicles in Germany have GPS-based technology that tracks their movements and levies the right toll. "Unsurprisingly, their toll index' provides a very effective "nowcast" of German industrial production. Perhaps we can look forward to the day when real economic data is collected and disseminated almost as easily as the charts on business television."

Advertisement

Recommended

Visit/517688/the-british-equity-market-is-shrinking
Stock markets

The British equity market is shrinking

British startups are abandoning public stockmarkets and turning to deep-pocketed Silicon Valley venture capitalists for their investment needs.
8 Nov 2019
Visit/511212/reasons-for-investors-to-be-bearish-but-stick-with-the-stockmarket-bulls
Stock markets

There are lots of reasons to be bearish – but you should stick with the bulls

There are plenty of reasons to be gloomy about the stockmarkets. But the trend remains up, says Dominic Frisby. And you don’t want to bet against the …
17 Jul 2019
Visit/510684/good-news-on-jobs-scares-stockmarkets
Economy

Good news on jobs scares US stockmarkets

June brought the best monthly US jobs growth of the year, but stockmarkets were not best pleased.
11 Jul 2019
Visit/510135/trade-war-ceasefire-boosts-stockmarkets
Economy

Trade-war ceasefire boosts stockmarkets

Stockmarkets sighed with relief after the G20 summit in Japan brought a handshake between Donald Trump and Xi Jinping.
4 Jul 2019

Most Popular

Visit/investments/stockmarkets/600909/will-coronavirus-kill-off-the-bull-market
Stockmarkets

Will coronavirus kill off the bull market?

It seems clear now the coronavirus will at some point go global. And when it does, will it bring down the stockmarket’s bull market? John Stepek looks…
27 Feb 2020
Visit/investments/commodities/gold/600887/gold-price-coronavirus-cost-of-face-masks
Gold

Gold, coronavirus, and the high cost of face masks in northern Italy

The price of gold is spiking – as it always does in a global panic. But this bull market predates the coronavirus epidemic, says Dominic Frisby, and w…
26 Feb 2020
Visit/personal-finance/pensions/pension-tax/600877/why-it-makes-sense-to-scrap-higher-rate-pensions-tax
Pension tax

Why it makes sense to scrap higher-rate pensions tax relief

The point of pensions tax relief is to keep you out of the means-tested benefits system. The current system is ridiculously generous, says Merryn Some…
24 Feb 2020
Visit/investments/stockmarkets/european-stockmarkets/600725/is-2020-the-year-for-european-small-cap
Sponsored

Is 2020 the year for European small-cap stocks?

SPONSORED CONTENT - Ollie Beckett, manager of the TR European Growth Trust, on why he believes European small-cap stocks are performing well.
12 Feb 2019