It’s what every investor has dreamed of: a way of predicting stock market moves. And according to researchers in the UK, it’s easier than you’d think.
Changes in the US Dow Jones index are presaged by the ebb and flow of Google searches for certain financial keywords.
Better still, acting on these trends could make you a huge profit – at least, until others find the same keywords, of course.
Predictably, publication of this claim in the journal Nature Scientific Reports attracted a lot of attention.
It was also hailed as evidence of the power of so-called Big Data: the extraction of insight from datasets.
Now it looks set to become a classic example of what Big Data can do – but not in a good way.
An analysis of the claim published this month suggests it is an object lesson in how digging into Big Data can trigger an avalanche of dross.
With everyone from politicians to billion-dollar corporations looking to Big Data for answers to big questions, it holds vital lessons for all of us.
And topping the list is: never let go of common sense.
When it first began to make headlines around a decade ago, the exploitation of Big Data was hailed as nothing short of a revolution in how we can make sense of the world. In the face of so much information, there was simply no reason to bother dreaming up intricate theories and then testing them.
"Out with every theory of human behaviour, from linguistics to sociology. Forget taxonomy, ontology and psychology," wrote Chris Anderson, editor-in-chief of Wired. "With enough data, the numbers speak for themselves."
At last month’s World Government Summit in Dubai, the potential of Big Data was held up as the means to solve a host of problems, from delivering local public services to tackling global food security.
But now many of those who have looked to Big Data for insight have found that when left to “speak for themselves”, numbers often spout gibberish.
Take that claim that Google search data can predict stock market moves. The idea isn’t so crazy: market swings reflect changes in sentiment among investors, and these might well show up as changes in the volume of searches for certain financial terms.
But which ones? In their Nature Science Reports study, the researchers came up with a list of about 100 terms they thought might pop up, like "risk" and "investment". They then set computers digging into Google's databases, looking for links between search volumes for each term and changes in the Dow Jones index.
And it worked. The computer found correlations between the two.
But the researchers went further, showing that the best correlation could be turned into hard cash.
Their results showed that a trading strategy of buying when the word “debt” is trending upwards and vice-versa would have generated a profit of more than 300 per cent compared to a simple buy-and-hold strategy.
But the key phrase there is “would have”. The researchers did not make any money themselves - not because they were above such things but because they would have needed a time machine. That’s because all their results were retrospective, revealing only past correlations.
And that’s where the whole idea unravels.
By running a list of 100 terms against past records of the Dow Jones, the researchers risked falling into a classic Big Data trap: finding correlations that are meaningless flukes.
Such correlations are shockingly common, as former Harvard law student Tyler Vigen has shown through his now-celebrated eponymous website.
It contains countless silly but impressively strong correlations found by automatically scouring the web.
For example, Vigen’s computers found that the annual amount of honey produced in the US is very strongly correlated to the number of murders using blunt objects.
Of course, no one with any common sense would fall for such “links”. But that’s the problem with using computers to find them: common sense does not come as standard.
In theory, genuine links might exist between search terms like “debt” and stock market changes. But the only way to find out is to check their predictive power.
Dr Wai Mun Fong, associate professor of finance at the National University of Singapore, has now done precisely that, in research published in the current Journal of Index Investing.
Dr Fong took the same list of about 100 terms used in the original study but this time tested their predictive power in years not examined by the original researchers.
Search terms that proved most strongly correlated with the Dow Jones in one year were used to predict market behaviour in the following year.
Sure enough, Dr Fong confirmed that some Google search terms were correlated with market moves.
But they proved to be “society”, “cancer”, “home” and various others with pretty tenuous links to investor sentiment. Significantly, one search term that failed to predict the market over this new timescale was “debt”.
Dr Fong’s conclusions are blunt: using Big Data to predict stock prices that aren’t based on solid economic theory or properly tested “are doomed to be misguided and futile”.
That such basic warnings are still necessary says much about the spell Big Data is weaving over smart people.
Even Google, that titan of Big Data, has proved vulnerable. In 2008 it unveiled Google Flu Trends (GFT), with the aim of helping predict future flu epidemics through spikes in certain search terms.
To find these keywords, computers had looked for links between 50 million candidates and just 1,200 flu outbreak data points. So big a mismatch is a sure-fire way of finding spurious correlations.
And thus it proved. Like the stock market predictor, GFT made headlines, then mistakes and, ultimately, proved useless. Google threw in the towel in 2015.
Now others are going down the same path. The latest victims of Big Data are hedge funds, who have ploughed huge sums into finding patterns that give them an edge. One industry insider recently told Bloomberg that the “insights” they’re finding in Big Data have a failure rate of about 90 per cent.
Few can resist surveying the towering masses of global data without believing the prospector’s credo “There’s gold in them thar hills”. There is, but it’s buried deep in dross - and simply grabbing a shovel and digging is not the way to find it.
Robert Matthews is visiting professor of science at Aston University, Birmingham, UK
CONFIRMED%20LINE-UP
%3Cp%3EElena%20Rybakina%20(Kazakhstan)%0D%3Cbr%3EOns%20Jabeur%20(Tunisia)%0D%3Cbr%3EMaria%20Sakkari%20(Greece)%0D%3Cbr%3EBarbora%20Krej%C4%8D%C3%ADkov%C3%A1%20(Czech%20Republic)%0D%3Cbr%3EBeatriz%20Haddad%20Maia%20(Brazil)%0D%3Cbr%3EJe%C4%BCena%20Ostapenko%20(Latvia)%0D%3Cbr%3ELiudmila%20Samsonova%0D%3Cbr%3EDaria%20Kasatkina%E2%80%AF%0D%3Cbr%3EVeronika%20Kudermetova%E2%80%AF%0D%3Cbr%3ECaroline%20Garcia%20(France)%E2%80%AF%0D%3Cbr%3EMagda%20Linette%20(Poland)%E2%80%AF%0D%3Cbr%3ESorana%20C%C3%AErstea%20(Romania)%E2%80%AF%0D%3Cbr%3EAnastasia%20Potapova%E2%80%AF%0D%3Cbr%3EAnhelina%20Kalinina%20(Ukraine)%E2%80%AF%E2%80%AF%0D%3Cbr%3EJasmine%20Paolini%20(Italy)%E2%80%AF%0D%3Cbr%3EEmma%20Navarro%20(USA)%E2%80%AF%0D%3Cbr%3ELesia%20Tsurenko%20(Ukraine)%0D%3Cbr%3ENaomi%20Osaka%20(Japan)%20-%20wildcard%0D%3Cbr%3EEmma%20Raducanu%20(Great%20Britain)%20-%20wildcard%3Cbr%3EAlexandra%20Eala%20(Philippines)%20-%20wildcard%3C%2Fp%3E%0A
Formula Middle East Calendar (Formula Regional and Formula 4)
Round 1: January 17-19, Yas Marina Circuit – Abu Dhabi
Round 2: January 22-23, Yas Marina Circuit – Abu Dhabi
Round 3: February 7-9, Dubai Autodrome – Dubai
Round 4: February 14-16, Yas Marina Circuit – Abu Dhabi
Round 5: February 25-27, Jeddah Corniche Circuit – Saudi Arabia
The smuggler
Eldarir had arrived at JFK in January 2020 with three suitcases, containing goods he valued at $300, when he was directed to a search area.
Officers found 41 gold artefacts among the bags, including amulets from a funerary set which prepared the deceased for the afterlife.
Also found was a cartouche of a Ptolemaic king on a relief that was originally part of a royal building or temple.
The largest single group of items found in Eldarir’s cases were 400 shabtis, or figurines.
Khouli conviction
Khouli smuggled items into the US by making false declarations to customs about the country of origin and value of the items.
According to Immigration and Customs Enforcement, he provided “false provenances which stated that [two] Egyptian antiquities were part of a collection assembled by Khouli's father in Israel in the 1960s” when in fact “Khouli acquired the Egyptian antiquities from other dealers”.
He was sentenced to one year of probation, six months of home confinement and 200 hours of community service in 2012 after admitting buying and smuggling Egyptian antiquities, including coffins, funerary boats and limestone figures.
For sale
A number of other items said to come from the collection of Ezeldeen Taha Eldarir are currently or recently for sale.
Their provenance is described in near identical terms as the British Museum shabti: bought from Salahaddin Sirmali, "authenticated and appraised" by Hossen Rashed, then imported to the US in 1948.
- An Egyptian Mummy mask dating from 700BC-30BC, is on offer for £11,807 ($15,275) online by a seller in Mexico
- A coffin lid dating back to 664BC-332BC was offered for sale by a Colorado-based art dealer, with a starting price of $65,000
- A shabti that was on sale through a Chicago-based coin dealer, dating from 1567BC-1085BC, is up for $1,950
The specs
AT4 Ultimate, as tested
Engine: 6.2-litre V8
Power: 420hp
Torque: 623Nm
Transmission: 10-speed automatic
Price: From Dh330,800 (Elevation: Dh236,400; AT4: Dh286,800; Denali: Dh345,800)
On sale: Now
Mercer, the investment consulting arm of US services company Marsh & McLennan, expects its wealth division to at least double its assets under management (AUM) in the Middle East as wealth in the region continues to grow despite economic headwinds, a company official said.
Mercer Wealth, which globally has $160 billion in AUM, plans to boost its AUM in the region to $2-$3bn in the next 2-3 years from the present $1bn, said Yasir AbuShaban, a Dubai-based principal with Mercer Wealth.
“Within the next two to three years, we are looking at reaching $2 to $3 billion as a conservative estimate and we do see an opportunity to do so,” said Mr AbuShaban.
Mercer does not directly make investments, but allocates clients’ money they have discretion to, to professional asset managers. They also provide advice to clients.
“We have buying power. We can negotiate on their (client’s) behalf with asset managers to provide them lower fees than they otherwise would have to get on their own,” he added.
Mercer Wealth’s clients include sovereign wealth funds, family offices, and insurance companies among others.
From its office in Dubai, Mercer also looks after Africa, India and Turkey, where they also see opportunity for growth.
Wealth creation in Middle East and Africa (MEA) grew 8.5 per cent to $8.1 trillion last year from $7.5tn in 2015, higher than last year’s global average of 6 per cent and the second-highest growth in a region after Asia-Pacific which grew 9.9 per cent, according to consultancy Boston Consulting Group (BCG). In the region, where wealth grew just 1.9 per cent in 2015 compared with 2014, a pickup in oil prices has helped in wealth generation.
BCG is forecasting MEA wealth will rise to $12tn by 2021, growing at an annual average of 8 per cent.
Drivers of wealth generation in the region will be split evenly between new wealth creation and growth of performance of existing assets, according to BCG.
Another general trend in the region is clients’ looking for a comprehensive approach to investing, according to Mr AbuShaban.
“Institutional investors or some of the families are seeing a slowdown in the available capital they have to invest and in that sense they are looking at optimizing the way they manage their portfolios and making sure they are not investing haphazardly and different parts of their investment are working together,” said Mr AbuShaban.
Some clients also have a higher appetite for risk, given the low interest-rate environment that does not provide enough yield for some institutional investors. These clients are keen to invest in illiquid assets, such as private equity and infrastructure.
“What we have seen is a desire for higher returns in what has been a low-return environment specifically in various fixed income or bonds,” he said.
“In this environment, we have seen a de facto increase in the risk that clients are taking in things like illiquid investments, private equity investments, infrastructure and private debt, those kind of investments were higher illiquidity results in incrementally higher returns.”
The Abu Dhabi Investment Authority, one of the largest sovereign wealth funds, said in its 2016 report that has gradually increased its exposure in direct private equity and private credit transactions, mainly in Asian markets and especially in China and India. The authority’s private equity department focused on structured equities owing to “their defensive characteristics.”
UAE currency: the story behind the money in your pockets
It's Monty Python's Crashing Rocket Circus
To the theme tune of the famous zany British comedy TV show, SpaceX has shown exactly what can go wrong when you try to land a rocket.
The two minute video posted on YouTube is a compilation of crashes and explosion as the company, created by billionaire Elon Musk, refined the technique of reusable space flight.
SpaceX is able to land its rockets on land once they have completed the first stage of their mission, and is able to resuse them multiple times - a first for space flight.
But as the video, How Not to Land an Orbital Rocket Booster, demonstrates, it was a case if you fail, try and try again.
Know before you go
- Jebel Akhdar is a two-hour drive from Muscat airport or a six-hour drive from Dubai. It’s impossible to visit by car unless you have a 4x4. Phone ahead to the hotel to arrange a transfer.
- If you’re driving, make sure your insurance covers Oman.
- By air: Budget airlines Air Arabia, Flydubai and SalamAir offer direct routes to Muscat from the UAE.
- Tourists from the Emirates (UAE nationals not included) must apply for an Omani visa online before arrival at evisa.rop.gov.om. The process typically takes several days.
- Flash floods are probable due to the terrain and a lack of drainage. Always check the weather before venturing into any canyons or other remote areas and identify a plan of escape that includes high ground, shelter and parking where your car won’t be overtaken by sudden downpours.
Our legal columnist
Name: Yousef Al Bahar
Advocate at Al Bahar & Associate Advocates and Legal Consultants, established in 1994
Education: Mr Al Bahar was born in 1979 and graduated in 2008 from the Judicial Institute. He took after his father, who was one of the first Emirati lawyers
The White Lotus: Season three
Creator: Mike White
Starring: Walton Goggins, Jason Isaacs, Natasha Rothwell
Rating: 4.5/5
The specs
Engine: 4.0-litre flat-six
Torque: 450Nm at 6,100rpm
Transmission: 7-speed PDK auto or 6-speed manual
Fuel economy, combined: 13.8L/100km
On sale: Available to order now
The five pillars of Islam
COMPANY%20PROFILE
%3Cp%3E%3Cstrong%3EName%3A%20%3C%2Fstrong%3ESmartCrowd%0D%3Cbr%3E%3Cstrong%3EStarted%3A%20%3C%2Fstrong%3E2018%0D%3Cbr%3E%3Cstrong%3EFounder%3A%20%3C%2Fstrong%3ESiddiq%20Farid%20and%20Musfique%20Ahmed%0D%3Cbr%3E%3Cstrong%3EBased%3A%20%3C%2Fstrong%3EDubai%0D%3Cbr%3E%3Cstrong%3ESector%3A%20%3C%2Fstrong%3EFinTech%20%2F%20PropTech%0D%3Cbr%3E%3Cstrong%3EInitial%20investment%3A%20%3C%2Fstrong%3E%24650%2C000%0D%3Cbr%3E%3Cstrong%3ECurrent%20number%20of%20staff%3A%3C%2Fstrong%3E%2035%0D%3Cbr%3E%3Cstrong%3EInvestment%20stage%3A%20%3C%2Fstrong%3ESeries%20A%0D%3Cbr%3E%3Cstrong%3EInvestors%3A%20%3C%2Fstrong%3EVarious%20institutional%20investors%20and%20notable%20angel%20investors%20(500%20MENA%2C%20Shurooq%2C%20Mada%2C%20Seedstar%2C%20Tricap)%3C%2Fp%3E%0A
What it means to be a conservationist
Who is Enric Sala?
Enric Sala is an expert on marine conservation and is currently the National Geographic Society's Explorer-in-Residence. His love of the sea started with his childhood in Spain, inspired by the example of the legendary diver Jacques Cousteau. He has been a university professor of Oceanography in the US, as well as working at the Spanish National Council for Scientific Research and is a member of the World Economic Forum’s Global Future Council on Biodiversity and the Bio-Economy. He has dedicated his life to protecting life in the oceans. Enric describes himself as a flexitarian who only eats meat occasionally.
What is biodiversity?
According to the United Nations Environment Programme, all life on earth – including in its forests and oceans – forms a “rich tapestry of interconnecting and interdependent forces”. Biodiversity on earth today is the product of four billion years of evolution and consists of many millions of distinct biological species. The term ‘biodiversity’ is relatively new, popularised since the 1980s and coinciding with an understanding of the growing threats to the natural world including habitat loss, pollution and climate change. The loss of biodiversity itself is dangerous because it contributes to clean, consistent water flows, food security, protection from floods and storms and a stable climate. The natural world can be an ally in combating global climate change but to do so it must be protected. Nations are working to achieve this, including setting targets to be reached by 2020 for the protection of the natural state of 17 per cent of the land and 10 per cent of the oceans. However, these are well short of what is needed, according to experts, with half the land needed to be in a natural state to help avert disaster.
Essentials
The flights
Etihad (etihad.ae) and flydubai (flydubai.com) fly direct to Baku three times a week from Dh1,250 return, including taxes.
The stay
A seven-night “Fundamental Detox” programme at the Chenot Palace (chenotpalace.com/en) costs from €3,000 (Dh13,197) per person, including taxes, accommodation, 3 medical consultations, 2 nutritional consultations, a detox diet, a body composition analysis, a bio-energetic check-up, four Chenot bio-energetic treatments, six Chenot energetic massages, six hydro-aromatherapy treatments, six phyto-mud treatments, six hydro-jet treatments and access to the gym, indoor pool, sauna and steam room. Additional tests and treatments cost extra.
The Sand Castle
Director: Matty Brown
Stars: Nadine Labaki, Ziad Bakri, Zain Al Rafeea, Riman Al Rafeea
Rating: 2.5/5
TOURNAMENT INFO
2018 ICC World Twenty20 Asian Western Regional Qualifier
The top three teams progress to the Asia Qualifier
Thursday results
UAE beat Kuwait by 86 runs
Qatar beat Bahrain by five wickets
Saudi Arabia beat Maldives by 35 runs
Friday fixtures
10am, third-place playoff – Saudi Arabia v Kuwait
3pm, final – UAE v Qatar
Martin Sabbagh profile
Job: CEO JCDecaux Middle East
In the role: Since January 2015
Lives: In the UAE
Background: M&A, investment banking
Studied: Corporate finance
Key facilities
- Olympic-size swimming pool with a split bulkhead for multi-use configurations, including water polo and 50m/25m training lanes
- Premier League-standard football pitch
- 400m Olympic running track
- NBA-spec basketball court with auditorium
- 600-seat auditorium
- Spaces for historical and cultural exploration
- An elevated football field that doubles as a helipad
- Specialist robotics and science laboratories
- AR and VR-enabled learning centres
- Disruption Lab and Research Centre for developing entrepreneurial skills
THE SPECS
Engine: 6.75-litre twin-turbocharged V12 petrol engine
Power: 420kW
Torque: 780Nm
Transmission: 8-speed automatic
Price: From Dh1,350,000
On sale: Available for preorder now
Singham Again
Director: Rohit Shetty
Stars: Ajay Devgn, Kareena Kapoor Khan, Ranveer Singh, Akshay Kumar, Tiger Shroff, Deepika Padukone
Rating: 3/5
Five%20calorie-packed%20Ramadan%20drinks
%3Cp%3E%3Cstrong%3ERooh%20Afza%3C%2Fstrong%3E%0D%3Cbr%3E100ml%20contains%20414%20calories%0D%3Cbr%3E%3Cstrong%3ETang%20orange%20drink%3C%2Fstrong%3E%0D%3Cbr%3E100ml%20serving%20contains%20300%20calories%0D%3Cbr%3E%3Cstrong%3ECarob%20beverage%20mix%3C%2Fstrong%3E%0D%3Cbr%3E100ml%20serving%20contains%20about%20300%20calories%0D%3Cbr%3E%3Cstrong%3EQamar%20Al%20Din%20apricot%20drink%3C%2Fstrong%3E%0D%3Cbr%3E100ml%20saving%20contains%2061%20calories%0D%3Cbr%3E%3Cstrong%3EVimto%20fruit%20squash%3C%2Fstrong%3E%0D%3Cbr%3E100ml%20serving%20contains%2030%20calories%3C%2Fp%3E%0A
Ireland v Denmark: The last two years
Denmark 1-1 Ireland
7/06/19, Euro 2020 qualifier
Denmark 0-0 Ireland
19/11/2018, Nations League
Ireland 0-0 Denmark
13/10/2018, Nations League
Ireland 1 Denmark 5
14/11/2017, World Cup qualifier
Denmark 0-0 Ireland
11/11/2017, World Cup qualifier
Milestones on the road to union
1970
October 26: Bahrain withdraws from a proposal to create a federation of nine with the seven Trucial States and Qatar.
December: Ahmed Al Suwaidi visits New York to discuss potential UN membership.
1971
March 1: Alex Douglas Hume, Conservative foreign secretary confirms that Britain will leave the Gulf and “strongly supports” the creation of a Union of Arab Emirates.
July 12: Historic meeting at which Sheikh Zayed and Sheikh Rashid make a binding agreement to create what will become the UAE.
July 18: It is announced that the UAE will be formed from six emirates, with a proposed constitution signed. RAK is not yet part of the agreement.
August 6: The fifth anniversary of Sheikh Zayed becoming Ruler of Abu Dhabi, with official celebrations deferred until later in the year.
August 15: Bahrain becomes independent.
September 3: Qatar becomes independent.
November 23-25: Meeting with Sheikh Zayed and Sheikh Rashid and senior British officials to fix December 2 as date of creation of the UAE.
November 29: At 5.30pm Iranian forces seize the Greater and Lesser Tunbs by force.
November 30: Despite a power sharing agreement, Tehran takes full control of Abu Musa.
November 31: UK officials visit all six participating Emirates to formally end the Trucial States treaties
December 2: 11am, Dubai. New Supreme Council formally elects Sheikh Zayed as President. Treaty of Friendship signed with the UK. 11.30am. Flag raising ceremony at Union House and Al Manhal Palace in Abu Dhabi witnessed by Sheikh Khalifa, then Crown Prince of Abu Dhabi.
December 6: Arab League formally admits the UAE. The first British Ambassador presents his credentials to Sheikh Zayed.
December 9: UAE joins the United Nations.
The five pillars of Islam
HAJJAN
%3Cp%3EDirector%3A%20Abu%20Bakr%20Shawky%C2%A0%3C%2Fp%3E%0A%3Cp%3E%3Cbr%3EStarring%3A%20Omar%20Alatawi%2C%20Tulin%20Essam%2C%20Ibrahim%20Al-Hasawi%C2%A0%3C%2Fp%3E%0A%3Cp%3E%3Cbr%3ERating%3A%204%2F5%3C%2Fp%3E%0A
More from our neighbourhood series:
