Scientists Develop Financial Turing Test

Can humans distinguish between sequences of real and randomly generated financial data? Scientist have developed a new test to find out.

Various economists argue that the efficiency of a market ought to be clearly evident in the returns it produces. They say that the more efficient it is, the more random its returns will be and a perfect market should be completely random.

That would appear to give the lie to the widespread belief that humans are unable to tell the difference between financial market returns and, say, a sequence of coin tosses. A number of experiments seem to back up this belief, showing for example that humans studying randomly generated data very quickly identify 'trends' in the data and develop hypotheses about them.

To find out whether humans can reliably distinguish between real and random market data, Jasmina Hasanhodzic at AlphaSimplex, an investment strategy company in Cambridge, Mass, Andrew Lo at MIT's Sloan School of Management, who founded AlphaSimplex and Emanuele Viola at NorthEastern University, have devised a simple experiment.

They have created a computer game in which a player is shown two time-series of data. One is real data from a financial market such as the US Dollar Index, or the spot price of Gold. The other is the same data randomly rearranged. The player has to guess which is the real series and is immediately told whether the guess is right or wrong.

Hasanhodzic and co call this a financial Turing test and anybody can sign up and take the test on their website.

In their experiment, 78 people took the test, with each contest lasting two weeks.

The results show that that humans are actually rather good at this game. After a few guesses most people quickly learn how to distinguish the real data from the random stuff. "The results provide overwhelming statistical evidence (p-values of at most 0.5%) that humans can quickly learn to distinguish actual price series from randomly generated ones," say Hasanhodzic and co.

It's not hard to see why. In feedback sessions, the players say that the real data was smoother than the randomised data or vice versa and that these patterns were easy to spot after a few goes.

That's an intriguing result but what to make of it? First let's look at what the study does not address. The study does not address any notion of predictability. A truly random market is entirely unpredictable, by definition.

There is good evidence that real markets are not random and that their behaviour can be described by fairly simple principles. That doesn't make them predictable, however (although we have looked at evidence that certain kinds of bubble markets might be predictable here, here and here).

Neither does the study address whether humans are good at making predictions; whether they are better at predicting the future performance of a market than, say, a coin toss.

So what does it show? It shows that humans are good at pattern recognition. Nothing more and nothing less.
Ref: arxiv.org/abs/1002.4592: Is It Real, or Is It Randomized?: A Financial Turing Test

Source: http://newscri.be/link/1029198

Comments

Open 6 Comments

• It may mean a lot more. . . ". . .It shows that humans are good at pattern recognition. Nothing more and nothing less. . ." Not so fast. We are talking about MARKETS and the behavior/participation of its various players. And above it all, we have Economic Theories of various types that inform/underpin/hope-to-influence national and global economic policy. And let's not forget that we almost had Depression 2.0 I often hear economists talk about 'Rational Market Behaviour'. Thing is, that supposition evolved from a time when Traders looked at Ticker Tapes and made their own 'wetware' based analysis of stock trends which were generally based on the common sense desire of companies and their shareholders to have their holdings increase in value-- at which said trader would grab a phone and yell out an order up or down. Today-- not only do we have these same trades being executed by computers within seconds, we now have trades being executed algorithmically for mathematical reasons that have nothing to do with company/product trends or even inside info and more to do with graphical stock microjumps up or down. Just a pure 'For X delta, execute Y Action times Z number of stocks'. It doesn't matter if the company makes CPU's or makes Tampons. And I'm sure that quite a few of you with PURE Tech stocks may have had a prolonged WTF moment that lasted for DAYS as you watched your beloved stock dive for the oceanic abyss despite it having NOTHING WHAT-SO-EVER to do with Subprime Mortgages. There was NOTHING 'Rational' about it. Nor was it ALL Human wetware Irrationality.  Couple that with whole banks of Trading Servers taking the Market on Upward Swoops and deathdefying dives inside a single day with NO MAJOR ECONOMIC NEWS. . .coupled with increasing possibility of Gov't scrutiny on so-called 'Program Trades' this notion of a Financial Turing test could be a match being lite in a dusty room full of dynamite. Rate this comment: (Reply)

  Marrach 02/26/2010 Posts:3 Avg Rating:

• I already built this. Three years ago I ran Stock Or Not - 100k games were played. My results were public. http://www.felixsalmon.com/000763.html Rate this comment: (Reply)

  jdigittl 02/26/2010 Posts:2 Avg Rating:

• reinvent the wheel So did they actually use Josh Reich's code or simply stumble upon the same idea? Rate this comment: (Reply)

  jd long 02/26/2010 Posts:2

  • Re: reinvent the wheel I don't claim to be that smart, its a pretty obvious idea. And theirs has Java! mine was cobbled together from bash scripts + R. Here is my R code http://i2pi.com/rez/stockOrNot.R Rate this comment: (Reply)

    jdigittl 02/26/2010 Posts:2 Avg Rating:

    • Re: reinvent the wheel Java, cool! That's so enterprizey! ;) Yeah I know it's not exactly novel. But if they got the idea from your game it would have been cool to at least give you a nod. Rate this comment: (Reply)

      jd long 02/26/2010 Posts:2

• EURUSD price line and your predictability The current crisis is a crisis linked to the possibility of building high technological products, only possible today. Result of the accessible massive processing and the large data storage available. This technological phenomenon as discussed above in the comments, causes meetings between algorithms and makes it sound patterns. They seem random, if we do not see what is going on. There are varying degrees of leverage and space-time. Minor leverages more time and space, opposite is the reverse. All that is smaller than a measure of a day are noisy routines. It is known that all uses standard margins and margin calls. Most of the algorithms act at the beginning or at the end of movements, therefore, most of all buy and sell at the same time, even using the same lagging indicators and/or similar algorithms. With some simple math, one can predict how big is the next step, but not the direction. When a movement starts, just stop in the next step, will never be in the middle ... It is a war between powers ... Sorry for my poor English. Rate this comment: (Reply)

  lleal2000 02/26/2010 Posts:1

Reply

Professional financial planners

 Expert advice, not pushing products, is the key

FINANCIAL planning (FP) should be viewed as a profession where unbiased and independent advice is provided to clients covering all personal financial matters and services.

However, the FP industry in Malaysia, which is still in its infancy stage compared with their counterparts in other advanced countries, is grappling with issues such as wrong public perceptions and lack of product innovation as well as FP tools.

"In short, it involves advice first, products second and services thereafter" ROBERT FOO

 

According to MyFP Services Sdn Bhd financial planner and managing director Robert Foo, the financial planning model follows a six-step process which involves building a relationship with the client, gathering the client’s personal data as well as financial goals, analysing the data, recommending and implementing solutions besides tracking that the client’s goals are eventually met.

“In short, it involves advice first, products second and services thereafter,” Foo concludes.

However, Foo notes that the Malaysian public tend to view FP practitioners as no more than product salespersons with FP qualifications.

“Hence, there is little trust on the advice given by many of these “professionals” although they are licensed by the Securities Commision (SC) or Bank Negara. They are perceived to be biased. At the back of their (the public) minds, financial planners are perceived to be out to make sales commission from selling as many products as possible,” Foo notes.

When the FP profession started to take root in Malaysia around 2001, the majority who took up FP qualifications were insurance and unit trust agents.

“Many of those qualified are still adopting a multi-level agency sales approach to their business and the emphasis and compensation is solely based on product sales and commission,” Foo adds.

Foo says the problem still exists due to the tied agency system where individual financial planners or analysts can only recommend products from a single provider.

"Their solutions are domestically myopic when the clients they target have already gone global" JEREMY TAN

 

To mitigate this problem, an institutionalised agency system called Corporate Unit Trust Agent was established where licensed financial planners or analysts can distribute products from multiple providers.
“But if you look at the response to this ‘innovation’, only four entities (product providers) have applied, which is not what individual financial planners want. This, in turn, hinders the development of the FP profession,” Foo adds.

Due to a lack of enforcement, scores of individuals are holding themselves out as financial planners or advisors without a licence.

“Some even have FP qualifications but are not licensed by SC or Bank Negara. Most of these are sales and product agents who want a little credibility with these professional sounding labels,” Foo notes.

Jeremy Tan, a licensed financial adviser with Standard Financial Planner Sdn Bhd, agrees that many equate financial planning with unit trust investment and insurance planning.

In reality, financial planning involves a holistic planning of one’s finances throughout the different stages of one’s life (family inclusive). This is a more wholesome approach and encompasses wealth management, its protection, distribution and wealth accumulation on an independent basis.

“Unit trust investment and insurance are among the vehicles in holistic financial planning, but they are by no means exhaustive,” Tan adds.

Another concern is the lack of accessibility to product innovations and solutions, which are available overseas, but not available to retail clients here. This limits the development of the FP industry.

Many clients recognise the options and opportunities overseas and have actually channelled a large amount of their money abroad for offshore product options.

“How do you expect the Malaysian FP practitioners to prosper? Their solutions are domestically myopic when the clients they target have already gone global?” Foo adds.

The local FP industry also lacks the tools required to provide the necessary comprehensive advice and services irrespective of whether the client’s assets have remained on Malaysian shores or gone global.
“Currently, there are almost no competitively priced and reliable tools available to these growing boutique firms to serve their globally oriented clients,” Foo says.

Coupled with the tied agency system, practitioners do not see the usefulness of such a comprehensive and globally-oriented system, Foo notes.

Financial planners agree that there need to be concerted efforts by the regulators and FP practitioners to have expos and public forums to create awareness.

“The caveat here is that it should be clearly about FP advice and not about products. Otherwise the confusion will persist,” Foo says.

Advisory practice standards should also be set to ensure that the FP practitioners provide their advice professionally. The client’s interest should be placed first.

“But standards set should not stifle the innovation and creativity of the different business models used by FP practitioners,” Foo notes.

More importantly, there is a need to open up the market for greater competition such as in the United States, Britain and Australia; this will benefit the public in the long run.

This includes making available offshore funds and products via various forms of distribution channels on a “willing buyer willing seller” basis.

“Investment and protection are two of the most important financial concerns for Malaysians and the public should get the best advice and options for their financial future,” Foo concludes.

By LAALITHA HUNT, laalhunt@thestar.com.my