Juris Mindcraft: Predicting the Stock Market

As part of our R&D efforts with Mindcraft AI, we have tried to predict the movement of KLSE shares using our Artificial Intelligence engine.

To simplify the project, we decided to only use price-action-movement to predict share prices, namely:

• Daily opening price
• Daily closing price
• Daily high
• Daily low
• Daily volume
• Correlation with KLSE Composite Index
• Various Technical Indicators such as Candlesticks, MACD, RSI, etc.

The goal was to see if we could predict whether any given stock would go up at least 5% in 2 weeks.

We felt that this goal was achievable because many traders have been successfully trading using only this information, and some traders have apparently automated their systems and also use AI. For examples of this, see Market Wizards and the newer book Hedge Fund Wizards.

KLSE data was purchased from bizfun.cc as the data is very clean and stock splits and rights issues are corrected for you.

Training was on 2011 and 2012 share price data, and then tested on data from 1995 to 2014. We used all KLSE stocks, excluding low volume stocks as these are too unpredictable.

How Mindcraft AI works

Mindcraft is a pattern recognition engine. It finds patterns in the data and assigns probabilities to how confident it thinks these patterns are. The key feature of AI is that it is able to find interesting patterns even if the data is imperfect, dirty or incomplete. A typical rule generated could look like this:

  IF Moving Average of Share Closing Price Dropped by 20-50% 
    AND Share Correlation with KLCI > 0.5 
    AND KLCI above Moving Average
    AND Share Candlestick is Tweezers Top 
  THEN BUY (67% probability)

Best Results for KLSE 1995-2014

The results for 2011 and 2012 should be good, as that was used to train the AI. The key thing to see is how good the predictions are with years it has never seen before, such as 1995-2010.

[rn_id=560596036, cf>=0.5]

The amount invested per trade was capped at RM 10,000, with no trade allowed to be more than 1% of the total RM volume of the shares for that day (because large share purchases would move the share price). Losses were cut if the share price fell by 20%. Otherwise the shares were sold after the 14 days. We assume transaction costs of 0.5% for buy and sell combined.

Using AI for Investment

The results are currently experimental because the AI works best when there is a lot of volatility in the market. When the market is stable, the AI finds few counters to trade, so some years are very lean. We can make the AI less picky, but then accuracy will drop.

The returns can fluctuate a lot. Some years are very positive, some years negative. This strategy is only suitable if you are a risk taker.

Lastly, the model is very specific to the data provided. Testing on  HK stock market counters reveals that different variables are picked up by the AI.

Overall the data is very promising and more research can be done.

Technical  Notes

This is one of  the largest datasets we  have analysed. The KLSE data extends from 1995 to 2015 and is 3.6 million records. We used a cluster of 5 servers and ran 26 CPU cores in parallel at peak for data mining.