Automating Transition Functions: A Way To Improve Trading Profits with Recurrent Reinforcement Learning - Artificial Intelligence Applications and Innovations (AIAI 2014) Access content directly
Conference Papers Year : 2014

Automating Transition Functions: A Way To Improve Trading Profits with Recurrent Reinforcement Learning

Abstract

This paper presents an application of the logistic smooth transition function and recurrent reinforcement learning for designing financial trading systems. We propose a trading system which is an upgraded version of the regime-switching recurrent reinforcement learning (RS-RRL) trading system referred to in the literature. In our proposed system (RS-RRL 2.0), we use an automated transition function to model the regime switches in equity returns. Unlike the original RS-RRL trading system, the dynamic of the transition function in our trading system is driven by utility maximization, which is in line with the trading purpose. Volume, relative strength index, price-to-earnings ratio, moving average prices from technical analysis, and the conditional volatility from a GARCH model are considered as possible options for the transition variable in RS-RRL type trading systems. The significance of Sharpe ratios, the choice of transition variables, and the stability of the trading system are examined by using the daily data of 20 Swiss SPI stocks for the period April 2009 to September 2013. The results from our experiment show that our proposed trading system outperforms the original RS-RRL and RRL trading systems suggested in the literature in terms of better Sharpe ratios recorded in three consecutive out-of-sample periods.
Fichier principal
Vignette du fichier
978-3-662-44654-6_4_Chapter.pdf (170.85 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01391291 , version 1 (03-11-2016)

Licence

Attribution

Identifiers

Cite

Jin Zhang. Automating Transition Functions: A Way To Improve Trading Profits with Recurrent Reinforcement Learning. 10th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Sep 2014, Rhodes, Greece. pp.39-49, ⟨10.1007/978-3-662-44654-6_4⟩. ⟨hal-01391291⟩
161 View
453 Download

Altmetric

Share

Gmail Facebook X LinkedIn More