Comparative Analysis of LSTM Neural Network and SVM for USD Exchange Rate Prediction: A Study on Different Training Data Scenarios

Yesy Diah Rosita(1), Lady Silk Moonlight(2),


(1) Faculty of Informatics, Institut Teknologi Telkom Purwokerto, Indonesia
(2) Aeronautical Communication, Politeknik Penerbangan Surabaya, Indonesia

Abstract

Purpose: This paper aims to investigate and compare the performance of LSTM Neural Network and Support Vector Machines (SVM) in predicting the USD exchange rate using three different training data scenarios: 45%, 55%, and 75%. The study employs a dataset from the Indonesian Central Bureau of Statistics (BPS) for the period of January 1 to June 30, 2021, encompassing attributes USD Selling Rate.

Methods: The methods involve implementing LSTM and SVM algorithms within the Python programming language using Google Colaboratory. Three distinct training data scenarios are explored to evaluate the models' robustness. Performance metrics, including Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), and R-squared, are employed for evaluation.

Result: Results reveal that LSTM demonstrates superior prediction accuracy compared to SVM across all scenarios, even though it incurs a longer training time. Notably, in the 75% training data scenario, LSTM achieves an MAE of 49.52, RMSE of 63.08, and R-squared of 0.37906, outperforming SVM with MAE of 138.33, RMSE of 161.58, and R-squared of 0.34277.

Novelty: This study innovatively compares LSTM Neural Network and Support Vector Machines (SVM) for USD exchange rate prediction across different training scenarios (45%, 55%, and 75%). Unlike previous research focusing on individual models, this study systematically evaluates both methods, highlighting the nuanced balance between prediction accuracy and training time. The findings offer novel insights into LSTM and SVM applicability in currency forecasting, providing valuable guidance for researchers and practitioners in model selection based on specific predictive task requirements.

Keywords

Predictive modeling; Time series forecasting; Financial data analysis

Full Text:

PDF

References

G. Pan, “The Impact of Exchange Rate Fluctuation on Toyota Financial Performance and Its Hedging Strategy,” BCP Business & Management, vol. 43, pp. 270–276, Mar. 2023, doi: 10.54691/bcpbm.v43i.4647.

U. S. Al-Azizah, Y. Daulay, and N. Krisnanto, “The Effect of USD/IDR Exchange Rate, Interest Rate, and World Oil Price To Jakarta Composite Index (JCI),” Agregat: Jurnal Ekonomi dan Bisnis, vol. 3, no. 2, p. 191, Nov. 2019, doi: 10.22236/agregat_vol3/is2pp191-204.

E. Y. Matsumoto, E. Del-Moral-Hernandez, C. E. Yoshinaga, and A. de Campos Pinto, “Forecasting US dollar exchange rate movement with computational models and human behavior,” Expert Syst Appl, vol. 194, p. 116521, May 2022, doi: 10.1016/j.eswa.2022.116521.

F. Ayiah-Mensah, P. Arthur-Nunoo, J. Acquah, and J. A. Addor, “Trend Analysis of Exchange Rate of the Ghana Cedi against the US Dollar Using Time Series,” Open J Stat, vol. 13, no. 05, pp. 734–745, 2023, doi: 10.4236/ojs.2023.135035.

A. Vadivel, S. Veeramani, and C. Raghutla, “Exchange rate (USD/INR) pass‐through and wholesale price index: A flexible least square approach,” J Public Aff, vol. 20, no. 3, Aug. 2020, doi: 10.1002/pa.2087.

P. Hasanaj and B. Kuqi, “Analysis of Financial Statements,” Humanities and Social Science Research, vol. 2, no. 2, p. p17, Jun. 2019, doi: 10.30560/hssr.v2n2p17.

E. M. C. Wattimena, A. Annisa, and I. S. Sitanggang, “CO and PM10 Prediction Model based on Air Quality Index Considering Meteorological Factors in DKI Jakarta using LSTM,” Scientific Journal of Informatics, vol. 9, no. 2, pp. 123–132, Oct. 2022, doi: 10.15294/sji.v9i2.33791.

D. Hopp, “Performance of LSTM Neural Networks in Nowcasting during the COVID-19 Crisis,” in UNCTAD Research Paper, 2021. [Online]. Available: https://github.com/dhopp1/NowcastLSTM.jl

W. Sholihah and A. Silvia Handayani, “Revolutionizing Healthcare: Comprehensive Evaluation and Optimization of SVM Kernels for Precise General Health Diagnosis,” Scientific Journal of Informatics, vol. 10, no. 4, p. 445, 2023, doi: 10.15294/sji.v10i4.46430.

A. Fahmi Limas, R. Rosnelly, and A. Nursie, “A Comparative Analysis on the Evaluation of KNN and SVM Algorithms in the Classification of Diabetes,” Scientific Journal of Informatics, vol. 10, no. 3, p. 251, 2023, doi: 10.15294/sji.v10i3.44269.

G. Pan, “The Impact of Exchange Rate Fluctuation on Toyota Financial Performance and Its Hedging Strategy,” BCP Business & Management, vol. 43, pp. 270–276, Mar. 2023, doi: 10.54691/bcpbm.v43i.4647.

U. S. Al-Azizah, Y. Daulay, and N. Krisnanto, “The Effect of USD/IDR Exchange Rate, Interest Rate, and World Oil Price To Jakarta Composite Index (JCI),” Agregat: Jurnal Ekonomi dan Bisnis, vol. 3, no. 2, p. 191, Nov. 2019, doi: 10.22236/agregat_vol3/is2pp191-204.

E. Y. Matsumoto, E. Del-Moral-Hernandez, C. E. Yoshinaga, and A. de Campos Pinto, “Forecasting US dollar exchange rate movement with computational models and human behavior,” Expert Syst Appl, vol. 194, p. 116521, May 2022, doi: 10.1016/j.eswa.2022.116521.

F. Ayiah-Mensah, P. Arthur-Nunoo, J. Acquah, and J. A. Addor, “Trend Analysis of Exchange Rate of the Ghana Cedi against the US Dollar Using Time Series,” Open J Stat, vol. 13, no. 05, pp. 734–745, 2023, doi: 10.4236/ojs.2023.135035.

A. Vadivel, S. Veeramani, and C. Raghutla, “Exchange rate (USD/INR) pass‐through and wholesale price index: A flexible least square approach,” J Public Aff, vol. 20, no. 3, Aug. 2020, doi: 10.1002/pa.2087.

P. Hasanaj and B. Kuqi, “Analysis of Financial Statements,” Humanities and Social Science Research, vol. 2, no. 2, p. p17, Jun. 2019, doi: 10.30560/hssr.v2n2p17.

D. Hopp and A. Statistician, “Performance of LSTM Neural Networks in Nowcasting during the COVID-19 Crisis,” 2021. [Online]. Available: https://github.com/dhopp1/NowcastLSTM.jl

L. Setiyani and W. H. Utomo, “Arabica Coffee Price Prediction Using the Long Short Term Memory Network (LSTM) Algorithm,” Scientific Journal of Informatics, vol. 10, no. 3, 2023, doi: 10.15294/sji.v10i3.44162.

B. A. Ardhani, N. Chamidah, and T. Saifudin, “Sentiment Analysis Towards Kartu Prakerja Using Text Mining with Support Vector Machine and Radial Basis Function Kernel,” Journal of Information Systems Engineering and Business Intelligence, vol. 7, no. 2, p. 119, Oct. 2021, doi: 10.20473/jisebi.7.2.119-128.

E. M. C. Wattimena, A. Annisa, and I. S. Sitanggang, “CO and PM10 Prediction Model based on Air Quality Index Considering Meteorological Factors in DKI Jakarta using LSTM,” Scientific Journal of Informatics, vol. 9, no. 2, pp. 123–132, Oct. 2022, doi: 10.15294/sji.v9i2.33791.

W. Sholihah and A. Silvia Handayani, “Revolutionizing Healthcare: Comprehensive Evaluation and Optimization of SVM Kernels for Precise General Health Diagnosis,” Scientific Journal of Informatics, vol. 10, no. 4, p. 445, 2023, doi: 10.15294/sji.v10i4.46430.

A. Fahmi Limas, R. Rosnelly, and A. Nursie, “A Comparative Analysis on the Evaluation of KNN and SVM Algorithms in the Classification of Diabetes,” Scientific Journal of Informatics, vol. 10, no. 3, p. 251, 2023, doi: 10.15294/sji.v10i3.44269.

T. Soni Madhulatha and M. Atheeq, “Foreign Exchange Rates Prediction for Time-series Data using Advanced Q-sensing Model ⋆,” 2022. [Online]. Available: http://ceur-ws.org

T. E. Putri, A. A. Firdaus, and W. I. Sabilla, “Short-Term Forecasting of Electricity Consumption Revenue on Java-Bali Electricity System using Jordan Recurrent Neural Network,” Journal of Information Systems Engineering and Business Intelligence, vol. 4, no. 2, p. 96, Oct. 2018, doi: 10.20473/jisebi.4.2.96-105.

A. Biswas and Md. S. Islam, “A Hybrid Deep CNN-SVM Approach for Brain Tumor Classification,” Journal of Information Systems Engineering and Business Intelligence, vol. 9, no. 1, pp. 1–15, Apr. 2023, doi: 10.20473/jisebi.9.1.1-15.

D. S. K. Karunasingha, “Root mean square error or mean absolute error? Use their ratio as well,” Inf Sci (N Y), vol. 585, pp. 609–629, Mar. 2022, doi: 10.1016/j.ins.2021.11.036.

D. Chicco, M. J. Warrens, and G. Jurman, “The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation,” PeerJ Comput Sci, vol. 7, p. e623, Jul. 2021, doi: 10.7717/peerj-cs.623.

A. G. Priya Varshini, K. Anitha Kumari, D. Janani, and S. Soundariya, “Comparative analysis of Machine learning and Deep learning algorithms for Software Effort Estimation,” J Phys Conf Ser, vol. 1767, no. 1, p. 012019, Feb. 2021, doi: 10.1088/1742-6596/1767/1/012019.

A. Biswas and M. S. Islam, “A Hybrid Deep CNN-SVM Approach for Brain Tumor Classification,” Journal of Information Systems Engineering and Business Intelligence, vol. 9, no. 1, Apr. 2023, doi: 10.20473/jisebi.9.1.1-15.

T. E. Putri, A. A. Firdaus, and W. I. Sabilla, “Short-Term Forecasting of Electricity Consumption Revenue on Java-Bali Electricity System using Jordan Recurrent Neural Network,” Journal of Information Systems Engineering and Business Intelligence, vol. 4, no. 2, p. 96, Oct. 2018, doi: 10.20473/jisebi.4.2.96-105.

E. Rainarli and A. Romadhan, “Perbandingan Simple Logistic Classifier dengan Support Vector Machine dalam Memprediksi Kemenangan Atlet,” Journal of Information Systems Engineering and Business Intelligence, vol. 3, no. 2, p. 87, Oct. 2017, doi: 10.20473/jisebi.3.2.87-91.

G. James, D. Witten, T. Hastie, and R. Tibshiran, An Introduction to Statistical Learning with Application R, vol. 103. New York: Springer, 2013.

J. Brownlee, Better Deep Learning: Train Faster, Reduce Overfitting, and Make Better Predictions. San Fransisco: machinelearningmastery.com, 2018.

M. Abadi et al., “TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems,” in OSDI’16: Proceedings of the 12th USENIX conference on Operating Systems Design and Implementation, Mar. 2016. [Online]. Available: http://arxiv.org/abs/1603.04467

A. Gulli and S. Pal, Deep Learning with Keras. Packt Publishing, 2017.

F. Pedregosa et al., “Scikit-learn: Machine Learning in Python,” Journal of Machine Learning Research, vol. 12, Jan. 2012, [Online]. Available: http://arxiv.org/abs/1201.0490

L. Buitinck et al., “API design for machine learning software: experiences from the scikit-learn project,” in European Conference on Machine Learning and Principles and Practices of Knowledge Discovery in Databases, Sep. 2013. [Online]. Available: http://arxiv.org/abs/1309.0238

D. S. K. Karunasingha, “Root mean square error or mean absolute error? Use their ratio as well,” Inf Sci (N Y), vol. 585, pp. 609–629, Mar. 2022, doi: 10.1016/j.ins.2021.11.036.

D. Chicco, M. J. Warrens, and G. Jurman, “The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation,” PeerJ Comput Sci, vol. 7, p. e623, Jul. 2021, doi: 10.7717/peerj-cs.623.

A. G. Priya Varshini, K. Anitha Kumari, D. Janani, and S. Soundariya, “Comparative analysis of Machine learning and Deep learning algorithms for Software Effort Estimation,” J Phys Conf Ser, vol. 1767, no. 1, p. 012019, Feb. 2021, doi: 10.1088/1742-6596/1767/1/012019.

Refbacks

  • There are currently no refbacks.




Scientific Journal of Informatics (SJI)
p-ISSN 2407-7658 | e-ISSN 2460-0040
Published By Department of Computer Science Universitas Negeri Semarang
Website: https://journal.unnes.ac.id/nju/index.php/sji
Email: [email protected]

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.