Application of Levenberg-Marquardt Optimization Algorithm Based Multilayer Neural Networks for Hydrological Time Series Modeling
DOI:
https://doi.org/10.11121/ijocta.01.2011.0038Keywords:
Levenberg-Marquardt optimization algorithm, Artificial neural networks, Hydrological time series modelingAbstract
It is very important to make hydrological time series modeling on water resource engineering and the decision making strategies of water resource management. In this paper, a comprehensive study on the application of Levenberg-Marquardt optimization algorithms based Multilayer Neural Networks in the monthly inflows of Demirkopru Dam, which is located in the Gediz Basin/Turkey, is presented. The best network structure which requires monthly areal precipitation, temperature and one month ahead areal precipitation values as the input data, is trained by using the 30 years monthly time series. The network was trained by the observed data set between 1977 and 1996, then tested by the data set observed between 1997 and 2006. The training and testing criteria which are selected as coefficient of determination (R2) and root-mean square error (RMSE) were calculated in the training period as 79.17 (%) and 31.95 (106 m3), respectively. These values are calculated in the testing period as 75.34 (%) and 34.37 (106 m3), respectively. Long term and seasonal term statistics show that the developed network simulates the inflows of Demirköprü Dam satisfactorily and the results represent that model can be used to estimate the monthly inflows. This was also proved with this study that Levenberg-Marquardt algorithm is the one of the fastest multilayer neural network training approaches and also a black box technique which is capable of reservoir inflow modeling without the detailing of the physical process.
Downloads
References
Abbott, M.B. and Refsgaard, J.C. Distributed Hydrological Modeling. Kluver Academic Publishers, Dordrecht. 17-39 (1996). CrossRef
Spolia, S.K., and Chander, S. Modeling of surface runoff systems by an ARMA model. Journal of Hydrology, 22, 317-332 (1974). CrossRef
Sim C. H. A Mixed Gamma ARMA(1,1) Model for River Flow Time Series. Water Resources Research, 23(1), 32-36 (1987). CrossRef
Fernandez B., and Salas J.D. Gamma Autoregressive Models for Stream- Flow Simulation. Journal of Hydrologic Engineering, 116 (11), 1403-1414 (1990). CrossRef
Cigizoglu, K., and Bayazit, M. Application of Gamma Autoregressive Model to Analysis of Dry Periods. Journal of Hydrologic Engineering, 3(3), 218-221 (1998). CrossRef
Yurekli, K., and Ozturk, F. Stochastic Modeling of Annual Maximum and Minimum Streamflow of Kelkit Stream, Water International, 28, 433-441 (2003). CrossRef
Yurekli, K., Kurunc, A., and Ozturk, F. Application of Linear Stochastic Models to Monthly Flow Data of Kelkit Stream, Ecological Modeling, 183, 67-75 (2005a). CrossRef
Yurekli, K., Kurunc, A., and Ozturk, F. Testing The Residuals of an ARIMA Model on The Cekerek Stream Watershed in Turkey, Turkish Journal of Engineering and Environmental Sciences, 29, 61-74 (2005b).
Kurunc, A., Yurekli, K., and Cevik, O. Performance of Two Stochastic Approaches for Forecasting Water Quality and Streamflow Data from Yeşilιrmak River, Turkey, Environmental Modeling & Software, 20, 1195-1200 (2005). CrossRef
Raman, H. and Sunilkumar, N., Multivariate modeling of water resources time series using artificial neural networks, Hydrological Sciences Journal, 40, 2, 145-163 (1995). CrossRef
Hsu, K., Gupta, H.V. and Sorooshian, S., Artificial neural network modelling of the rainfall runoff process, Water Res. Research, 31, 2517-2530 (1995). CrossRef
Minns, A.W. and Hall, M.J., Artificial neural networks as rainfall runoff models Hydrological Sciences Journal, 41, 3, 399-417 (1996). CrossRef
Tokar, A.S. and Johnson, P.A., Rainfall runoff modeling using artificial neural networks, Journal of Hydrologic Engineering, 4, 3, 232-239 (1999). CrossRef
Cigizoglu, H.K., Incorporation of ARMA models into flow forecasting by artificial neural networks, Environmetrics, 14, 4, 417-427 (2003). CrossRef
Kisi, O., Daily river flow forecasting using artificial neural networks and auto-regressive models. Turkish Journal of Engineering and Environmental Sciences, 29, 9–20 (2005).
Campolo, M., Andreussi, P. ve Soldati, A., River flood forecasting with a neural network model, Water Resources Research, 35, 1191-1197 (1999). CrossRef
Méndez, M. C., Manteiga, W.G., Bande, M.F. Sánchez J.M.P. and Calderón R.L., Modeling of the monthly and daily behavior of the runoff of the Xallas river using Box–Jenkins and neural networks methods. Journal of Hydrology, 296, 38-58 (2004). CrossRef
Okkan, U., Mollamahmutoğlu, A. Çoruh Nehri günlük akımlarının yapay sinir ağları ile tahmin edilmesi, Süleyman Demirel Üniversitesi Fen Bilimleri Enstitüsü Dergisi, 14, 3, 251-261 (2010a).
Cigizoglu H.K., Application of the Generalized Regression Neural Networks to Intermittent Flow Forecasting and Estimation. Journal of Hydrologic Engineering, 10(4), 336-341 (2005a). CrossRef
Cigizoglu H.K., Generalized regression neural networks in monthly flow forecasting. Civil Engineering and Environmental Systems. 22 (2), 71-84 (2005b). CrossRef
Fernando, D.A.K., and Jayawardena, A.W., Runoff forecasting using RBF networks with OLS algorithm, Journal of Hydrologic Engineering 3, 3, 203-209 (1998). CrossRef
Lin, G., and Chen, L., A non-linear rainfall-runoff model using radial basis function network, Journal of Hydrology, 289, 1-8 (2004). CrossRef
Okkan, U., Serbeş Z.A., Radyal tabanlı yapay sinir ağları yaklaşımı ile günlük akımların modellenmesi, İnşaat Mühendisleri Odası İzmir Şube Bülteni, 155, 26-29 (2010).
Haykin, S. Neural Networks: A Comprehensive Foundation. MacMillan. New York (1994).
Skapura, D. M. Building Neural Networks, Addison-Wesley, New York (1996).
Ham, F., and Kostanic, I., Principles of Neurocomputing for Science and Engineering. Macgraw-Hill. USA (2001).
Kisi, O., Multi-layer perceptrons with Levenberg–Marquardt training algorithm for suspended sediment concentration prediction and estimation. Hydrological Sciences Journal 49 (6), 1025–1040 (2004). CrossRef
Cigizoglu, H.K., and Kisi, O., Flow prediction by three back propagation techniques using k-fold partitioning of neural network training data. Nordic Hydrology 36 (1), 49–64 (2005).
Okkan, U., Mollamahmutoğlu, A. Yiğitler Çayı günlük akımlarının yapay sinir ağları ve regresyon analizi ile modellenmesi, Dumlupınar Üniversitesi Fen Bilimleri Enstitüsü Dergisi, 23, 33-48 (2010b).
Hagan, M.T., and Menhaj, M.B., Training feed forward techniques with the Marquardt algorithm. IEEE Transactions on Neural Networks 5 (6), 989–993 (1994). CrossRef
Marquardt, D., An algorithm for least squares estimation of non-linear parameters. Journal of the Society for Industrial and Applied Mathematics 11 (2), 431–441 (1963). CrossRef
Hagan, M.T., Demuth, H.P., and Beale, M., Neural Network Design. PWS Publishing, Boston (1996).
Downloads
Published
How to Cite
Issue
Section
License
Articles published in IJOCTA are made freely available online immediately upon publication, without subscription barriers to access. All articles published in this journal are licensed under the Creative Commons Attribution 4.0 International License (click here to read the full-text legal code). This broad license was developed to facilitate open access to, and free use of, original works of all types. Applying this standard license to your work will ensure your right to make your work freely and openly available.
Under the Creative Commons Attribution 4.0 International License, authors retain ownership of the copyright for their article, but authors allow anyone to download, reuse, reprint, modify, distribute, and/or copy articles in IJOCTA, so long as the original authors and source are credited.
The readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material
- for any purpose, even commercially.
- The licensor cannot revoke these freedoms as long as you follow the license terms.
under the following terms:
- Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
This work is licensed under a Creative Commons Attribution 4.0 International License.
