Development of Oil Production Forecasting Method based on Deep Learning
Abstract
Identification of the quick declines of the desirable production fluids and rapid increases of the undesirable fluids are the production problems of the oil wells. The main purpose of this work is to develop a method that can forecast oil production with high accuracy, using Deep neural networks based on the debt data of the wells. In this paper, a hybrid model based on a combination of the CNN (Convolutional Neural Network) and LSTM (Long Short-Term Memory) networks, called CNN-LSTM is proposed for the forecasting of oil production time series. The architecture of the proposed CNN-LSTM model is hierarchical. Here, at first the CNN layer of the model is applied to the current time window, then the relationship between the time windows is predicted by applying the LSTM. The challenges of time series prediction often come from the continuity duration of every state. In order to overcome this problem, we try to predict temporal dependency in the certain time window. This issue is solved by the application of the CNN algorithm. Evaluation efficiency of the proposed model is performed on the QRI dataset. The prediction accuracy of the method is tested by RMSLE loss function and the best results are obtained using our proposed in the testing process.References
M.M. Korjani, A.S. Popa, E. Grijalva, S.Cassidy, I. Ershaghi Reservoir characterization using fuzzy kriging and deep learning neural networks, SPE Annual Technical Conference and Exhibition, 2016, pp. 1-15.
K. Holdaway, P. Hall, J. Silva and I. Kabul, Surface reservoir characteristics from subsurface seismic images with deep learning methodologies,In proc. of the International Conference and Exhibition, pp. 239-239, 2016, https://doi.org/10.1190/ice2016-6319324.1
O. Abdel-Hamid, A.R. Mohamed, H. Jiang, G. Penn, Applying convolutional neural networks concepts to hybrid NNHMM model for speech recognition, In proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.4277-4280, 2012.
G.E. Dahl, D. Yu, L. Deng, A. Acero, Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition,IEEE Transactions on Audio, Speech, and Language Processing, vol. 20, no. 1, pp. 30-42, 2012.
M. Zeng, L.T. Nguyen, B. Yu, O.J. Mengshoel, J. Zhu, P. Wu, J.Zhang, Convolutional neural networks for human activity recognition using mobile sensors, In proc. of the IEEE 6th International Conference on Mobile Computing, Applications and Services(MobiCASE), pp. 197-205, 2014.
T.N. Sainath, O. Vinyals, A. Senior, H. Sak, Convolutional, long short-term memory, fully connected deep neural networks, In proc.of the IEEE International Conference on In Acoustics, Speech and Signal Processing (ICASSP), pp. 4580-4584, 2015.
I. Aizenberg, L. Sheremetov, L. Villa-Vargas, J. Martinez-Munoz, Multilayer Neural Network with Multi-Valued Neurons in time series forecasting of oil production, Neurocomputing, vol. 175, Part B, pp. 980-989, 2016.
N.C. Chakra, K.Y. Song, D.N. Saraf, M.M. Gupta, Production Forecasting of Petroleum Reservoir applying Higher-Order Neural Networks (HONN) with Limited Reservoir Data, International Journal of Computer Applications, vol. 72, no.2, pp. 23-35, 2013, 10.5120/12466-8834
S.M. Al-Fattah, R.A. Startzman, Predicting Natural Gas Production Using Artificial Neural Network, In proc. of the SPE Hydrocarbon Economics and Evaluation Symposium, pp. 1-11, 2001, https://doi.org/10.2118/68593-MS
H.H. Nguyen, C.W. Chan, M. Wilson, Prediction of oil well production using multi-neural networks, In proc. of the Canadian Conference on Electrical and Computer Engineering, pp. 798-802, 2002.
K. Greff, R.K. Srivastava, J. Koutné?k, B.R. Steunebrink, and JSchmidhuber, Lstm: A earch space Odyssey, IEEE transactions on neural networks and learning systems, vol. 28, no. 10, pp. 2222-2232, 2017.
D. Palaz, M. Magimai-Doss, and R. Collobert, Analysis of cnn based speech recognition system using raw speech as inputℓ1function approximation, In proc. of the Interspeech, pp. 11-15, 2015.
P. Malhotra, L. Vig, G. Shroff, P. Agarwal, Long short term memory networks for anomaly detection in time series, In proc. of the 23rd European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, pp. 89-94, 2015.
T.N. Sainath, O. Vinyals, A. Senior, H. Sak, Convolutional, long short-term memory, fully connected deep neural networks, In proc.of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4580-4584, 2015.
R.M. Alguliyev, R.M. Aliguliyev, F.J. Abdullayeva, PSO+K-means algorithm for anomaly detection in Big Data, Statistics, Optimization And Information Computing, vol. 7, pp 348C359, 2019.
L. Deng, A tutorial survey of architectures, algorithms, and applications for deep learning, APSIPA Transactions on Signal and Information Processing, vol. 3, pp. 1-29, 2014.
Y. Imamverdiyev, F. Abdullayeva, Deep Learning Method for Denial of Service Attack Detection Based on Restricted Boltzmann Machine, Big Data, vol., 6, no. 2, pp. 159C169, 2018.
P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P.A. Manzagol, Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion Journal of Machine Learning Research, vol. 11, no. Dec, pp. 3371-3408, 2010.
S., Hochreiter, J. Schmidhuber, Long short-term memory, Neural Computing, vol. 9, No. 8, pp. 1735-1780, 1997.
A. Krizhevsky, I. Sutskever, G.E. Hinton, ImageNet classification with deep convolutional neural networks, Advances in neural information processing systems, vol. 25, no. 2, pp. 1097-1105, 2012.
P.Zhong,Z.Gong, A hybrid DBN and CRF model for spectral-spatial classification of hyperspectral images, Statistics,optimization and information computing, vol. 5, pp 75C98, 2017.
L. Deng, D. Yu, Deep learning: methods and applications, Foundations and Trends in Signal Processing, vol. 7, no. 3-4, pp. 197-387,2014.
A. Fatai, L. Jane, A. Abdulazeez, Hybrid intelligent systems in petroleum reservoir characterization and modeling: the journey so far and the challenges ahead, Journal of Petroleum Exploration and Production Technology, vol. 7, no 1, pp. 251-263, 2017.
S.D. Mohaghegh, Recent Developments in Application of Artificial Intelligence in Petroleum Engineering, Journal of Petroleum Technology, vol. 57, no. 04, pp. 86-91, 2005.
X. Ma, Z. Liu, Predicting the oil production using the novel multivariate nonlinear model based on Arps decline model and kernel method, Neural Computing and Applications, vol. 29, no 2, pp. 579-591, 2018, https://doi.org/10.1007/s00521-016-2721-x
G.J. Velazquez, C.J. Quintero, E.R. Gimenez,Production monitoring using artificial intelligence,SPE Intelligent Energy International, vol. 1, pp. 80-94, 2012.
A. Graves, A.R. Mohamed, G. Hinton, Speech recognition with deep recurrent neural networks, In proc. of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 6645-6649, 2013.
L. Ding, W. Fang, H. Luo, P.E. Love, B. Zhong, X. Ouyang, A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory, Automation in construction, vol. 86, pp. 118-124, 2018.
G. Swapna, Kp. Soman, R. Vinayakumar, Automated detection of diabetes using CNN and CNN-LSTM network and heart rate signals, Procedia computer science, vol. 132, pp. 1253-1262, 2018.
S.L. Oh, E.Y. Ng, R.S. Tan, U.R. Acharya, Automated diagnosis of arrhythmia using combination of CNN and LSTM techniques with variable length heart beats, Computers in biology and medicine, 2018, In press.
Krizhevsky A., Sutskever I., Hinton G.E., Imagenet classification with deep convolutional neural networks, Proc. of the 25th International Conference on Neural Information Processing Systems, pp. 1097-1105, 2012.
F.J. Morales, D. Roggen, Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition,Sensors, pp. 115-140, 2016, https://doi.org/10.3390/s16010115
P. Filonov, A. Lavrentyev, A. Vorontsov, Multivariate industrial time series with cyber-attack simulation: fault detection using an LSTM-based predictive data model, pp. 1-8, 2016, https://arxiv.org/pdf/1612.06676.pdf
N. Srivastava, G.E. Hinton, A. Krizhevsky, I. Sutskever, R. Salakhutdinov, Dropout: a simple way to prevent neural networks from overfitting, Journal of Machine Learning Research, vol. 15, no 1, pp. 1929-1958, 2014.
J. Garcia, A. Levy, A. Tung, R.M. Yang, F.V.Kaynig, Applying Deep Learning to Petroleum Well Data, QRI project at TRiCAM,pp.1-9, https://www.academia.edu
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
