Issue

Vol. 9, No. 1, February 2024

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

Mental Health Prediction Model on Social Media Data Using CNN-BiLSTM

https://doi.org/10.22219/kinetik.v9i1.1849
Abdurrahim
Universitas Islam Indonesia
Dhomas Hatta Fudholi
Universitas Islam Indonesia

Corresponding Author(s) : Dhomas Hatta Fudholi

hatta.fudholi@uii.ac.id

Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, Vol. 9, No. 1, February 2024

Abstract

Social media has transformed into a global platform for expression and interaction where users can share photos, images, and videos. The rapid development and widespread use of social media afford the opportunity to analyze the construction of social life in societies and communities. As a result of alterations in lifestyle during the COVID-19 pandemic, mental health disorders increased. Mental health is a complex disease involving numerous individual, socioeconomic, and clinical variables. Natural language processing and analysis methods are required to address this complexity. The classification of mental health-related texts, which can serve as early warnings and early diagnoses, is facilitated by analytical and natural language processing techniques. In this investigation, a CNN-BiLSTM model was utilized, which was aided by a FastText-based word weighting method. The utilized data set consists of texts on mental health with labels such as borderline personality disorder (BPD), anxiety, depression, bipolar, mentalillness, schizophrenia, and poison. There are 35000 training records and 6108 test records. The data will undergo a data cleansing procedure, which will include lower text stages, number removal, reading mark removal, and stopword removal. Modeling with CNN-BiLSTM and FastText weighting yielded an F1-Score and accuracy of 85% and 85%, respectively. In comparison to the Bi-LSTM model, the F1-Score and accuracy were both 83%.

Keywords

Mental Health Natural Language Processing Text Analytic Classification CNN-BiLSTM
Abdurrahim, & Dhomas Hatta Fudholi. (2024). Mental Health Prediction Model on Social Media Data Using CNN-BiLSTM . Kinetik: Game Technology, Information System, Computer Network, Computing, Electronics, and Control, 9(1), 29-44. https://doi.org/10.22219/kinetik.v9i1.1849
Download Citation
Endnote/Zotero/Mendeley (RIS)
BibTeX
References
  1. J. Rehm and K. D. Shield, “Global Burden of Disease and the Impact of Mental and Addictive Disorders,” Curr. Psychiatry Rep., vol. 21, no. 2, pp. 1–7, 2019. https://doi.org/10.1007/s11920-019-0997-0
  2. Rokom, “Ministry of Health Reveals Mental Health Issues in Indonesia,” 2021.
  3. J. Singh, M. Wazid, D. P. Singh, and S. Pundir, “An embedded LSTM based scheme for depression detection and analysis,” Procedia Comput. Sci., vol. 215, pp. 166–175, 2022. https://doi.org/10.1016/j.procs.2022.12.019
  4. T. Zhang, A. M. Schoene, S. Ji, and S. Ananiadou, “Natural language processing applied to mental illness detection: a narrative review,” npj Digit. Med., vol. 5, no. 1, pp. 1–13, 2022. https://doi.org/10.1038/s41746-022-00589-7
  5. G. Gonzalez-Hernandez, A. Sarker, K. O’Connor, and G. Savova, “Capturing the Patient’s Perspective: a Review of Advances in Natural Language Processing of Health-Related Text.,” Yearb. Med. Inform., vol. 26, no. 1, pp. 214–227, Aug. 2017. https://doi.org/10.15265/iy-2017-029
  6. O. G. Iroju and J. O. Olaleke, “A Systematic Review of Natural Language Processing in Healthcare,” Int. J. Inf. Technol. Comput. Sci., vol. 7, no. 8, pp. 44–50, 2015. https://doi.org/10.5815/ijitcs.2015.08.07
  7. P. M. Nadkarni, L. Ohno-Machado, and W. W. Chapman, “Natural language processing: An introduction,” J. Am. Med. Informatics Assoc., vol. 18, no. 5, pp. 544–551, 2011. https://doi.org/10.1136/amiajnl-2011-000464
  8. J. Ive et al., “Generation and evaluation of artificial mental health records for Natural Language Processing,” npj Digit. Med., vol. 3, no. 1, pp. 1–9, 2020. https://doi.org/10.1038/s41746-020-0267-x
  9. A. S. M. Venigalla, S. Chimalakonda, and D. Vagavolu, “Mood of India during Covid-19 - An interactive web portal based on emotion analysis of twitter data,” Proc. ACM Conf. Comput. Support. Coop. Work. CSCW, pp. 65–68, 2020. https://doi.org/10.1145/3406865.3418567
  10. E. D’Avanzo, G. Pilato, and M. Lytras, “Using Twitter sentiment and emotions analysis of Google Trends for decisions making,” Program, vol. 51, no. 3, pp. 322–350, Jan. 2017. https://doi.org/10.1108/PROG-02-2016-0015
  11. G. Castillo-sánchez, M. Franco-martín, G. Marques, E. Dorronzoro, I. De Torre-díez, and M. Franco-martín, “Suicide Risk Assessment Using Machine Learning and Social Networks : a Scoping Review,” J. Med. Syst., 2020. https://doi.org/10.1007/s10916-020-01669-5
  12. M. A. Franco-Martín, J. L. Muñoz-Sánchez, B. Sainz-de-Abajo, G. Castillo-Sánchez, S. Hamrioui, and I. de la Torre-Díez, “A Systematic Literature Review of Technologies for Suicidal Behavior Prevention,” J. Med. Syst., vol. 42, no. 4, 2018. https://doi.org/10.1007/s10916-018-0926-5
  13. S. Ji, S. Pan, X. Li, E. Cambria, G. Long, and Z. Huang, “Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications,” IEEE Trans. Comput. Soc. Syst., vol. 8, no. 1, pp. 214–226, 2021. https://doi.org/10.1109/TCSS.2020.3021467
  14. F. T. Giuntini, M. T. Cazzolato, M. de J. D. dos Reis, A. T. Campbell, A. J. M. Traina, and J. Ueyama, “A review on recognizing depression in social networks: challenges and opportunities,” J. Ambient Intell. Humaniz. Comput., vol. 11, no. 11, pp. 4713–4729, 2020. https://doi.org/10.1007/s12652-020-01726-4
  15. N. Mahdy, D. A. Magdi, A. Dahroug, and M. A. Rizka, “Comparative Study: Different Techniques to Detect Depression Using Social Media,” 2020.
  16. A. Khan, M. S. Husain, and A. Khan, “Analysis of Mental State of Users Using Social Media To Predict Depression! A Survey,” Int. J. Adv. Res. Comput. Sci., vol. 9, pp. 100–106, 2018.
  17. S. Chancellor and M. De Choudhury, “Methods in predictive techniques for mental health status on social media: a critical review,” npj Digit. Med., vol. 3, no. 1, 2020. https://doi.org/10.1038/s41746-020-0233-7
  18. E. A. Ríssola, D. E. Losada, and F. Crestani, “A survey of computational methods for online mental state assessment on social media,” ACM Trans. Comput. Healthc., vol. 2, no. 2, 2021. https://doi.org/10.1145/3437259
  19. G. Coppersmith, M. Dredze, and C. Harman, “Quantifying Mental Health Signals in Twitter,” in Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, Jun. 2014, pp. 51–60. https://doi.org/10.3115/v1/W14-3207
  20. R. A. CALVO, D. N. MILNE, M. S. HUSSAIN, and H. CHRISTENSEN, “Natural language processing in mental health applications using non-clinical texts,” Nat. Lang. Eng., vol. 23, no. 5, pp. 649–685, 2017. https://doi.org/10.1017/S1351324916000383
  21. A. Murarka and I. B. M. Raleigh, “Classification of mental illnesses on social media using RoBERTa,” Proc. ofthe 12th Int. Work. Heal. Text Min. Inf. Anal., pp. 59–68, 2021.
  22. I. Ameer, M. Arif, G. Sidorov, H. Gòmez-Adorno, and A. Gelbukh, “Mental Illness Classification on Social Media Texts using Deep Learning and Transfer Learning,” 2022. https://doi.org/10.48550/arXiv.2207.01012
  23. W. Yue and L. Li, “Sentiment analysis using word2vec-cnn-bilstm classification,” 2020 7th Int. Conf. Soc. Netw. Anal. Manag. Secur. SNAMS 2020, pp. 3–7, 2020. https://doi.org/10.1109/SNAMS52053.2020.9336549
  24. M. Rhanoui and M. Mikram, “A CNN-BiLSTM Model for Document-Level Sentiment Analysis,” pp. 832–847, 2019. https://doi.org/10.3390/make1030048
  25. L. Xiaoyan, R. C. Raga, and S. Xuemei, “GloVe-CNN-BiLSTM Model for Sentiment Analysis on Text Reviews,” J. Sensors, vol. 2022, 2022. https://doi.org/10.1155/2022/7212366
  26. V. Tejaswini, K. S. Babu, and B. Sahoo, “Depression Detection from Social Media Text Analysis using Natural Language Processing Techniques and Hybrid Deep Learning Model,” ACM Trans. Asian Low-Resource Lang. Inf. Process., 2022. https://doi.org/10.1145/3569580
  27. Y. Kim, “Convolutional Neural Networks for Sentence Classification,” 2014. https://doi.org/10.48550/arXiv.1408.5882
  28. K. Dheeraj and T. Ramakrishnudu, “Negative emotions detection on online mental-health related patients texts using the deep learning with MHA-BCNN model,” Expert Syst. Appl., vol. 182, no. May, p. 115265, 2021. https://doi.org/10.1016/j.eswa.2021.115265
  29. K. Zeberga, M. Attique, B. Shah, F. Ali, Y. Z. Jembre, and T. S. Chung, “A Novel Text Mining Approach for Mental Health Prediction Using Bi-LSTM and BERT Model,” Comput. Intell. Neurosci., vol. 2022, 2022. https://doi.org/10.1155/2022/7893775
  30. M. Trotzek, S. Koitka, and C. M. Friedrich, “Utilizing Neural Networks and Linguistic Metadata for Early Detection of Depression Indications in Text Sequences,” IEEE Trans. Knowl. Data Eng., vol. 32, no. 3, pp. 588–601, 2020. https://doi.org/10.1109/TKDE.2018.2885515
  31. S. Ghosal and A. Jain, “Depression and Suicide Risk Detection on Social Media using fastText Embedding and XGBoost Classifier,” Procedia Comput. Sci., vol. 218, pp. 1631–1639, 2023. https://doi.org/10.1016/j.procs.2023.01.141
  32. G. Gkotsis et al., “Characterisation of mental health conditions in social media using Informed Deep Learning,” Sci. Rep., vol. 7, pp. 1–10, 2017. https://doi.org/10.1038/srep45141
  33. E. M. Dharma, F. L. Gaol, H. L. H. S. Warnars, and B. Soewito, “The Accuracy Comparison Among WORD2VEC, Glove, and Fasttext Towards Convolution Neural Network (CNN) Text Classification,” J. Theor. Appl. Inf. Technol., vol. 100, no. 2, pp. 349–359, 2022.
  34. M. R. Hossain, M. M. Hoque, and I. H. Sarker, “Text Classification Using Convolution Neural Networks with FastText Embedding,” Adv. Intell. Syst. Comput., vol. 1375 AIST, no. June, pp. 103–113, 2021. https://doi.org/10.1007/978-3-030-73050-5_11
  35. N. A. Hasanah, N. Suciati, and D. Purwitasari, “Identifying degree-of-concern on covid-19 topics with text classification of twitters,” Regist. J. Ilm. Teknol. Sist. Inf., vol. 7, no. 1, pp. 50–62, 2021. https://doi.org/10.26594/register.v7i1.2234
  36. T. T. Mengistie and D. Kumar, “Deep Learning Based Sentiment Analysis On COVID-19 Public Reviews,” in 2021 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), 2021, pp. 444–449. https://doi.org/10.1109/ICAIIC51459.2021.9415191
  37. G. Coppersmith, M. Dredze, C. Harman, K. Hollingshead, and M. Mitchell, “CLPsych 2015 Shared Task: Depression and PTSD on Twitter,” in 2nd Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, CLPsych 2015 - Proceedings of the Workshop, 2015, pp. 31–39. https://doi.org/10.3115/v1/W15-1204
  38. D. I. Ahmed Husseini Orabi, Prasadith Buddhitha, Mahmoud Husseini Orabi, “Deep Learning for Depression Detection of Twitter Users,” Proc. ofthe Fifth Work. Comput. Linguist. Clin. Psychol. From Keyboard to Clin., pp. 88–97. https://doi.org/10.18653/v1/W18-0609
  39. A. Benton, M. Mitchell, and D. Hovy, “Multi-Task Learning for Mental Health using Social Media Text,” 2017. https://doi.org/10.48550/arXiv.1712.03538
  40. A. Zirikly, P. Resnik, ¨ Ozlem Uzuner, and K. Hollingshead, “CLPsych 2019 Shared Task: Predicting the Degree of Suicide Risk in Reddit Posts,” Proc. Sixth Work. Comput. Linguist. Clin. Psychol., pp. 24–33, 2019. https://doi.org/10.18653/v1/W19-3003
  41. J. Kim, J. Lee, E. Park, and J. Han, “A deep learning model for detecting mental illness from user content on social media,” Sci. Rep., vol. 10, no. 1, pp. 1–6, 2020. https://doi.org/10.1038/s41598-020-68764-y
  42. M. Fekihal, J. Diederich, and A.-A. A, Machine learning, text classification and mental health. 2004.
  43. M. Amjad, N. Ashraf, A. Zhila, G. Sidorov, A. Zubiaga, and A. Gelbukh, “Threatening Language Detection and Target Identification in Urdu Tweets,” IEEE Access, vol. 9, pp. 128302–128313, 2021. https://doi.org/10.1109/ACCESS.2021.3112500
  44. M. Amjad, G. Sidorov, A. Zhila, H. Gómez-Adorno, I. Voronkov, and A. Gelbukh, “‘Bend the truth’: Benchmark dataset for fake news detection in Urdu language and its evaluation,” J. Intell. Fuzzy Syst., vol. 39, pp. 2457–2469, 2020. https://doi.org/10.3233/JIFS-179905
  45. I. Sekulic and M. Strube, “Adapting deep learning methods for mental health prediction on social media,” W-NUT@EMNLP 2019 - 5th Work. Noisy User-Generated Text, Proc., pp. 322–327, 2019. https://doi.org/10.18653/v1/D19-5542
  46. Y. Hu and M. Sokolova, “Explainable Multi-class Classification of the CAMH COVID-19 Mental Health Data,” no. December 2020, pp. 1–22, 2021. https://doi.org/10.48550/arXiv.2105.13430
  47. H. Kour and M. K. Gupta, An hybrid deep learning approach for depression prediction from user tweets using feature-rich CNN and bi-directional LSTM, vol. 81, no. 17. Multimedia Tools and Applications, 2022. https://doi.org/10.1007/s11042-022-12648-y
  48. A. Joulin, E. Grave, P. Bojanowski, and T. Mikolov, “Bag of tricks for efficient text classification,” 15th Conf. Eur. Chapter Assoc. Comput. Linguist. EACL 2017 - Proc. Conf., vol. 2, pp. 427–431, 2017. https://doi.org/10.18653/v1/e17-2068
  49. M. R. Pribadi, D. Manongga, H. D. Purnomo, I. Setyawan, and Hendry, “Sentiment Analysis of the PeduliLindungi on Google Play using the Random Forest Algorithm with SMOTE,” 2022 Int. Semin. Intell. Technol. Its Appl. Adv. Innov. Electr. Syst. Humanit. ISITIA 2022 - Proceeding, no. July, pp. 115–119, 2022. https://doi.org/10.1109/ISITIA56226.2022.9855372
  50. M. Khader, A. Awajan, and G. Al-Naymat, “The Effects of Natural Language Processing on Big Data Analysis: Sentiment Analysis Case Study,” in 2018 International Arab Conference on Information Technology (ACIT), 2018, pp. 1–7. https://doi.org/10.1109/ACIT.2018.8672697
  51. A. Squicciarini, A. Tapia, and S. Stehle, “Sentiment analysis during Hurricane Sandy in emergency response,” Int. J. Disaster Risk Reduct., vol. 21, no. December 2016, pp. 213–222, 2017. https://doi.org/10.1016/j.ijdrr.2016.12.011
  52. S. Sarica and J. Luo, “Stopwords in technical language processing,” PLoS One, vol. 16, no. 8 August, pp. 1–13, 2021. https://doi.org/10.1371/journal.pone.0254937
  53. P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov, “Enriching Word Vectors with Subword Information,” vol. 5, pp. 135–146, 2017.
  54. T. Mikolov, K. Chen, G. Corrado, and J. Dean, “Efficient estimation of word representations in vector space,” 1st Int. Conf. Learn. Represent. ICLR 2013 - Work. Track Proc., pp. 1–12, 2013.
  55. Z. Cui, R. Ke, Z. Pu, and Y. Wang, “Deep Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Prediction,” pp. 1–11, 2018. https://doi.org/10.48550/arXiv.1801.02143
  56. A. W. Bateman and R. Krawitz, “Borderline Personality Disorder: An evidence-based guide for generalist mental health professionals.” Oxford University Press, May 01, 2013. https://doi.org/10.1093/med:psych/9780199644209.001.0001
  57. B. Storer et al., “Global prevalence of anxiety in adult cardiology outpatients : A systematic review and meta-analysis The Black Dog Institute , Sydney , Australia School of Psychology , Faculty of Science , University of New South Wales , Sydney ,” Curr. Probl. Cardiol., p. 101877, 2023. https://doi.org/10.1016/j.cpcardiol.2023.101877
  58. A. H. Miller and C. L. Raison, “The role of inflammation in depression: from evolutionary imperative to modern treatment target,” Nat. Rev. Immunol., vol. 16, no. 1, pp. 22–34, 2016. https://doi.org/10.1038/nri.2015.5
  59. “Bipolar disorder,” Clin. Pediatr. (Phila). https://doi.org/10.1177/0009922808316663
  60. 65 World Health Assembly, “Global burden of mental disorders and the need for a comprehensive, coordinated response from health and social sectors at the country level: report by the Secretariat.” World Health Organization, Geneva PP - Geneva.
  61. E. Parellada and P. Gassó, “Glutamate and microglia activation as a driver of dendritic apoptosis: a core pathophysiological mechanism to understand schizophrenia.,” Transl. Psychiatry, vol. 11, no. 1, p. 271, May 2021. https://doi.org/10.1038/s41398-021-01385-9
  62. I. Calixto, V. Yaneva, and R. M. Cardoso, “Natural Language Processing for Mental Disorders: An Overview,” Nat. Lang. Process. Healthc., no. October, pp. 37–59, 2022. http://dx.doi.org/https://doi.org/10.1201/9781003138013
  63. H. Herdiansyah, R. Roestam, R. Kuhon, and A. S. Santoso, “Their post tell the truth: Detecting social media users mental health issues with sentiment analysis,” Procedia Comput. Sci., vol. 216, no. 2022, pp. 691–697, 2022. https://doi.org/10.1016/j.procs.2022.12.185
  64. M. Lyons, N. D. Aksayli, and G. Brewer, “Mental distress and language use: Linguistic analysis of discussion forum posts,” Comput. Human Behav., vol. 87, no. May, pp. 207–211, 2018. https://doi.org/10.1016/j.chb.2018.05.035
  65. H. Dyson and L. Gorvin, “How Is a Label of Borderline Personality Disorder Constructed on Twitter: A Critical Discourse Analysis,” Issues Ment. Health Nurs., vol. 38, no. 10, pp. 780–790, 2017. https://doi.org/10.1080/01612840.2017.1354105
  66. E. Kadkhoda, M. Khorasani, F. Pourgholamali, M. Kahani, and A. R. Ardani, “Bipolar disorder detection over social media,” Informatics Med. Unlocked, vol. 32, no. August, p. 101042, 2022. https://doi.org/10.1016/j.imu.2022.101042
  67. D. Levanti et al., “Depression and Anxiety on Twitter During the COVID-19 Stay-At-Home Period in 7 Major U.S. Cities,” AJPM Focus, vol. 2, no. 1, p. 100062, 2023. https://doi.org/10.1016/j.focus.2022.100062
  68. D. Zarate, M. Ball, M. Prokofieva, V. Kostakos, and V. Stavropoulos, “Identifying self-disclosed anxiety on Twitter: A natural language processing approach,” Psychiatry Res., vol. 330, p. 115579, 2023. https://doi.org/10.1016/j.psychres.2023.115579
Read More
Author biographies is not available.
Download this PDF file
PDF
Statistic
Read Counter : 30 Download : 35

Downloads

Download data is not yet available.