A Comparative Framework for Fake News Detection Using DistilBERT and Machine Learning Algorithms
DOI:
https://doi.org/10.71426/jcdt.v2.i2.pp165-171Keywords:
Fake news detection, DistilBERT, Machine learning, Natural language processing, Deep learning, Text classificationAbstract
Automated fake-news detection is increasingly required because the volume and speed of online content exceed the capacity of manual verification. This study presents a controlled comparison between three conventional machine-learning classifiers---Naive Bayes, Logistic Regression, and Random Forest---and a fine-tuned DistilBERT transformer. The conventional models were trained using TF--IDF representations, whereas DistilBERT was fine-tuned directly on tokenized text. Data derived from the LIAR and ISOT fake-news datasets were processed through a common experimental pipeline and evaluated on a held-out test split using accuracy, precision, recall, and F1-score. The reported results show accuracies of 95.67%, 97.93%, and 97.67% for Naive Bayes, Logistic Regression, and Random Forest, respectively, while DistilBERT achieved 99.00%. The trained DistilBERT model was further integrated into a Streamlit application that returns a Real/Fake prediction and an associated confidence score, with a token-level explanation view available in the interface. The study therefore provides a compact benchmark of frequency-based and contextual text representations under a common workflow and demonstrates a lightweight path from model evaluation to interactive deployment.
References
[1] Devlin J, Chang MW, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Vol. 1. 2019. p. 4171–4186. Available from: https://doi.org/10.18653/v1/N19-1423
[2] Sanh V, Debut L, Chaumond J, Wolf T. DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter. arXiv Preprint. 2019;arXiv:1910.01108. Available from: https://doi.org/10.48550/arXiv.1910.01108
[3] Wang WY. “Liar, liar pants on fire”: A new benchmark dataset for fake news detection. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Vol. 2: Short Papers. 2017. p. 422–426. Available from: https://doi.org/10.18653/v1/P17-2067
[4] Ahmed H, Traore I, Saad S. Detecting opinion spams and fake news using text classification. Security and Privacy. 2018;1(1):e9. Available from: https://doi.org/10.1002/spy2.9
[5] Conroy NK, Rubin VL, Chen Y. Automatic deception detection: Methods for finding fake news. Proceedings of the Association for Information Science and Technology. 2015;52(1):1–4. Available from: https://doi.org/10.1002/pra2.2015.145052010082
[6] Ahmad I, Yousaf M, Yousaf S, Ahmad MO. Fake news detection using machine learning ensemble methods. Complexity. 2020;2020:8885861. Available from: https://doi.org/10.1155/2020/8885861
[7] Kaliyar RK, Goswami A, Narang P. FakeBERT: Fake news detection in social media with a BERT-based deep learning approach. Multimedia Tools and Applications. 2021;80(8):11765–11788. Available from: https://doi.org/10.1007/s11042-020-10183-2
[8] Kaliyar RK, Goswami A, Narang P, Sinha S. FNDNet: A deep convolutional neural network for fake news detection. Cognitive Systems Research. 2020;61:32–44. Available from: https://doi.org/10.1016/j.cogsys.2019.12.005
[9] Kaliyar RK, Goswami A, Narang P. DeepFakE: Improving fake news detection using tensor decomposition-based deep neural network. The Journal of Supercomputing. 2021;77(2):1015–1037. Available from: https://doi.org/10.1007/s11227-020-03294-y
[10] Kaliyar RK, Goswami A, Narang P. EchoFakeD: Improving fake news detection in social media with an efficient deep neural network. Neural Computing and Applications. 2021;33(14):8597–8613. Available from: https://doi.org/10.1007/s00521-020-05611-1
[11] Ozbay FA, Alatas B. Fake news detection within online social media using supervised artificial intelligence algorithms. Physica A: Statistical Mechanics and Its Applications. 2020;540:123174. Available from: https://doi.org/10.1016/j.physa.2019.123174
[12] Nasir JA, Khan OS, Varlamis I. Fake news detection: A hybrid CNN–RNN-based deep learning approach. International Journal of Information Management Data Insights. 2021;1(1):100007. Available from: https://doi.org/10.1016/j.jjimei.2020.100007
[13] Khan JY, Khondaker MT, Afroz S, Uddin G, Iqbal A. A benchmark study of machine learning models for online fake news detection. Machine Learning with Applications. 2021;4:100032. Available from: https://doi.org/10.1016/j.mlwa.2021.100032
[14] Sahoo SR, Gupta BB. Multiple features-based approach for automatic fake news detection on social networks using deep learning. Applied Soft Computing. 2021;100:106983. Available from: https://doi.org/10.1016/j.asoc.2020.106983
[15] Meel P, Vishwakarma DK. A temporal ensembling-based semi-supervised ConvNet for the detection of fake news articles. Expert Systems with Applications. 2021;177:115002. Available from: https://doi.org/10.1016/j.eswa.2021.115002
[16] Kumari R, Ekbal A. AAMFB: Attention-based multimodal factorized bilinear pooling for multimodal fake news detection. Expert Systems with Applications. 2021;184:115412. Available from: https://doi.org/10.1016/j.eswa.2021.115412
[17] Rai N, Kumar D, Kaushik N, Raj C, Ali A. Fake news classification using transformer-based enhanced LSTM and BERT. International Journal of Cognitive Computing in Engineering. 2022;3:98–105. Available from: https://doi.org/10.1016/j.ijcce.2022.03.003
[18] Alkhodair SA, Ding SH, Fung BC, Liu J. Detecting breaking news rumors of emerging topics in social media. Information Processing & Management. 2020;57(2):102018. Available from: https://doi.org/10.1016/j.ipm.2019.02.016
[19] Zhang X, Ghorbani AA. An overview of online fake news: Characterization, detection, and discussion. Information Processing & Management. 2020;57(2):102025. Available from: https://doi.org/10.1016/j.ipm.2019.03.004
[20] Islam MR, Liu S, Wang X, Xu G. Deep learning for misinformation detection on online social networks: A survey and new perspectives. Social Network Analysis and Mining. 2020;10(1):82. Available from: https://doi.org/10.1007/s13278-020-00696-x
[21] Shishah W. JointBERT for detecting Arabic fake news. IEEE Access. 2022;10:71951–71960. Available from: https://doi.org/10.1109/ACCESS.2022.3185083
[22] Jain A, Shakya A, Khatter H, Gupta AK. A smart system for fake news detection using machine learning. In: Proceedings of the 2019 International Conference on Issues and Challenges in Intelligent Computing Techniques. Vol. 1. IEEE; 2019. p. 1–4. Available from: https://doi.org/10.1109/ICICT46931.2019.8977659
[23] Kesarwani A, Chauhan SS, Nair AR. Fake news detection on social media using K-nearest neighbor classifier. In: Proceedings of the 2020 International Conference on Advances in Computing and Communication Engineering. IEEE; 2020. p. 1–4. Available from: https://doi.org/10.1109/ICACCE49060.2020.9154997
[24] Shu K, Sliva A, Wang S, Tang J, Liu H. Fake news detection on social media: A data mining perspective. ACM SIGKDD Explorations Newsletter. 2017;19(1):22–36. Available from: https://doi.org/10.1145/3137597.3137600
[25] Zhou X, Zafarani R. A survey of fake news: Fundamental theories, detection methods, and opportunities. ACM Computing Surveys. 2020;53(5):1–40. Available from: https://doi.org/10.1145/3395046
[26] Reddy SRS, Neha Akshaya G, Lakshmi Koteswari O, Sreeja T, Edara VS. Leveraging sentiment analysis in the digital era: Uncovering insights from unstructured data for enhanced customer engagement. Journal of Modern Technology. 2025;2(1):212–219. Available from: https://doi.org/10.71426/jmt.v2.i1.pp212-219
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Abhishek Babu Kolati, Persis Voola (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors retain copyright in their published work subject to the journal's publication and licensing arrangements.
Articles published in JMT are distributed under the Creative Commons Attribution–NonCommercial 4.0 International License (CC BY-NC 4.0).
Under this license, readers may share and adapt published material for non-commercial purposes, provided that:
- Appropriate credit is given to the author or authors.
- The original publication source is acknowledged.
- A link to the applicable license is provided.
- Any modifications are clearly indicated.
Commercial reuse is not permitted under CC BY-NC 4.0 without appropriate authorization from the relevant rights holder.
License details are available at:
Creative Commons Attribution–NonCommercial 4.0 International
DOI prefix: 10.71426
