PFed-TG: A Personalized Federated Learning Framework for Text Generation

Authors

  • Shameen Noor Department of Software Engineering, Superior University, Lahore, 54000, Pakistan.
  • Muhammad Azam Faculty of Computer Sciences and Information Technology, The Superior University, Lahore, 54000, Pakistan.
  • Fahad Sabah Faculty of Information Technology, Beijing University of Technology, Beijing, China.
  • Fawad Nasim Faculty of Computer Sciences and Information Technology, The Superior University, Lahore, 54000, Pakistan.
  • Kahkisha Ayub Department of Software Engineering, Superior University, Lahore, 54000, Pakistan.
  • Kinza Parvaiz Department of Software Engineering, Superior University, Lahore, 54000, Pakistan.

Keywords:

Federated Learning, Personalized Federated Learning, Text Generation, Privacy Preservation, Natural Language Processing, Python

Abstract

In recent years, advancements in deep learning and machine learning have spurred the development of various text generation models, particularly through Python programming. This paper introduces PFed-TG, a novel personalized federated learning (PFL) framework for text generation (PFed-TG) tasks that integrates personalized model training with federated learning principles, leveraging Python's Natural Language Processing (NLP) tools, including the Hugging Face Transformers library. The framework's efficacy is evaluated using the Shakespeare dataset, demonstrating consistent production of contextually relevant text. Performance is assessed using metrics such as ASL, ROUGE-L, BLEU, METEOR, and Perplexity, focusing on readability, coherence, and alignment. Results indicate that PFed-TG enhances efficiency and offers insights into optimizing personalized FL models for practical applications across diverse domains like healthcare, finance, and education. This research comprehensively evaluates PFed-TG's methodology, highlighting its potential to advance the field of NLP through innovative FL approaches.

Downloads

Published

2024-09-01

How to Cite

Shameen Noor, Muhammad Azam, Fahad Sabah, Fawad Nasim, Kahkisha Ayub, & Kinza Parvaiz. (2024). PFed-TG: A Personalized Federated Learning Framework for Text Generation . Journal of Computing & Biomedical Informatics, 7(02). Retrieved from https://jcbi.org/index.php/Main/article/view/601