Sign inSubmit
Tips: “quotes” for a phrase · author:Lee · a DOI goes straight to its article

18 results for “Transformer Language Model”
Set a search alert
Research ArticleOpen accessIn the abstractScalable and Advanced Framework for Hate Speech Detection on Social Media Using BERT and GPT-2 through Encoder and Decoder ArchitecturesUsman, Nabeela Hasan, Syed Mohammad Khurshid QuadriHate speech is a major problem on social media platforms. Every day, numerous instances of hateful behavior based on race, ethnicity, religion, or gender are witnessed on social media. Most of the leading social media platforms like Instagram, Facebook, Twitter Reddit, etc., have strong community guidelines that condemn and restrict the exchange of hateful language/content in any form. Despite the … …Journal of Computer Science, Vol. 21, Issue 3 · 7 Feb 2025 · 7,325 accessesView PDFCite
Research ArticleOpen accessIn the abstractLeveraging Transformer Model for Data-Driven Requirement Engineering: A Case Study of NLP4RE E-Commerce Business Apps in Malaysia and IndonesiaDevi Yurisca Bernanda, Dayang Norhayati Abang Jawawi, Shahliza Abd Halim et al.Data-Driven Requirement Engineering (DDRE) marks a departure from conventional methods, embracing dynamic, user-centric strategies with the help of machine learning and artificial intelligence. As software systems grow more intricate and demand adaptability, a continuous software engineering approach becomes crucial. However, this shift poses challenges in handling data inconsistencies during the elicitation process, leading to software development shortcomings. This study tackles … …Journal of Computer Science, Vol. 20, Issue 11 · 2 Oct 2024 · 5,131 accessesView PDFCite
Research ArticleOpen accessIn the abstractTopic-Transformer for Document-Level Language UnderstandingOumaima Hourrane, El Habib BenlahmarAs long as natural language processing applications are considered prediction problems with insufficient context, usually referred to as a single sentence or paragraph, this does not reveal how humans perceive natural language. When reading a text, humans are sensitive to much more context, such as the rest or other relevant documents. This study focuses on simultaneously capturing syntax and global … …Journal of Computer Science, Vol. 18, Issue 1 · 22 Jan 2022 · 6,616 accessesView PDFCite
Research ArticleOpen accessIn the abstractBangla↔English Machine Translation Using Attention-based Multi-Headed Transformer ModelArgha Chandra Dhar, Arna Roy, M. A. H. Akhand et al.Machine Translation (MT) refers to translate texts or documents from the source language into the target language without human intervention. Any MT model is language-dependent and its development requires grammar, phrase rules, vocabulary, or relevant data for the particular language pair. Hitherto, little research on MT for Bangla-English is reported in the literature, although Bangla is a major language. This … …Journal of Computer Science, Vol. 17, Issue 10 · 10 Nov 2021 · 8,469 accessesView PDFCite
Research ArticleOpen accessIn the abstractSQL Generation from Natural Language: A Sequence-to-Sequence Model Powered by the Transformers Architecture and Association RulesYoussef Mellah, Abdelkader Rhouati, El Hassane Ettifouri et al.Using Natural Language (NL) to interacting with relational databases allows users from any background to easily query and analyze large amounts of data. This requires a system that understands user questions and automatically converts them into structured query language such as SQL. The best performing Text-to-SQL systems use supervised learning (usually formulated as a classification problem) by approaching this task … …Journal of Computer Science, Vol. 17, Issue 5 · 23 May 2021 · 10,027 accessesView PDFCite
Research ArticleOpen accessAll words, across the recordEnhancing Indian Language Speech Recognition Systems with Language-Independent Phonetic Script: An Experimental ExplorationJose Stephan, Muthayyan Kamalam JayakumarIndia has a distinct linguistic profile that makes it extremely challenging to train Automatic Speech Recognition (ASR) systems correctly because most Indian languages have limited training material and are generally low-resource in nature. However, due to their similarity in phonemes, these languages offer an opportunity to create a single speech recognition technology. This study proposes an optimized phonetic script which … …Journal of Computer Science, Vol. 21, Issue 5 · 9 May 2025 · 6,536 accessesView PDFCite
Research ArticleOpen accessAll words, across the recordImprovement of Moroccan Dialect Sentiment Analysis Using Arabic BERT-Based ModelsGhizlane Bourahouat, Manar Abourezq, Najima DaoudiThis study addresses the crucial task of sentiment analysis in natural language processing, with a particular focus on Arabic, especially dialectal Arabic, which has been relatively understudied due to inherent challenges. Our approach centers on sentiment analysis in Moroccan Arabic, leveraging BERT models that are pre-trained in the Arabic language, namely AraBERT, QARIB, ALBERT, AraELECTRA, and CAMeLBERT. These models are … …Journal of Computer Science, Vol. 20, Issue 2 · 27 Dec 2023 · 6,545 accessesView PDFCite
Research ArticleOpen accessAll words, across the recordImproving Arabic Named Entity Recognition with a Modified Transformer EncoderHamid Sadeq Mahdi Alsultani, Ahmed H. AliwyThis article investigates the use of a transformer encoder for Arabic Named Entity Recognition (NER). The classic transformer that was originally proposed for machine translation adopts the absolute sinusoidal position embedding which is aware of distance but unfortunately is not aware of the directionality. However, in the NER task, both distance and orientation are crucial. Therefore, in this study, instead … …Journal of Computer Science, Vol. 19, Issue 5 · 10 Apr 2023 · 5,330 accessesView PDFCite