Home
Author Guide
Editor Guide
Reviewer Guide
Published Issues
Special Issue
Introduction
Special Issues List
Sections and Topics
Sections
Topics
journal menu
Aims and Scope
Editorial Board
Indexing Service
Article Processing Charge
Open Access
Copyright and Licensing
Preservation and Repository Policy
Publication Ethics
Editorial Process
Contact Us
General Information
ISSN:
1798-2340 (Online)
Frequency:
Monthly
DOI:
10.12720/jait
Indexing:
ESCI (Web of Science)
,
Scopus
,
CNKI
,
etc
.
Acceptance Rate:
19%
APC:
500 USD
Average Days to Accept:
135 days
Journal Metrics:
Impact Factor 2022: 1.0
3.1
2022
CiteScore
49th percentile
Powered by
Editor-in-Chief
Prof. Kin C. Yow
University of Regina, Saskatchewan, Canada
I'm delighted to serve as the Editor-in-Chief of
Journal of Advances in Information Technology
.
JAIT
is intended to reflect new directions of research and report latest advances in information technology. I will do my best to increase the prestige of the journal.
What's New
2024-03-28
Vol. 15, No. 3 has been published online!
2024-02-26
The papers published in Vol. 15, Nos. 1&2 have been registered with Crossref.
2024-02-26
Vol. 15, No. 2 has been published online!
Home
>
Published Issues
>
2022
>
Volume 13, No. 2, April 2022
>
JAIT 2022 Vol.13(2): 181-185
doi: 10.12720/jait.13.2.181-185
Increasing Accessibility of Language Models with Multi-stage Information Extraction
Conrad Czejdo and Sambit Bhattacharya
Dept. of Mathematics and Computer Science, Fayetteville State University, Fayetteville, United States
Abstract
—The capabilities of Language Models (LMs) have continued to increase in recent years, as have their computational requirements. Widely available APIs have also become available. These APIs present new challenges for ease of gradient based fine-tuning by users, resulting in the use models which may be larger than necessary and more expensive, therefore reducing accessibility. In this paper, we present a new methodology for increasing performance of single-shot LMs by chaining multiple smaller LMs. Additionally, as the derived representation is in plain-text it is readily human interpretable. We show that optimizing the context which leads to this derived representation results in improved performance and reduced cost.
Index Terms
—Deep Learning (DL), Natural Language Processing (NLP), Language Models (LM), one-shot learning, API
Cite: Conrad Czejdo and Sambit Bhattacharya, "Increasing Accessibility of Language Models with Multi-stage Information Extraction," Journal of Advances in Information Technology, Vol. 13, No. 2, pp. 181-185, April 2022.
Copyright © 2022 by the authors. This is an open access article distributed under the Creative Commons Attribution License (
CC BY-NC-ND 4.0
), which permits use, distribution and reproduction in any medium, provided that the article is properly cited, the use is non-commercial and no modifications or adaptations are made.
11-S1-227-US
PREVIOUS PAPER
CrowdSurge: A Crowd Density Monitoring Solution Using Smart Video Surveillance with Security Vulnerability Assessment
NEXT PAPER
Fast Data-Centric Optimization of Nonlinear Dynamic Flows on Network System Suited for Big-Data and Extreme Computing