万彩网·首页欢迎您

pisco_log

Open Journal Systems

User

Language

Journal Content

Font Size

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z All

Geological and Mining Engineering

Geological and Mining Engineering (GME), published by Scineer Publishing PTE. LTD, is an open-access journal. GME is devoted to publish geological and mining engineering related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on geological and mining engineering throughout the world. GME welcomes all original

ISSN: 3029-1887(P)

3029-2034(O)

View Journal Current Issue Register

Food Safety and Quality

Food Safety and Quality (FSQ), published by Scineer Publishing PTE. LTD, is an open-access journal. FSQ is devoted to publish food safety and quality related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on food safety and quality throughout the world. FSQ welcomes all original manuscripts that do not be published in any other journals.

ISSN: 3029-2115(P)

3029-2123(O)

View Journal Current Issue Register

Hydraulic Engineering and Power Research

Hydraulic Engineering and Power Research (HEPR), published by Scineer Publishing PTE. LTD, is an open-access journal. HEPR is devoted to publish hydraulic engineering and power related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on hydraulic engineering and power throughout the world. HEPR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â

Â Â Â Â ISSN: 3029-2158(P)

Â Â Â Â Â Â Â Â Â 3029-2166(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Medical and Health Research

Medical and Health Research (MHR), published by Scineer Publishing PTE. LTD, is an open-access journal. MHR is devoted to publish medicine related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on medicine throughout the world. MHR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â

Â Â Â Â ISSN: 3029-2190(P)

Â Â Â Â Â Â Â Â Â 3029-2204(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Practical Medical Research

Practical Medical Research (PMR), published by Scineer Publishing PTE. LTD, is an open-access journal. PMR is devoted to publish medicine related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on medicine throughout the world. PMR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â

Â Â Â Â ISSN: 3029-2085(P)

Â Â Â Â Â Â Â Â Â Â 3029-2093(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Forum on Research and Innovation Management

Forum on Research and Innovation Management (FRIM), published by Scineer Publishing PTE. LTD, is an open-access journal. FRIM is devoted to publish research and innovation management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on research and innovation management throughout the world. FRIM welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â

Â Â Â Â ISSN: 3029-1933(P)

Â Â Â Â Â Â Â Â Â 3029-1984(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Construction Safety Technology and Management

Construction Safety Technology and Management (CSTM), published by Scineer Publishing PTE. LTD, is an open-access journal. CSTM is devoted to publish construction safety technology and management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on construction safety technology and management throughout the world. CSTM welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â

Â Â Â Â Â ISSN: 3029-2069(P)

Â Â Â Â Â Â Â Â Â Â Â 3029-2077(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Industrial Technology Research

Industrial Technology Research (ITR), published by Scineer Publishing PTE. LTD, is an open-access journal. ITR is devoted to publish industrial technology related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on industrial technology throughout the world. ITR welcomes all original manuscripts that do not be published in any other journals.

Â Â Â Â

Â Â Â Â ISSN: 3029-1895(P)

Â Â Â Â Â Â Â Â Â Â 3029-2026(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Environmental Protection and Health

Environmental Protection and Health (EPH), published by Scineer Publishing PTE. LTD, is an open-access journal. EPH is devoted to publish environmental protection and health related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on environmental protection and health throughout the world. EPH welcomes all original manuscripts that do not be published in any other journals.Â

Â Â

Â Â Â Â ISSN: 3029-1909(P)

Â Â Â Â Â Â Â Â Â 3029-2018(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Artificial Intelligence Technology Research

Artificial Intelligence Technology Research (AITR), published by Scineer Publishing PTE. LTD, is an open-access journal. AITR is devoted to publish artificial intelligence technology related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on artificial intelligence technology throughout the world. AITR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-1968(O)

Â Â Â Â Â Â Â Â Â 3029-195X(P)
Â Â Â Â Â

Â Â

View Journal Current Issue Register

Curriculum Learning and Exploration

Curriculum Learning and Exploration (CLE), published by Scineer Publishing PTE. LTD, is an open-access journal. CLE is devoted to publish curriculum related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on curriculum throughout the world. CLE welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-1976(O)

Â Â Â Â Â Â Â Â Â 3029-1941(P)
Â Â Â Â Â Â Â

View Journal Current Issue Register

Evaluation of Educational Research

Evaluation of Educational Research (EER), published by Scineer Publishing PTE. LTD, is an open-access journal. EER is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. EER welcomes all original manuscripts that do not be published in any other journals.

Â Â Â Â ISSN: 3029-1992(O)

Â Â Â Â Â Â Â Â Â 3029-1925(P)
Â Â Â Â Â Â Â

View Journal Current Issue Register

World Education Forum

World Education Forum (WEF), published by Scineer Publishing PTE. LTD, is an open-access journal. WEF is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. WEF welcomes all original manuscripts that do not be published in any other journals.

Â Â Â Â ISSN: 3029-214X(O)

Â Â Â Â Â Â Â Â Â 3029-2131(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

New Explorations in Education and Teaching

New Explorations in Education and Teaching (NEET), published by Scineer Publishing PTE. LTD, is an open-access journal. NEET is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. NEET welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-200X(O)

Â Â Â Â Â Â Â Â Â 3029-1917(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Modern Economic Management Forum

Â

Modern Economic Management Forum (MEMF), published by Scineer Publishing PTE. LTD, is an open-access journal. MEMF is devoted to publish modern economic management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on economic management throughout the world. MEMF welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-2182(O)

Â Â Â Â Â Â Â Â Â 3029-2174(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Research and Commentary on Humanities and Arts

Research and Commentary on Humanities and ArtsÂ (RCHA), published by Scineer Publishing PTE. LTD, is an open-access journal. RCHA is devoted to publish humanities and arts related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on humanities and arts throughout the world. RCHA welcomes all original manuscripts that do not be published in any other journals.Â

Â

Â Â Â

Â Â Â Â Â Â ISSN: 3029-2050(O)

Â Â Â Â Â Â Â Â Â Â Â 3029-2042(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Scineer Publishing is a publisher of open access journals. Covering various disciplines and promoting interdisciplinary development, Scineer Publishing adheres to a principle of respecting academics, and publishes insightful and rigorous academic research contents.

12 Eu Tong Sen Street, #07-168, Singapore 059819

E-mail: scineerpub@126.com

Copyright © 2023 Scineer Publishing Pte. Ltd.

Pretraining Dataset Design for Domain-Specific Small Language Models: A Pedagogical Framework and the AI-PEAP Case Study

Yiwen Qiang, Yale Yu, Qiujun Lan, Xinjian Qiang, Jianpeng Che, Weijuan Wen

Abstract

As enterprises shift toward specialized small language models, the lack of systematic methodologies for pretraining dataset design
remains a critical bottleneck. This paper introduces a pedagogical framework for constructing high-quality pretraining datasets that enable
Domain-Specific Small Language Models (DSSLMs) to achieve professional-level competency. The methodology—comprising five phases:
domain competency mapping, curriculum design, source strategy, data creation, and expert validation—emphasizes learning efficiency over
token volume and professional judgment over general benchmarks. We validate the framework through the AI-PEAP (Professional Enterprise
Architecture Practitioner) case study, demonstrating that a 3B-parameter SLM pretrained on only 8B pedagogically designed tokens (ρ≈2.7)
achieves architecture review competency scores of 4.3/5.0—70% fewer tokens than Chinchilla-optimal scaling would suggest. The framework
reduces pretraining costs by 49% while improving professional alignment. We further analyze its domain-agnostic applicability to medicine,
law, and education, establishing "pedagogical data design" as a critical discipline for building expert-grade, efficient SLMs.

Keywords

Small Language Models; Domain-Specific AI; Pretraining Dataset Design; Pedagogical Framework; Enterprise Architecture; Pro fessional AI; Data Efficiency;AI Pedagogy

Full Text:

PDF

Included Database

References

[1] Brown T, Mann B, Ryder N, et al. Language Models are Few-Shot Learners.Advances in Neural Information Processing Systems, 2020,

33: 1877-1901.

[2] Touvron H, Lavril T, Izacard G, et al. Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv preprint arXiv:2307.09288, 2023.

[3] Patterson D, Gonzalez J, Le Q, et al. The MLPerf Training Benchmark. Computer, 2022, 55(7): 18-28.

[4] Yu Y. Research on XXX. 8th International Conference on Natural Language Processing (ICNLP 2026), Xi’an, China, 2026.

[5] Abdin M, Zoph B, Tan M, et al. Gemini:A Family of Highly Capable Multimodal Models. arXiv preprint arXiv:2404.14219, 2024.

[6] Jiang A Q, Sablayrolles A, Mensch A, et al. Mistral 7B. arXiv preprint arXiv:2310.06825, 2023.

[7] Ji Z, Li X, Zou Y, et al. Survey of Hallucination in Natural Language Generation.ACM Computing Surveys, 2023, 55(12): 1-38.

[8] Yu Y.AI-PEAP SLM Product Development Plan (Version 1.3). 2026.

[9] Hoffmann J, Borgeaud S, Mensch A, et al. Training Compute-Optimal Large Language Models. arXiv preprint arXiv:2203.15556, 2022.

[10] Kaplan J, McCandlish S, Henighan T, et al. Scaling Laws for Neural Language Models. arXiv preprint arXiv:2001.08361, 2020.

[11] Sharma U, Kaplan J. The Neural Data Hypothesis:A Unifying View of Systematic Generalization in Humans and Machines. Journal of

Machine Learning Research, 2022, 23: 1-34.

[12] Zhang P, Li L,Wang H, et al. Overview of Large Model Alignment Techniques. arXiv preprint arXiv:2401.02385, 2024.

[13] Wu S,Weber J,Nevard G, et al.MMMLU:Measuring Massive Multitask Language Understanding. arXiv preprint arXiv:2303.17564,2023.

[14] Pan S J,Yang Q.A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(10): 1345-1359.

[15] Hu E J, Shen Y,Wallis P, et al. LoRA: Low-Rank Adaptation of Large Language Models. arXiv preprint arXiv:2106.09685, 2021.

[16] Shortliffe E H. Computer-Based Medical Consultations: MYCIN.New York: Elsevier, 1976.

[17] Esteva A, Robicquet A, Ramsundar B, et al.A Guide to Deep Learning in Healthcare.Nature Medicine, 2019, 25(1): 24-29.

[18] Aletras N, Tsarapatsanis D, Preoţiuc-Pietro D, et al. Evaluating the State-of-the-Art in Automatic Text Simplification. PeerJ Computer

Science, 2016, 2: e93 .

[19] Koedinger K R,Anderson J R, Hadley W H, et al. Intelligent Tutoring Goes to School in the Big City. International Journal of Artificial

Intelligence in Education, 1997, 8: 30-43.

[20] The Open Group. TOGAF Standard,Version 9.2.Van Haren Publishing, 2018.

DOI: http://dx.doi.org/10.70711/aitr.v3i9.9017

Refbacks

There are currently no refbacks.

Scineer Publishing is a publisher of open access journals. Covering various disciplines and promoting interdisciplinary development, Scineer Publishing adheres to a principle of respecting academics, and publishes insightful and rigorous academic research contents.

12 Eu Tong Sen Street, #07-168, Singapore 059819

E-mail: scineerpub@126.com

Copyright © 2023 Scineer Publishing Pte. Ltd.