万彩网·首页欢迎您

pisco_log

Open Journal Systems

User

Language

Journal Content

Font Size

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z All

Geological and Mining Engineering

Geological and Mining Engineering (GME), published by Scineer Publishing PTE. LTD, is an open-access journal. GME is devoted to publish geological and mining engineering related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on geological and mining engineering throughout the world. GME welcomes all original

ISSN: 3029-1887(P)

3029-2034(O)

View Journal Current Issue Register

Food Safety and Quality

Food Safety and Quality (FSQ), published by Scineer Publishing PTE. LTD, is an open-access journal. FSQ is devoted to publish food safety and quality related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on food safety and quality throughout the world. FSQ welcomes all original manuscripts that do not be published in any other journals.

ISSN: 3029-2115(P)

3029-2123(O)

View Journal Current Issue Register

Hydraulic Engineering and Power Research

Hydraulic Engineering and Power Research (HEPR), published by Scineer Publishing PTE. LTD, is an open-access journal. HEPR is devoted to publish hydraulic engineering and power related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on hydraulic engineering and power throughout the world. HEPR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â

Â Â Â Â ISSN: 3029-2158(P)

Â Â Â Â Â Â Â Â Â 3029-2166(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Medical and Health Research

Medical and Health Research (MHR), published by Scineer Publishing PTE. LTD, is an open-access journal. MHR is devoted to publish medicine related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on medicine throughout the world. MHR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â

Â Â Â Â ISSN: 3029-2190(P)

Â Â Â Â Â Â Â Â Â 3029-2204(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Practical Medical Research

Practical Medical Research (PMR), published by Scineer Publishing PTE. LTD, is an open-access journal. PMR is devoted to publish medicine related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on medicine throughout the world. PMR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â

Â Â Â Â ISSN: 3029-2085(P)

Â Â Â Â Â Â Â Â Â Â 3029-2093(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Forum on Research and Innovation Management

Forum on Research and Innovation Management (FRIM), published by Scineer Publishing PTE. LTD, is an open-access journal. FRIM is devoted to publish research and innovation management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on research and innovation management throughout the world. FRIM welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â

Â Â Â Â ISSN: 3029-1933(P)

Â Â Â Â Â Â Â Â Â 3029-1984(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Construction Safety Technology and Management

Construction Safety Technology and Management (CSTM), published by Scineer Publishing PTE. LTD, is an open-access journal. CSTM is devoted to publish construction safety technology and management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on construction safety technology and management throughout the world. CSTM welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â

Â Â Â Â Â ISSN: 3029-2069(P)

Â Â Â Â Â Â Â Â Â Â Â 3029-2077(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Industrial Technology Research

Industrial Technology Research (ITR), published by Scineer Publishing PTE. LTD, is an open-access journal. ITR is devoted to publish industrial technology related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on industrial technology throughout the world. ITR welcomes all original manuscripts that do not be published in any other journals.

Â Â Â Â

Â Â Â Â ISSN: 3029-1895(P)

Â Â Â Â Â Â Â Â Â Â 3029-2026(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Environmental Protection and Health

Environmental Protection and Health (EPH), published by Scineer Publishing PTE. LTD, is an open-access journal. EPH is devoted to publish environmental protection and health related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on environmental protection and health throughout the world. EPH welcomes all original manuscripts that do not be published in any other journals.Â

Â Â

Â Â Â Â ISSN: 3029-1909(P)

Â Â Â Â Â Â Â Â Â 3029-2018(O)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Artificial Intelligence Technology Research

Artificial Intelligence Technology Research (AITR), published by Scineer Publishing PTE. LTD, is an open-access journal. AITR is devoted to publish artificial intelligence technology related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on artificial intelligence technology throughout the world. AITR welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-1968(O)

Â Â Â Â Â Â Â Â Â 3029-195X(P)
Â Â Â Â Â

Â Â

View Journal Current Issue Register

Curriculum Learning and Exploration

Curriculum Learning and Exploration (CLE), published by Scineer Publishing PTE. LTD, is an open-access journal. CLE is devoted to publish curriculum related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on curriculum throughout the world. CLE welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-1976(O)

Â Â Â Â Â Â Â Â Â 3029-1941(P)
Â Â Â Â Â Â Â

View Journal Current Issue Register

Evaluation of Educational Research

Evaluation of Educational Research (EER), published by Scineer Publishing PTE. LTD, is an open-access journal. EER is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. EER welcomes all original manuscripts that do not be published in any other journals.

Â Â Â Â ISSN: 3029-1992(O)

Â Â Â Â Â Â Â Â Â 3029-1925(P)
Â Â Â Â Â Â Â

View Journal Current Issue Register

World Education Forum

World Education Forum (WEF), published by Scineer Publishing PTE. LTD, is an open-access journal. WEF is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. WEF welcomes all original manuscripts that do not be published in any other journals.

Â Â Â Â ISSN: 3029-214X(O)

Â Â Â Â Â Â Â Â Â 3029-2131(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

New Explorations in Education and Teaching

New Explorations in Education and Teaching (NEET), published by Scineer Publishing PTE. LTD, is an open-access journal. NEET is devoted to publish education related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on education throughout the world. NEET welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-200X(O)

Â Â Â Â Â Â Â Â Â 3029-1917(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Modern Economic Management Forum

Â

Modern Economic Management Forum (MEMF), published by Scineer Publishing PTE. LTD, is an open-access journal. MEMF is devoted to publish modern economic management related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on economic management throughout the world. MEMF welcomes all original manuscripts that do not be published in any other journals.Â

Â Â Â Â ISSN: 3029-2182(O)

Â Â Â Â Â Â Â Â Â 3029-2174(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Research and Commentary on Humanities and Arts

Research and Commentary on Humanities and ArtsÂ (RCHA), published by Scineer Publishing PTE. LTD, is an open-access journal. RCHA is devoted to publish humanities and arts related articles in the form of original papers, review papers and case studies. It also provides a platform for scholars to exchange the latest information in the related fields and aim to promote the research on humanities and arts throughout the world. RCHA welcomes all original manuscripts that do not be published in any other journals.Â

Â

Â Â Â

Â Â Â Â Â Â ISSN: 3029-2050(O)

Â Â Â Â Â Â Â Â Â Â Â 3029-2042(P)

Â Â Â Â Â Â Â

View Journal Current Issue Register

Scineer Publishing is a publisher of open access journals. Covering various disciplines and promoting interdisciplinary development, Scineer Publishing adheres to a principle of respecting academics, and publishes insightful and rigorous academic research contents.

12 Eu Tong Sen Street, #07-168, Singapore 059819

E-mail: scineerpub@126.com

Copyright © 2023 Scineer Publishing Pte. Ltd.

HSM-LCR:AUnified Framework for Hierarchical Semantic Multi-Scale Memory and Long-Chain Reasoning

Fan Shi ï¼ˆBlaze Frank Stoneï¼‰

Abstract

As large language models (LLMs) make breakthroughs in long-text understanding and generation, their ability to ef-fectively utilize long contexts and perform deep reason- ing has become the next bottleneck. We propose a Hier- archical Semantic Multi-Scale Memory and Long-Chain Reasoning Framework (HSM-LCR), which integrates hi- erarchical sparse attention (HSA) with multi-level memory fusion (MMF) to enable structured long-document model- ing, dynamic memory management, and cross-scale rea- soning. Through formal equa tions and pseudo-code, we define hierarchical semantic propagation and cross-level memory recall mechanisms. Simulated experiments show that HSM-LCR significantly improves reasoning depth and long-range information retention compared with methods such as Longformer, BigBird, and LongNet.

Keywords

Long-context Language model;Hierarchical semantics;Hierarchical sparse attention;Multi-level mem- ory fusion; Chain reasoning

Full Text:

PDF

Included Database

References

Dani Aizerman, Soo Kim, and Rui Zhao. H-mem: Hier- archical memory networks for context reasoning. In AAAI Conference on Artifi

cial Intelligence, 2022. 1, 2

Rohan Anil, Yutian Bai, Xinying Chen, and et al. Longnet: Scaling transformers to 1b tokens. In Proceedings of the 40th International

Conference on Machine Learning (ICML), 2023. 1, 2

Yutian Bai, Wenhao Chen, and Xin Zhang. Memorybank: Towards efficient multi-scale context compression . arXiv preprint

arXiv:2401 .04110, 2024. 1

Iz Beltagy, Matthew E Peters, and Arman Cohan. Long- former: The long-document transformer. arXiv preprint arXiv:2004 .05150,

1, 2

Tom Brown, Benjamin Mann, Nick Ryder, and et al. Lan- guage models are few-shot learners. Advances in Neural In-formation

Processing Systems (NeurIPS), 2020. 1

Roman Bulatov, Max Ryabinin, and Artem Gusev. Hier- archical transformers are more efficient long-range models. In International

Conference on Learning Representations (ICLR), 2022. 1

Xinyu Chen, Wenhao Zhang, Yu Gu, and et al. Ruler: Eval- uating long-context language models at scale . arXiv preprint

arXiv:2308 .12288, 2023. 1, 2

Peng Liu, Zhihong Wang,Yizhu Zhao, and Yun Chen. Ring attention with blockwise learning for long-range sequence modeling. In Em

pirical Methods in Natural Language Pro- cessing (EMNLP), 2023. 1

Yifan Liu, Qi Gao, and Chen Liang. Hierarchical transform- ers for structured document understanding. Transactions of the Association

for Computational Linguistics (TACL), 2024. 1

Zhiyuan Liu, Xipeng Qiu, and Maosong Sun. Survey on long-context modeling in large language models.AI Open, 2024. 1

Bo Peng, Xinyu Han,Yuhan Shen, and et al. Memgpt: Towards llms with external memory. arXiv preprint arXiv:2310 .08560, 2023. 1

Jack W Rae, Anna Potapenko, Siddhant M Jayakumar, and Timothy P Lillicrap. Scaling memory-augmented trans- former models. In

Advances in Neural Information Process- ing Systems (NeurIPS), 2021. 1

Hugo Touvron, Thibaut Lavril, Gautier Izacard, and et al. Llama: Open and efficient foundation language models. In International Con

ference on Learning Representations (ICLR), 2023. 1

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones,Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin.At

tention is all you need.Advances in Neural Information Processing Systems (NeurIPS), 2017. 1

Lin Xu, Xi Chen, and Yichong Zhang. Hiermem: Hierarchi- cal memory for long-term context reasoning. arXiv preprint

arXiv:2312 .02088, 2023. 1

Zheng Yuan,Yibo Fang, and Xingyu Chen. Dynamic se- mantic memory routing for long-context reasoning. InACL 2024, 2024. 1

Manzil Zaheer, Guru Guruganesh,Avinava Dubey, and et al. Bigbird: Transformers for longer sequences. In Advances in Neural Infor

mation Processing Systems (NeurIPS), 2020. 1, 2

Hao Zhao, Xi Lin, and Tianqi Zhang. Multi-scale context integration for long-document transformers. IEEE Transac- tions on Neural

Networks and Learning Systems, 2024. 1

DOI: http://dx.doi.org/10.70711/aitr.v3i9.9026

Refbacks

There are currently no refbacks.

Scineer Publishing is a publisher of open access journals. Covering various disciplines and promoting interdisciplinary development, Scineer Publishing adheres to a principle of respecting academics, and publishes insightful and rigorous academic research contents.

12 Eu Tong Sen Street, #07-168, Singapore 059819

E-mail: scineerpub@126.com

Copyright © 2023 Scineer Publishing Pte. Ltd.