pisco_log
banner

Design of AI Virtual Character Dialogue Systems for VR Interaction A Practical Exploration Based on Large Language Models

Peifeng Liu, Tuyatsetseg Badarch, Jinfeng Cai

Abstract


In the current era of deep integration between Virtual Reality (VR) and Artificial Intelligence (AI), developing a natural and
smooth virtual character dialogue system has become the key to breaking through the bottleneck of VR immersive experience. With large
language models as the core technical support, this paper conducts research on the design and practice of an AI virtual character dialogue
system, focusing on the specific needs of VR interaction scenarios. Firstly, it sorts out the VR interaction technology system, the principles
of large language models, and the core modules of AI dialogue systems to clarify the foundation for technology integration. Furthermore,
it constructs a four-layer system architecture consisting of a user interaction layer, a VR scene layer, an AI core processing layer, and a
data storage layer. Meanwhile, it designs a personalized modeling method for virtual characters from the three dimensions of "appearancepersonality-knowledge" and formulates an interaction logic of "multimodal input understanding-context management-intelligent response
generation". Finally, through three practical casesintelligent NPCs in the gaming field, immersive history teaching in the education field,
and virtual patient training in the medical fieldthe paper verifies the system's effectiveness in improving interaction naturalness and
functional adaptability.

Keywords


Virtual Reality; Large Language Models; Virtual Characters; Dialogue Systems; Immersive Interaction

Full Text:

PDF

Included Database


References


[1] Joshi A, Dabre R, Kanojia D, et al. Natural Language Processing for Dialects of a Language: A Survey[J]. ACM Computing Surveys,

2025, 57(6).

[2] Panagoulias D P, Virvou M, Tsihrintzis G A. Augmenting Large Language Models with Rules for Enhanced Domain-Specific Interactions: The Case of Medical Diagnosis[J]. Electronics, 2024, 13(2):26.

[3] Kundu R K, Hoque K A. RelaxVR: Cybersickness Reduction in Immersive Virtual Reality Through Explainable AI and Large Language

Models[J]. IEEE Access, 2025:13.

[4] Castagna F, Mcburney P, Parsons S. ExplanationQuestionResponse dialogue: An argumentative tool for explainable AI[J]. Argument

& Computation, 2025, 16(2):133150.

[5] Litvin A, Kaverinsky V, Simonov D. The Use of Large Language Models in Combination with the Ontological Approach for the Synthesis of Natural Language Text[J]. Artificial Intelligence, 2024, 29(AI.2024.29(4)):89-95.




DOI: http://dx.doi.org/10.70711/frim.v4i1.8572

Refbacks

  • There are currently no refbacks.