The purpose of this study is to establish the effects of the gesture types and the facial expressions of
the pedagogical agent according to the types of learning materials in the multimedia learning environment
on the persona effect and cognitive efficiency. 3×2 factorial design was applied with pedagogical agent's
gesture types (deictic gesture, conversational gesture, no gesture) and facial expression (facial, no facial).
This study attempts to test two purposes. First, it is how much the learners perceived the pedagogical
agent as a human. For this, the persona effect questionnaire survey was conducted. Second, it is whether
the pedagogical agent's gestures and facial expressions have positive effects on the efficient cognitive process
of the learners. The results of the analysis are summarized as follows. In the text-type materials, it is
important to apply facial expressions, and in the picture-type materials, it can be said to be more effective
to apply conversational gestures rather than no gesture. The results of this study have three implications.
First, facial expressions are also important interface factors that can cause social interaction. Second,
conversational gestures can be more important than deictic gestures. Third, the pedagogical agent's effects
can vary depending on the types of the materials. Through this, it was confirmed that, when designing
the pedagogical agent, it is important to apply facial expressions and gestures appropriately, and that the
social interaction between the pedagogical agent and the learners exerts positive effects on learning.