Papers - Cognitive Presence

Buraphadeja, V., Dawson, K. (2008). Content Analysis in Computer-Mediated Communication: Analyzing Models for Assessing Critical Thinking Through the Lens of Social Constructivism. The American Journal of Distance Education, 22(3), 1–28.

This article reviews content analysis studies aimed to assess critical thinking in computer-mediated communication. It also discusses theories and content analysis models that encourage critical thinking skills in asynchronous learning environments and reviews theories and factors that may foster critical thinking skills and new knowledge construction.

Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. Internet and Higher Education, 2(2-3), 87 - 105.

The purpose of this study is to provide conceptual order and a tool for the use of CMC and computer conferencing in supporting an educational experience. Central to the study introduced here is a model of community inquiry that constitutes three elements essential to an educational transaction - cognitive presence, social presence, and teaching presence. Indicators (key words/phrases) for each of the three elements emerged from the analysis of computer conferencing transcripts. The indicators described represent a template or tool for researchers to analyze written transcripts as well as a guide to educators for the optimal use of computer conferencing as a medium to facilitate an educational transaction. This research would suggest that computer conferencing has considerable potential to create a community of inquiry for educational purposes.

Garrison, D. R., Anderson, T., Archer, W. (2001). Critical thinking, cognitive presence, and computer conferencing in distance education. American Journal of Distance Education, 15(1).

The purpose of this paper is to describe a practical approach to judging the nature and quality of critical discourse in a computer conference. A model of a critical community of inquiry frames the research. A core concept in defining a community of inquiry is cognitive presence. In turn, the practical inquiry model operationalizes cognitive presence for the purpose of developing a tool to assess critical discourse and reflection. Encouraging empirical findings related to an attempt to create an efficient and reliable instrument to assess the nature and quality of critical discourse and thinking in a text-based educational context are presented. Finally, it is suggested that cognitive presence (i.e., critical, practical inquiry) can be created and supported in a computer conference environment with appropriate teaching and social presence.

McKlin, T., Harmon, S.W., Evans, W., Jone, MG. (2001). Cognitive Presence in Web-Based Learning: A Content Analysis of Students' Online Discussions. American Journal of Distance Education, 15(1) 7-23.

This first phase of a content analysis of online, asynchronous, educational discussions is designed to generate a method for automatically categorizing messages into cognitive categories using neural network software. This phase of research answers two questions regarding the method of automatically analyzing discussion messages: Can a neural network reliably categorize messages under optimum circumstances, and how can the method be improved to generate greater reliability? To determine whether neural network software can reliably categorize messages, two trials were conducted. The first, ?best fit? trial, a proof of concept trial comprised only of messages which best fit the categorization model, generated strong reliability figures (CR = 0.84; k = 0.76), and the second, systematic sample, a sample much more indicative of the messages generated in an online educational discussion, produced formative reliability figures (CR = 0.68; k = 0.31) from which the method of analysis may be optimized. This analysis also provides a distribution based on cognitive presence categories and subcategories of one semester of graduate online educational messages.

Rovai, A.P. (2002). Sense of community, perceived cognitive learning, and persistence in asynchronous learning networks. The Internet and Higher Education, 5(4), 319-332.

The primary purpose of this study was to determine if a relationship exists between sense of community and cognitive learning in an online educational environment. Study participants consisted of 314 students enrolled in 26 graduate education and leadership courses taught at a distance using the Blackboard.comSM e-learning system. Study results provided evidence that a significant relationship exists between classroom community and perceived cognitive learning. Online learners who have stronger sense of community and perceive greater cognitive learning should feel less isolated and have greater satisfaction with their academic programs, possibly resulting in fewer dropouts.

Meyer, K. (2003). Face-to-Face Versus Threaded Discussions: The Role of Time and Higher-Order Thinking. Journal of Asynchronous Learning Networks, 7(3), 55-65.

This study compares the experiences of students in face-to-face (in class) discussions with threaded discussions and also evaluates the threaded discussions for evidence of higher-order thinking. Students were enrolled in graduate-level classes that used both modes (face-to-face and online) for course-related discussions; their end-of-course evaluations of both experiences were grouped for analysis and themes constructed based on their comments. Themes included the quot;expansion of time," "experience of time," "quality of the discussion," "needs of the student," and "faculty expertise." While there are advantages to holding discussions in either setting, students most frequently noted that using threaded discussions increased the amount of time they spent on class objectives and that they appreciated the extra time for reflection on course issues. The face-to-face format also had value as a result of its immediacy and energy, and some students found one mode a better "fit" with their preferred learning mode. The analysis of higher-order thinking was based on a content analysis of the threaded discussions only. Each posting was coded as one of the four cognitive-processing categories described by Garrison and colleagues [1]: 18% were triggering questions, 51% were exploration, 22% were integration, and 7% resolution. A fifth category - social - was appropriate for 3% of the responses and only 12% of the postings included a writing error. This framework provides some support for the assertion that higher-order thinking can and does occur in online discussions; strategies for increasing the number of responses in the integration and resolution categories are discussed.

Garrison, D. R. (2003). Cognitive presence for effective asynchronous online learning: The role of reflective inquiry, self-direction and metacognition. In J. Bourne & J. C. Moore (Eds.), Elements of quality online education: Practice and direction. Volume 4 in the Sloan C Series, Needham, MA: The Sloan Consortium.

The purpose of this paper is to demonstrate that asynchronous online learning can create a rich cognitive presence capable of supporting effective, higher-order learning. It begins by exploring the properties of asynchronous online learning and their link with the dimensions of higher-order learning. The dimensions of higher-order learning emerge from the concepts of reflective inquiry, self-direction and metacognition. Moreover, it is argued that the dimensions of higher-order learning, reflection and collaboration, are, in fact, congruent with the asynchronous and connectivity properties of online learning. Finally, within this context, the issues and principles of effective asynchronous online learning are explored.

Kanuka, H., Garrison, D.R. (2004). Cognitive Presence in Online Learning. Journal of Computing in Higher Education, 15(2), 30-48.

The article aims to advance understanding of how to facilitate higher levels of learning when using asynchronous text-based Internet communication technology. The framework used to guide this study is based on the community of inquiry model developed by Garrison, Anderson, and Archer (2000). Crucial methodological constructs congruent with this model and higher-order learning were identified. They are discourse, collaboration, management, reflection, monitoring, and knowledge construction. Using a focus group interview, the results of this study reveal that these methodological constructs are consistent with, and supportive of, the facilitation of higher levels of learning in an asynchronous text-based Internet environment.

Meyer, K. (2004). Evaluating Online Discussions: Four Difference Frames of Analysis. Journal of Asynchronous Learning Networks, 8(2), 101-114.

This study uses four different "frames" to analyze 17 online discussions that occurred in two doctoral level classes in educational leadership. Two of the frames were developmental models: King and Kitchener's Reflective Judgment Model and Perry's model of intellectual and ethical development. Two of the frames captured levels of thinking: Garrison's four-stage critical-thinking model and Bloom's taxonomy of educational objectives. Of the 278 individual postings, 45.3% were at levels five through seven of the King and Kitchener model, 100% were at levels five through nine of the Perry model, 52.2% were at the two highest levels of the Garrison model, and 54.3% were at levels four through six in Bloom's taxonomy. These results seem appropriate to the level of response expected of doctoral students. For each frame, the analysis resulted in additional findings. The study concludes that each frame has value and focuses attention on different aspects of the student's thinking as evidenced in his/her posting to an online discussion; however, some frames are more difficult to use than others, which argues for specific training and/or tailoring the topic of discussions to address issues in a particular manner. Lastly, the question initiating each of the online discussions influenced the level of the responses from students. Each frame has the potential to illumine students' online discussions, although using multiple frames may have more benefit than using any one frame exclusively.

Murphy, E. (2004). Identifying and Measuring Ill-Structured Problem Formulation and Resolution in Online Asynchronous Discussions. Canadian Journal of Learning and Technology, 30(1).

This paper reports on a study involving the development and application of an instrument to identify and measure ill-structured problem formulation and resolution (PFR) in online asynchronous discussions (OADs). The instrument was developed by first determining PFR processes relevant to ill-structured problems in professional practice. The processes were derived from a conceptual framework. Further refinement of the instrument was achieved by the addition of indicators of processes. These indicators are derived through application of the instrument to an actual discussion in which the processes are operationalized. Results of the application of the instrument indicated that participants engaged more in problem resolution than in problem formulation. The instrument can be further developed and refined through its application in other contexts by researchers or practitioners interested in the design and use of OADs.

Garrison, D. R. & Cleveland-Innes, M. (2005). Facilitating Cognitive Presence in Online Learning: Interaction Is Not Enough. American Journal of Distance Education, 19(3), pp. 133-148.

This paper reports on a study that assessed the depth of learning in an online learning environment. The focus was on the nature of online interaction in four distance education course designs. An extensive review of the literature in online interaction from the perspective of higher levels of learning is provided. The Study Process Questionnaire was used to measure the shift in students approach to learning from the beginning to the end of the courses. The results suggest that design has a significant impact on the nature of the interaction and whether students approach learning in a deep and meaningful manner. Structure and leadership were found to be crucial for online learners to take a deep and meaningful approach to learning.

Vaughan, N., & Garrison, D. R. (2005). Creating cognitive presence in a blended faculty development community. Internet and Higher Education, 8, 1-12.

The focus of this study was to understand how a blended learning approach can support the inquiry process (cognitive presence) in a faculty development context. The findings from this study indicate that there are several key differences and similarities in cognitive presence between face-to-face and online discussions. These differences and similarities are specifically related to the four phases of cognitive presence of the practical inquiry model. A comparison of the face-to-face and online discussion forums indicates that: a slightly higher percentage of triggering events occurred in the face-to-face discussions; exploration was the dominant phase in both environments; a noticeably greater percentage of comments were coded for integration in the online discussions; and the resolution/application phase was almost non-existent in both forms of discussion. The results from this study imply that an increased emphasis should be placed on teaching presence within a blended learning environment to ensure that participants achieve resolution in the inquiry cycle.

Schrire, S. (2006). Knowledge building in asynchronous discussion groups: Going beyond quantitative analysis. Computers & Education, 46(1), 49-70.

This contribution examines the methodological challenges involved in defining the collaborative knowledge- building processes occurring in asynchronous discussion and proposes an approach that could advance understanding of these processes. The written protocols that are available to the analyst provide an exact record of the instructional transactions at a given time in the online discussion. On the basis of a study of online discussion forums used in a higher education context, a model for the analysis of collaborative knowledge building in asynchronous discussion is presented. The model allows examination of the communication from the multiple perspectives of interaction, cognition and discourse analysis. The investigation was conducted using a qualitative case study approach and involved an in-depth examination of three cases. Content analysis of the discourse was done at a number of levels, focusing on the discussion forum itself, the discussion threads, the messages, and the exchanges and moves among the messages. As a result of correspondences found among the variables representing the different levels of the analysis, the most important being the relationship between type of interaction, phase of critical inquiry, and move in the exchange structure, it was possible to build a scheme for assessing knowledge building in asynchronous discussion groups. The scheme integrates the interactive, cognitive and discourse dimensions in computer- supported collaborative learning (CSCL). The study represents a merging of quantitative analysis within qualitative methodology and provides both an analytic and a holistic perspective on CSCL.

Stein, D.S., Wanstreet, C.E., Glazer, H.R., Engle, C.L., Harris, R.T., Johnston, S.M., Simons, M.R. & Trinko, L.A. (2007). Creating shared understanding through chats in a community of inquiry. The Internet and Higher Education, 10, 103 - 115.

This study investigated the process by which shared understanding develops in a chat learning space. It used a practical inquiry model to assess the development of cognitive presence. The study also explored how the pattern of conversation in synchronous discussion supports cognitive presence and how cognitive presence changes over time. Results show that there is a pattern among group members that involves reacquainting themselves through social presence and orienting themselves to the cognitive task through teaching presence. Individual meaning contributed by each member of the group through triggering events and exploratory statements is transformed as members see the text on the screen and respond to it through questioning and collective exploration. This group exploration enables the transition to shared understanding.

Kanuka, H., Liam, R. & Laflamme, E. (2007). The influence of instructional methods on the quality of online discussion. British Journal of Educational Technology, 38(2), 260 - 271.

In this case study, we examined the influence of five groups of communication activities on the quality of students' contributions to online discussion. The activities were the nominal group technique, debate, invited expert, WebQuest and reflective deliberation. Quality of discussion was operationalised as cognitive presence, a construct developed to investigate the role of critical discourse in higher, distance education contexts. Using the quantitative content analysis technique, the postings of 19 students in an undergraduate university course were assigned to one of the four categories of cognitive presence. Across the five activities, the proportion and number of contributions categorised in the highest phases of cognitive presence was low (20.21%), but was highest during the Webquest and debate activities. There are three advantageous qualities of these two activities, we argue:

  1. They were well structured.
  2. They provided clearly defined roles and responsibilities for the students.
  3. They provoked the students to explicitly confront others' opinions.


Shea, P. & Bidjeramo, T. (2008). Community of Inquiry as a theoretical framework to foster “epistemic engagement” and “cognitive presence” in online education. Unpublished manuscript.

This paper set investigates the roles of theoretical frameworks in describing, explaining, and improving online learning processes. Online education continues to expand into virtually all domains of higher education and online technologies continue to evolve. Given the challenges associated with designing online courses in these circumstances it is suggested that additional theoretical and empirical work needs to be completed. Several recent theoretical conceptions of technology mediated education were thus examined, including presentational, performance tutoring, and epistemic engagement models (Larreamendy-Joerns & Leinhardt, 2006). Additionally, the Technological Pedagogical Content Model (TPKC) was reviewed with regards to its commonalities and distinctions from these views. Limitations on this model were identified, including its emphasis on direct instruction with relatively little weight given to the role of learners in building knowledge. It was further concluded that the epistemic engagement approach, which foregrounds the role of learners as collaborative knowledge builders, is more fully articulated and extended through the Community of Inquiry Model (CoI). The CoI posits that the ability to construct knowledge in online environments is contingent on the capacity of teachers and learners to move beyond direct instruction to establish forms of "presence". In order to assess the value of this model in actual educational settings, a study of online learners was conducted to validate an instrument designed to measure teaching, social, and cognitive presence indicative of a community of learners within the CoI framework. The study of the CoI model indicated that items cohere into interpretable factors that represent the intended constructs. Further it was determined through structural equation modeling that 70% of the variation in students' levels of cognitive presence can be modeled based on their reports of their instructors' skills in fostering teaching presence and their own abilities to establish a sense of social presence. Recommendations for practice, theory and additional research are presented.