Lauri J.
Partanen
*a,
Liisa
Myyry
b and
Henna
Asikainen
b
aSchool of Chemical Engineering, Department of Chemistry and Materials Science, Aalto University, Espoo, Finland. E-mail: lauri.partanen@aalto.fi
bFaculty of Educational Sciences, Centre for University Teaching and Learning, University of Helsinki, Helsinki, Finland
First published on 7th December 2023
We explored chemical engineering students’ approaches to learning, study-related burnout, and perceptions of peer and self-assessment in a challenging physical chemistry thermodynamics course. Cluster analysis revealed three learning profiles based on students’ approaches to learning: students who scored high in both organised studying and the deep approach to learning, students who scored high in the unreflective approach to learning, and students who scored high in all three approaches. According to our findings, students who employed deep learning strategies and managed their time carefully experience the least study-related burnout. These students also felt more efficacious when participating in assessment and had fever negative experiences of both peer and self-assessment. Consequently, physical chemistry educators should adopt practices that facilitate a deeper approach to learning, including paying careful attention to course workload and utilising teaching methodologies that can foster the deep approach like peer and self-assessment.
Apart from the abstract and mathematical nature of concepts, physical chemistry also poses challenges due to factors such as instructor-centred pedagogical approaches, excessive course content, limited resources, and waning student motivation (Sözbilir, 2004). Consequently, many students enter physical chemistry courses with negative perceptions and low expectations of success (Nicoll and Francisco 2001; Partanen, 2016). This is particularly concerning given that study-related burnout is prevalent among university students (Salmela-Aro and Read, 2017), including chemical engineers, (Gomez Jimenez et al., 2021) and that courses perceived as excessively difficult can exacerbate exhaustion (Maslach et al., 2001).
Research has shown that the way students approach learning impacts their likelihood of experiencing burnout. For example, burnout is more prevalent among students relying on the surface approach towards learning (Asikainen et al., 2022). This approach emphasises memorising and leaves students struggling with a fragmented knowledge base (Entwistle and Ramsden, 1983; Asikainen et al., 2013), putting them at risk of either changing their major or dropping out completely (Lastusaari et al., 2019). Meanwhile, students employing the deep approach focus on understanding and using meaningful learning strategies. The deep approach is connected with less study-related burnout (Asikainen et al., 2020).
In addition to students’ approaches to learning, their perceptions of the teaching–learning environment impact study-related burnout (Meriläinen, 2014; Meriläinen and Kuittinen, 2014). Indeed, recent research has connected chemical engineering students’ perceptions of peer and self-assessment in a thermodynamics course with both their learning approaches and study-related burnout (Partanen et al., 2023). In self-assessment learners are involved in judging their own learning, particularly their learning outcomes or achievements (Boud and Falchikov, 1989), whereas in peer assessment students evaluate similar status peers (Topping 1998). In the literature, peer and self-assessments have been associated with several benefits that are relevant in the physical chemistry context: on one side, peer assessment can enhance achievement, attitudes, and higher order thinking skills, such as critical thinking and problem-solving (Topping, 1998; Huisman et al., 2019; Hadzhikoleva et al., 2019), which are key competencies in physical chemistry. On the other side, self-assessment has been shown to increase metacognitive knowledge (Mok et al., 2006) and to help students take more responsibility for learning (Häsä et al., 2018). Specifically in physical chemistry, learning modules that include peer and self-assessment have been associated with enhanced learning outcomes (Partanen, 2018; Partanen, 2023) as well as improved attitudes (Partanen, 2020; Partanen, 2023).
Past studies have looked at different aspects of peer and self-assessment in the chemistry context such as its validity (Tsaparlis et al., 1999; Tashiro et al., 2021), implementation (Wenzel, 2007), and the ability to facilitate metacognition (Casselman and Atwood, 2017). Peer review has also been broadly used in the context of writing tasks, particularly laboratory reports (Margerum et al., 2007; Berry and Fawkes, 2010; Zwicky and Hands, 2016; Basso, 2020; Piccinno et al., 2023). However, there has been less research on students’ perceptions of peer and self-assessment. Even though student perceptions of the teaching–learning environment are known to be connected both to the learning approaches students employ (Richardson, 2005; Parpala et al., 2010; Herrmann et al., 2017) and the burnout they experience (Meriläinen, 2014; Meriläinen and Kuittinen, 2014), these connections have been little investigated at the course level. Thus, there is a lack of knowledge on how specific teaching practices like peer and self-assessment relate to student's approaches to learning and especially study-related burnout. In this study, we seek to understand the interplay between physical chemistry students’ learning approaches, study-related burnout and their perceptions of peer and self-assessment in the context of a thermodynamics course at Aalto university in Finland. This course is widely considered challenging, making it a potential contributor to study-related burnout.
Student's approach to learning can vary from one context to another (Richardson, 2011). Which approach is adopted is influenced by both the individual's learning orientation and their perception of task requirements. For example, when facing a heavy workload or threatening situations, individuals are more likely to adopt the unreflective approach (Tait and Entwistle, 1996; Kyndt et al., 2011). Research also indicates that the deep and organised approaches are related to positive perceptions of the teaching–learning environment, while the unreflective approach is connected to more negative ones (Richardson, 2005; Parpala et al., 2010; Kyndt et al., 2011; Herrmann et al., 2017).
One important way that a teacher can influence students’ learning approaches is through assessment (Rust et al., 2005; Struyven et al., 2005). For example, repetitive assessment methods are linked to the unreflective approach while methods that require deeper understanding, such as essays, correlate with the deep approach (Struyven et al., 2005). Likewise, assessments that measure real-life competencies seem to motivate students to adopt deep learning strategies (Gulikers et al., 2006). The interaction between the teaching–learning environment and students’ learning approaches is bidirectional: for instance, students tend to prefer examinations that align with their preferred learning approach (Struyven et al., 2005) with students applying a deep approach favouring challenging courses (Halme et al., 2021). Studies have also found that the deep and organised approaches are associated with more positive perceptions of assessment's role in supporting learning, compared to the unreflective approach (Parpala et al., 2010). However, contrary results by Gijbels et al. (2008) associate assessment that supports learning with an increase in the unreflective approach.
Research has revealed that students tend to cluster into different combinations regarding their approaches to learning. For example, Parpala et al. (2010) identified four distinct profiles among university students from various disciplines: (1) organised students, (2) students applying the deep approach, (3) students applying the unreflective approach, and (4) unorganised students applying the deep approach who scored high in the deep approach but low in organised studying. These profiles have been found in other studies as well (Salmisto et al., 2016; Haarala-Muhonen et al., 2017; Asikainen et al., 2020), while different combinations have emerged in others. For instance, a recent study by Asikainen and Katajavuori (2022) identified three profiles: (1) students employing the deep approach, (2) organised students, and (3) students embodying the unreflective approach. Meanwhile, another recent study discovered the following profiles: (1) unorganised and unreflective students, (2) deep and unorganised students, (3) students representing a deep approach, and (4) all high students (Parpala et al., 2021). The paradoxical all-high profile refers to students with dissonant or seemingly contradictory study strategies. It has been suggested that these students have not yet had sufficient time to develop a differentiated studying strategy (Freyer and Vermunt, 2018). On the other hand, Lindblom-Ylänne (2003) suggested that these students may have difficulties in changing or developing their study strategies even when they know that their current strategies are inefficacious.
There is rising concern about burnout among university students. For example, Hyytinen et al. (2022) revealed that as many as 30% of first-year students are already at-risk level for study-related burnout. Other studies have shown that while 7% of students in higher education were at severe burnout risk, 30% were classified as simultaneously engaged and exhausted (Salmela-Aro and Read, 2017). Burnout risk has also risen to a worrying level among chemical engineering students (Gomez Jimenez, et al. 2021).
Students’ approaches to learning have been linked to wellbeing, as students’ perceptions of study workload interact with their processes of understanding (Hailikari et al., 2018). Notably, a perceived heavy workload can contribute to stress and ultimately lead to symptoms of exhaustion, which are characteristic of burnout (Maslach et al., 2001). Specifically, the unreflective approach is positively associated with study-related burnout (Asikainen et al., 2020; 2022), together with perceptions of workload in studies (Kyndt et al., 2011). Different learning profiles among students appear to further influence study-related burnout: unreflective learners, who exhibit high scores in the unreflective approach and relatively low scores in the deep approach and organised studying, tend to report higher levels of exhaustion, inadequacy, and cynicism. In contrast, students employing the deep approach tend to experience lower levels of exhaustion and inadequacy compared to both organised students and unorganised students applying a deep approach (Asikainen et al., 2020). This indicates that students lacking reflection practices are more susceptible to experiencing burnout. Furthermore, students with poor time management skills tend to experience more stress, exhaustion, and less interest in their studies (Heikkilä et al., 2012).
On the negative side, students can find peer assessment intimidating or time-consuming (Hanrahan and Isaacs 2001; Sluijsmans et al., 2001; Moneypenny et al., 2018) while others express dissatisfaction with the notion of taking on the teacher's work (Van Hattum-Janssen and Lourenço 2008; Willey and Gardner 2010). Distrust towards the validity and fairness of peer assessment is also commonplace (Van Zundert et al., 2010; Kaufman and Schunn 2011; Patton 2012; Carvalho 2013; Wanner and Palmer 2018; Andersson and Weurlander 2019) as students are concerned with the competence and impartiality of their peer-assessors (Willey and Gardner 2010; Kaufman and Schunn 2011; Carvalho 2013; Mulder et al., 2014b) or their own ability to assess (Van Hattum-Janssen and Lourenço 2008). Especially when the evaluation criteria are unclear, peer and self-assessment can be frustrating and difficult (Hanrahan and Isaacs, 2001; Andrade and Du, 2007).
To date, the relationship between peer and self-assessment perceptions and wellbeing has received little research, but there are some indications of a potential connection. For one, there is the possible influence of peer support on wellbeing (John et al., 2018; Drysdale et al., 2022) suggesting that engaging in formative feedback and discussions with peers could enhance students' wellbeing. Self-assessment has also been specifically connected to self-efficacy (Panadero et al., 2017; Nieminen et al., 2021) which, in turn, is associated with wellbeing. Therefore, it can be hypothesised that self-assessment may have a positive impact on students' wellbeing. With regards to learning approaches, there is evidence that the teaching–learning environment and specifically assessment practices can impact students’ approaches to learning, as discussed before. However, few studies have looked specifically at peer or self-assessment, although there is some evidence that self-grading can promote the deep approach (Nieminen et al., 2021) and that peer assessment can promote deeper learning (Asikainen et al., 2014). There is also recent correlational evidence that feelings of self-efficacy in self-and peer assessment are related to the deep approach, while negative perceptions of peer and self-assessment correlate with the unreflective approach (Partanen et al., 2023).
(1) What learning profiles are present among chemical engineering students in a thermodynamics course?
(2) How are the learning profiles related to student experiences of peer and self-assessment and study-related burnout?
During the course, peer and self-assessment were used for six sets of course problems, and constituted approximately 10% of the overall course grade. The peer and self-assessment scheme shared communalities with the Peer assessment learning sessions proposed by O'moore and Baldock (2007): the deadlines for each problem set were communicated to the students at the beginning of the course, while the problems themselves were made available at least one week before the deadline. During the period leading up to the deadline, students had the opportunity to attend up to 3 or 4 walk-in study halls where they could collaborate with their peers to solve the problems. Teaching staff was also present in these study halls to offer assistance and guidance. Each problem set typically consisted of 2–3 problems. The problems were made of subtasks spanning the second and third knowledge categories and third through fifth cognitive processing categories of the Revised Bloom's taxonomy (Anderson and Krathwohl 2001).
The students submitted their solutions digitally through the course's online learning platform, where they also performed the peer and self-assessment. Each student was responsible for assessing their own solutions and those of two anonymous peers. To facilitate the assessment process, clear instructions, an assessment rubric, and model solutions were provided. Two sample subtasks and their assessment rubrics are provided in Appendix 1. The assessment criteria and practices were determined solely by the course instructor, without input from the students.
The peer and self-assessments included both grading and a formative component: along with assigning numerical marks, students were required to write feedback and justifications for their evaluations in an open response field. For instance, they had to explain any deductions they made based on the assessment rubric. While the presence of text in the open response fields was automatically checked, the content and quality of the student feedback were not examined.
The final mark for each student was calculated as an average of the three assessments they received. When the minimum and maximum marks differed significantly, a course instructor assessed the solutions. Students received credit based both on the quantity and quality of the numerical assessments they provided. The course instructor offered general feedback to the students, highlighting trends and observations based on the solutions submitted. While peer and self-assessment are used in certain courses at the university, they are still considered relatively novel and uncommon teaching methods.
In 2021, 139 students initially enrolled in the course. From the 127 students that did not drop out, 106 (83%) responded to the end-of-course survey. In 2020, the number of initially enrolled students was 155 of whom 149 did not drop out. From these, 124 (83%) responded to the end-of-course survey and provided research permission. In 2019, these numbers were 149, 119, and 114 (96%), respectively. Most (78%) of the participants in this study were in their second year, and half (55%) were females. The mean age was 21.6 years, with a range of 19–43 years.
Since the course instructor was part of the research team, careful steps were taken to avoid any perceptions that the students should participate in the research because of the instructor's involvement. While participants received approximately 1% of the total course marks of credit for responding to the end-of-course survey, it was emphasised that they would receive this credit irrespective of whether they provided research permission. The participants were informed that they could renege the research permission at any time with no detrimental effects on their course performance, and that the responses would have no effect on the course grade. There were also additional tasks that the students could do during to course to make up for the credits lost for declining to answer the survey.
Table 1 presents the descriptive statistics of the variables in this study for the primary 230 student sample. It also includes the correlation coefficients between the variables. Only coefficients that were statistically significant at the p < 0.05 – level are displayed. As expected, the correlations among variables within the same instrument, such as learning approaches, were generally stronger than those between variables from different instruments. Specifically, correlations above 0.45 or below −0.45 were observed between the subscales of the study-related burnout instrument, as well as between the deep and organised approaches to learning. Regarding the peer and self-assessment perception subscales, such correlations were found between the learning enhancing experiences of peer and self-assessment (PSL and SSL), the negative experiences of peer and self-assessment (PNE and SNE), the peer and self-assessment self-efficacies (PSE and SSE), peer assessment self-efficacy and learning enhancing experiences of peer assessment (PSE and PSL), and self-assessment self-efficacy and the learning enhancing experiences of self-assessment (SSE and SSL). Notably, inter-instrument correlations of this magnitude were only found between the unreflective approach to learning and the exhaustion and inadequacy aspects of study-related burnout.
Mean (sd) | U | D | O | EXH | CYN | INA | PSL | PNE | PSE | SSL | SNE | |
---|---|---|---|---|---|---|---|---|---|---|---|---|
PSL = peer assessment as supporting learning-factor, PNE = negative experiences of peer assessment-factor, PSE = self-efficacy in peer assessment-factor, SSL = self-assessment as supporting learning-factor, SNE = negative experiences of self-assessment-factor, SSE = self-efficacy in self-assessment-factor. | ||||||||||||
Unreflective (U) | 3.27 (0.77) | |||||||||||
Deep (D) | 3.21 (0.66) | −0.20 | ||||||||||
Organised (O) | 2.85 (0.81) | −0.17 | 0.46 | |||||||||
Exhaustion (EXH) | 2.92 (1.00) | 0.48 | ||||||||||
Cynicism (CYN) | 2.29 (1.09) | 0.37 | −0.29 | −0.31 | 0.45 | |||||||
Inadequacy (INA) | 3.25 (1.10) | 0.53 | −0.13 | −0.24 | 0.66 | 0.65 | ||||||
PSL | 3.08 (0.83) | 0.15 | 0.15 | |||||||||
PNE | 2.33 (0.69) | 0.22 | 0.19 | 0.21 | 0.18 | −0.32 | ||||||
PSE | 3.84 (0.73) | −0.16 | 0.19 | 0.46 | −0.44 | |||||||
SSL | 3.22 (0.76) | 0.17 | 0.17 | 0.77 | −0.28 | 0.40 | ||||||
SNE | 2.40 (0.73) | 0.32 | −0.15 | 0.18 | 0.19 | 0.21 | −0.29 | 0.63 | −0.29 | −0.33 | ||
SSE | 3.84 (0.70) | −0.23 | 0.19 | −0.15 | −0.14 | 0.44 | −0.42 | 0.75 | 0.49 | −0.41 |
For the primary research data, Table 2 presents cluster indices and the corresponding optimal number of clusters. Consistent with the findings from the test data, the 2- and 3-cluster solutions were predominant, with the 2-cluster solution receiving support from 10 indices, and the 3-cluster solution from 5. Again, solutions with a greater number of clusters were supported by fewer than 3 indices. To further assess the stability of our cluster solution we performed the clustering using 4 different distance measures besides the Euclidean and 7 different clustering methods besides k-means, resulting in 40 different method-distance measure pairs. The 2- and 3-cluster solutions were consistently favoured, with most cases preferring the 2-cluster solution.
Indexa | 2 Clusters | 3 Clusters |
---|---|---|
a See Table 1 in Charrad et al. (2014) for references of the individual indices. | ||
KL | 11.8848* | 0.1519 |
CH | 112.5318* | 107.533 |
McClain | 0.6960* | 1.1895 |
Silhouette | 0.2886* | 0.2821 |
Cindex | 0.3293 | 0.3237* |
CCC | 31.7747* | 20.7020 |
DB | 1.4234 | 1.2763* |
Ratkowsky | 0.3911* | 0.3907 |
PtBiserial | 0.3879 | 0.4304* |
Gamma | 0.4557 | 0.5524* |
SDindex | 3.6302 | 2.9521* |
Table 3 displays the cluster sizes, means and standard deviations for the different learning approaches from the primary data set. Analogous results were obtained with the test data. We see that both 2- and 3-cluster solutions have reasonable numbers of students in each cluster. The 2-cluster solution appears to contain one cluster where the students are high in both deep and organised approaches to learning and lower in the unreflective approach. In contrast, the second cluster consists of students high in the unreflective approach. The 3-cluster solution mainly splits the first of these clusters into two, resulting in a new “All high”-cluster as indicated in Table 3. Since the 3-cluster solution appears to contain more information with reasonable cluster sizes, we chose it for further analysis. Fig. 1 visualises the cluster means for the learning approaches.
High organised and deep | All high | High unreflective | |
---|---|---|---|
2-Cluster | |||
N | 110 | 120 | |
Unreflective | 2.94 (0.81) | — | 3.56 (0.59) |
Deep | 3.59 (0.51) | — | 2.86 (0.59) |
Organised | 3.45 (0.57) | — | 2.30 (0.58) |
3-Cluster | |||
N | 61 | 69 | 100 |
Unreflective | 2.33 (0.45) | 3.72 (0.48) | 3.52 (0.58) |
Deep | 3.70 (0.48) | 3.32 (0.55) | 2.84 (0.61) |
Organised | 3.26 (0.67) | 3.47 (0.47) | 2.16 (0.50) |
We further investigated the trends in means for study-related burnout using one-way ANOVAs and Dunnett's T3 post hoc tests. Table 4 displays the mean values of the three study-related burnout facets for the different clusters as well as their standard deviations. On the right, it also includes the effect sizes for the statistically significantly different means based on Dunnett's T3 post hoc test. The ANOVA resulted in a statistically significant result for all three subscales of study-related burnout. From Table 4, we observe that the differences in exhaustion are statistically significant between the “All high” and the two other groups, but are not significant between the “High organised and deep” and the “High unreflective” groups. In contrast, for both cynicism and inadequacy the differences between the “High organised and deep” and the two other groups are statistically significant. With the exemption of the medium-sized Cohen's d value of 0.49 between the “All high” and “High unreflective”-clusters, all effect sizes in Table 4 are between large and very large according to the interpretation guidelines by Sawilowsky (2009).
Mean (sd) | Effect sizebc | ||
---|---|---|---|
All high | High unreflective | ||
a The ANOVA results for the exhaustion, cynicism and inadequacy subscales were statistically significant with F(2,227) = 11.579, p < 0.001, F(2,227) = 18.581, p < 0.001, and F(2,227) = 24.113, p = 0.001, respectively. b Effect sizes for the mean difference between the two clusters indicated on the left and above. Only statistically significant effect sizes are displayed. c Dunnett's T3 post hoc test significances: p < 0.001, ***; 0.001 < p < 0.01, **; and 0.01 < p < 0.05, *. | |||
Exhaustiona | |||
High organised & deep | 2.54 (1.01) | 0.79*** | — |
All high | 3.34 (1.01) | 0.49** | |
High unreflective | 2.88 (0.88) | ||
Cynicisma | |||
High organised & deep | 1.62 (0.80) | 0.79*** | 1.04*** |
All high | 2.41 (1.16) | — | |
High unreflective | 2.61 (1.04) | ||
Inadequacya | |||
High organised & deep | 2.48 (1.10) | 0.92*** | 1.08*** |
All high | 3.46 (1.02) | — | |
High unreflective | 3.57 (0.93) |
Differences between student's peer and self-assessment perceptions are also evident in Fig. 2. Specifically, students in the “High organised and deep” cluster exhibit more or equally positive perceptions of learning and efficacy along with fewer negative experiences of both peer and self-assessment compared to the other clusters. Conversely, the “All high” and “High unreflective” groups demonstrate similar efficacy and negative perceptions of peer and self-assessment. However, when it comes to peer and self-assessment supporting learning, the “All-high” students’ scores are closer to the results of the “High organised and deep” group. This distinction together with the differences observed in Fig. 1 underscores how the three-cluster solution adds depth to the interpretation of the data. As anticipated from the correlations in Table 1, students’ perceptions of peer assessment mirror closely the ones from self-assessment.
As before, the observed differences in cluster means from Fig. 2 were further studied using ANOVA and Dunnett's T3 post hoc tests. The results are summarised in Tables 5 and 6, which display the numerical ANOVA results, the effect sizes and the significances of the post hoc tests. For peer assessment, the ANOVA revealed main effects for the self-efficacy and negative experiences subscales, while the outcome for the supporting learning subscale was nonsignificant. A similar pattern was observed for self-assessment. In both peer and self-assessment the “High organised and deep” group scored significantly lower in negative experiences and higher in self-efficacy compared to the other groups. These differences corresponded mostly to medium or large effect sizes (Sawilowsky, 2009), with larger effect sizes observed for self-assessment.
Mean (sd) | Effect sizebc | ||
---|---|---|---|
All high | High unreflective | ||
a The ANOVA results were statistically significant for the self-efficacy and negative experiences subscales, with F(2,227) = 5.751, p = 0.004 and F(2,227) = 4.726, p = 0.010, respectively, and nonsignificant for the supporting learning subscale with F(2,227) = 2.325, p = 0.100. b Effect sizes for the mean difference between the two clusters indicated on the left and above. Only statistically significant effect sizes are displayed. c Dunnett's T3 post hoc test significances: p < 0.001, ***; 0.001 < p < 0.01, **; and 0.01 < p < 0.05, *. | |||
Peer assessment as supporting learninga | |||
High organised & deep | 3.17 (0.92) | — | — |
All high | 3.20 (0.88) | — | |
High unreflective | 2.95 (0.73) | ||
Negative experiences of peer assessmenta | |||
High organised & deep | 2.11 (0.67) | 0.46* | 0.43* |
All high | 2.47 (0.85) | — | |
High unreflective | 2.36 (0.54) | ||
Self-efficacy in peer assessmenta | |||
High organised & deep | 4.10 (0.70) | 0.50* | 0.52** |
All high | 3.73 (0.77) | — | |
High unreflective | 3.75 (0.68) |
Mean (sd) | Effect sizebc | ||
---|---|---|---|
All high | High unreflective | ||
a The ANOVA results were statistically significant for the self-efficacy and negative experiences subscales, with F(2,227) = 8.142, p < 0.001 and F(2,227) = 14.039, p < 0.001, respectively, and nonsignificant for the supporting learning subscale with F(2,227) = 2.697, p = 0.070. b Effect sizes for the mean difference between the two clusters indicated on the left and above. Only statistically significant effect sizes are displayed. c Dunnett's T3 post hoc test significances: p < 0.001, ***; 0.001 < p < 0.01, **; and 0.01 < p < 0.05, *. | |||
Self-assessment as supporting learninga | |||
High organised & deep | 3.38 (0.82) | — | — |
All high | 3.25 (0.87) | — | |
High unreflective | 3.10 (0.62) | ||
Negative experiences of peer assessmenta | |||
High organised & deep | 2.00 (0.62) | 0.74*** | 0.88*** |
All high | 2.56 (0.85) | — | |
High unreflective | 2.54 (0.61) | ||
Self-efficacy in peer assessmenta | |||
High organised & deep | 4.14 (0.62) | 0.58** | 0.65*** |
All high | 3.73 (0.77) | — | |
High unreflective | 3.73 (0.63) |
Finally, we also investigated the correlations between students’ perceptions of peer and self-assessment and study-related burnout within each cluster. For the “High organised and deep” cluster, a statistically significant correlation of 0.31 was found between the exhaustion and negative experiences of self-assessment variables. Meanwhile, for the “All high” cluster both exhaustion and cynicism were significantly correlated with negative experiences of peer assessment with correlation coefficients of 0.27 and 0.29, respectively. Lastly, both exhaustion and inadequacy were correlated with perceptions of peer assessment as supporting learning in the “High unreflective” cluster. These correlation coefficients were 0.22 and 0.27, respectively. All of these correlations were relatively modest.
We found three learning profiles from our data (1) “High organised and deep”, (2) “All high” and (3) “High unreflective”. Of these three, the “All high” group had the highest mean of all three for the unreflective approach to learning and organised studying, while the “High organised and deep” had the highest mean for the deep approach. Similar profiles to our “High organised and deep” and “High unreflective” have been found in previous studies (Parpala et al., 2010) including with engineering students (Salmisto et al., 2016), but these studies did not include the “All high” profile. In contrast, a recent study by Parpala et al. (2021) did find an “All high” profile, with elevated scores for all the approaches to learning.
Interestingly, the unreflective students formed the largest group in this study. This contradicts earlier general studies where the “High unreflective” group is usually the smallest (Parpala et al., 2010; Asikainen and Katajavuori, 2022). As these studies have measured learning approaches at a general level, the higher prevalence of the unreflective approach could just signal the challenging nature and the high workload associated with the thermodynamics course. Alternatively, there is some evidence that students’ discipline can also impact the adopted learning approach, with less deep and more unreflective approaches typically encountered in fields like science and economy (Baeten et al., 2010). Regardless, it appears that qualitatively different results can emerge at the course-level compared to the general one. This is interesting, as studies exploring learning profiles at course-level are relatively scarce. These results also provide potential corroboration that the adoption of the deep and unreflective approaches depends on the course context and the learning environment (Postareff et al., 2018).
Our results showed that the “High organised and deep” group experienced almost every aspect of burnout, i.e., exhaustion, cynicism, and inadequacy substantially less than students in the other profiles. That is to say, chemical engineering students who aim to understand and use meaningful learning strategies in physical chemistry and who manage their time effectively experience less exhaustion, cynicism, and inadequacy. These results line up with earlier studies showing that first year students applying a deep approach experience less burnout symptoms than students utilising the unreflective approach (Asikainen et al., 2020). In addition, both our results and those of Parpala et al. (2021) indicate that the most exhaustion was suffered by the “All high” students. The high score in exhaustion set the “All high” group apart from the “High unreflective group”, justifying the use of the three-cluster solution over the two-cluster one.
Who are the “All high” students? Parpala et al. (2021) thought that these students may have difficulties with their learning strategies while being aware of how they should develop their studying (Lindblom-Ylänne, 2003). Upon observing a similar group in their study of first-year students, Freyer and Vermunt (2018) further suggested that these are students who have not yet had sufficient time to develop a differentiated study strategy. Perhaps some of our students might also still be learning study skills, as most course participants were starting their second year. It should also be noted that the thermodynamics course differed in several regards from what the students had come to expect from their first year. For example, in addition to the mathematics-heavy approach of physical chemistry, the students had to operate in a student-centred learning environment. The course also included somewhat unfamiliar assessment practices in the form of peer and self-assessment. As undergraduates may be more used to traditional assessment (Alt and Raichel, 2020), the new learning environment may place demands on the students to modify their learning strategies, which can increase the workload (Beaten et al., 2010) and lead to exhaustion.
Our study also uncovered variation in how students with different learning profiles perceive peer and self-assessment. Students representing the “High organised and deep” profile scored higher in efficacy experiences and lower in negative experiences of both peer and self-assessment with larger differences observed for self-assessment. This is in line with previous research linking both the deep approach to learning and organised studying with positive perceptions of assessment and the unreflective approach with negative perceptions (Parpala et al., 2010; Herrmann et al., 2017). Because peer and self-assessment can feel difficult for students (Hanrahan and Isaacs 2001; Andrade and Du 2007; Van Hattum-Janssen and Lourenço 2008), these results also agree with the finding that students utilising the deep approach tend to prefer challenging courses (Halme et al., 2021). The fact that self-efficacy is also positively related to the deep approach and negatively to the unreflective approach to learning (Prat-Sala and Redford, 2010), further lends credence to our results. In short, students who employ deep learning strategies and manage their time carefully not only experience less study-related burnout but also feel more efficacious when participating in assessment and have fever negative experiences.
In sum, our study associated multiple benefits with belonging to the “High organised and deep” learning approach group when studying physical chemistry, particularly in terms of study-related burnout. As the learning environment impacts students’ approaches to learning, it would thus be worthwhile for physical chemistry instructors to employ instructional practices that facilitate the adoption of the deep approach. Based on the review by Baeten et al. (2010), this could be achieved through a reasonable overall workload, student-centred teaching approaches, teacher involvement and orientation towards changing students’ conceptions, and assessment that encourages deep learning and resembles students’ future practice. For example, Process Oriented Guided Inquiry Learning has recently served as the basis for several physical chemistry laboratory modules (Hunnicutt et al., 2015; Phillips et al., 2019; Cole et al., 2020; Partanen, 2023) and there is some evidence indicating that it can facilitate the adoption of the deep approach while undermining the unreflective one (Joshi and Lau, 2023). Regardless, the deep approach is hard to induce (Baeten et al., 2013). For example, the “High unreflective” group emerged largest in the thermodynamics course, despite our reliance on student-centred teaching and peer and self-assessment, which has been shown to help foster a deeper approach to learning (Lynch et al., 2012; Nieminen et al., 2021). In fact, our results are reminiscent of the findings of Gijbels et al. (2008) where even though students experienced what appeared to be a student-centred and constructivist learning environment and perceived the assessment as demanding deeper levels of understanding, they still ended up adopting increasingly unreflective approaches to learning. The two explanations they offer for this paradoxical outcome are: first, some students might have successful experiences with assessment that focuses on lower-level cognitive skills from prior education, which makes the confrontation with assessment demanding higher-order thinking skills stressful and arduous. Second, as students in the thermodynamics course had to perform several novel self-study and assessment activities, the total workload could feel high.
In our study, self-efficacy and lack of negative experiences in assessment were connected with the profile that was high in the deep approach, while the profiles high in the unreflective approach tended to possess more negative perceptions of assessment. Given the result that self-assessment can induce the deep approach (Nieminen et al., 2021), these associations could mean that to bolster this effect, the teacher needs to facilitate assessment self-efficacy while minimizing negative experiences. This underscores the need for clear assessment instructions, sufficient tools, and support while also monitoring how students perceive the assessment tasks and their workload. Peer and self-assessment are associated with various benefits that are relevant to physical chemistry learning, including critical thinking, metacognitive knowledge, and problem-solving gains (Topping, 1998; Mok et al., 2006; Huisman et al., 2019; Hadzhikoleva et al., 2019), better learning outcomes (Partanen, 2018; Partanen, 2023) and improved attitudes (Partanen, 2020; Partanen, 2023). Consequently, its use in physical chemistry education is cautiously recommended. Further research is needed to explore the role that challenging courses play in university students’ wellbeing, and the impact of peer and self-assessment in promoting wellbeing.
2H2O(l) → 2H2(g) + O2(g) |
The generated hydrogen gas has a high energy density and its combustion forms only water.
(For more info, see https://science.sciencemag.org/content/355/6321/eaad4998).
Subtask 1.1 Calculate the heat released in the reaction at 1 bar and 25 °C. Based on the reaction equation, what can you conclude about the work done in this reaction? Use your conclusion to compare the change in the internal energy to the change in enthalpy. (3 points).
Assessment rubric 1.1 (Start from zero points and add points if the following conditions are met:)
+1p. Enthalpy calculated correctly using enthalpies of formation and the result is within 5 kJ mol−1 of the model answer. (OR there must be some kind of justification why the result is minus two times the formation enthalpy of liquid water.)
+1p. The student has understood that work is being done in the process because the amount of gas increases. (The numerical calculation of the work is also sufficient as justification.)
+1p. The student has realized that the change in internal energy is smaller than the change in enthalpy, because work is negative. (A numerical calculation of these is also sufficient as a justification.)
Subtask 2.1 Qualitatively compare the freezing points of water in the containers. Carefully justify your answer using the chemical potential. Draw a picture!
Assessment rubric 2.1 (Start from zero points and add points if the following conditions are met:)
+1p. The student has explained (or shown through a picture) that impurities such as dissolved gases in the solution lead to a lowering of the freezing point.
+2p. The student has explained that the point where the chemical potential of the solid and the liquid is the same (= freezing point) moves to a lower temperature as the chemical potential of the solution decreases, which leads to a lower freezing point. (A picture like the one depicted in the model answer is sufficient so long as the student has also described what is in the picture as a part of their solution.) If the explanation is incomplete, but in the answer somehow connects the lowering of the freezing point to the lowering of the chemical potential of the solution in relation to the pure solution, you can give +1p.
Approaches to learning (Parpala and Lindblom-Ylänne 2012).
The students were instructed to think about their teaching and learning in the Thermodynamics course.
1. Deep approach
1.1 Ideas and perspectives I came across during my studies have made me contemplate them afterwards.
1.2 I have carefully looked for evidence to reach my own conclusions about what I am studying in the course.
1.3 During my studies in this course I have tried to relate new material to my previous knowledge.
1.4 I have tried to relate what I learned in this course to what I have learned in other courses.
2. Unreflective approach
2.1 The things I need to learn have seemed so complicated that I have had difficulties in understanding them.
2.2 I have often had to repeat things in order to learn them.
2.3 I have often had trouble in making sense of the things I have to learn.
2.4 Much of what I have learned seems nothing more than unrelated bits and pieces.
3. Organised approach
3.1 Overall, I have been systematic and organised in my studying.
3.2 I have organised my study time carefully to make the best use of it.
3.3 I have planned my studies in this course so that I can fit everything in.
3.4 I have put a lot of effort into my studies in this course.
Study-related burnout (Salmela-Aro et al., 2009).
The students were instructed pick the Likert option that best described the current situation in their studies.
4. Exhaustion
4.1 I feel overwhelmed by the work related to my studies.
4.2 During my free time I worry over matters related to my studies.
4.3 The pressure of my studies causes problems in my close relationships with others.
4.4 I often sleep badly because of matters related to my studies.
5. Cynicism
5.1 I feel a lack of study motivation and often think of giving up.
5.2 I feel that I am losing interest in my studies.
5.3 I am continually wondering whether my studies have any meaning.
6. Inadequacy
6.1 I often have feelings of inadequacy in my studies.
6.2 I used to expect I would achieve much more in my studies than I expect now.
Perceptions of peer assessment (Partanen et al., 2023).
7. Peer assessment as supporting learning-factor
7.1 Peer assessment supported my learning in the course.
7.2 Peer assessment motivated me to engage more deeply with course tasks.
7.3 Peer assessment made me participate more in course activities.
7.4 Peer assessment helped me recognise my errors.
7.5 Peer assessment increased my motivation to study in the course.
7.6 Peer assessment made me review the course contents more.
8. Negative experiences of peer assessment-factor
8.1 Peer assessment is unfair because the effort students put into it varies a lot.
8.2 The criteria for peer assessment felt unjust when compared to the tasks.
8.3 I felt that I could not assess others’ work reliably.
8.4 I feel that many students were not able to assess their peers’ work.
8.5 Peer assessment increased the workload too much.
8.6 In peer assessment, the students are forced to do the teacher's work as well.
9. Self-efficacy in peer assessment-factor
9.1 I was able to assess the performance of my peers with the provided assessment rubrics and model solutions.
9.2 I was able to apply the assessment rubric to mark my peers’ solutions.
9.3 I understood how the tasks were supposed to be solved when I compared them to the assessment rubric and model solutions.
Perceptions of self-assessment (Partanen et al., 2023)
10. Self-assessment as supporting learning-factor
10.1 Self-assessment supported my learning in the course.
10.2 Self-assessment made me review the course contents more.
10.3 Self-assessment made me participate more in course activities.
10.4 Self-assessment helped me to recognise my errors.
10.5 Self-assessment motivated me to engage more deeply with course tasks.
10.6 Self-assessment increased my motivation to study in the course.
11. Negative experiences of self-assessment-factor
11.1 Self-assessment increased the workload too much.
11.2 Self-assessment was unpleasant and stressful.
11.3 Performing self-assessment felt frustrating.
11.4 It was difficult to assess my performance if I had not mastered the tasks myself.
11.5 I felt that I could not assess my work reliably.
11.6 There is little benefit to self-assessment compared to the workload.
12. Self-efficacy in self-assessment-factor
12.1 I was able to apply the assessment rubric to mark my solutions.
12.2 I was able to assess my performance with the provided assessment rubrics and model solutions.
12.3 I understood how the tasks were supposed to be solved when I compared them to the assessment rubric and model solutions.
This journal is © The Royal Society of Chemistry 2024 |