Conceptions of assessment in higher education
an exploratory study of portuguese faculty
DOI:
https://doi.org/10.18554/rt.v17i3.7450Palavras-chave:
Higher Education, Faculty, Teachers Conceptions of Assessment (TCoA)Resumo
Under the Bologna process, it is important that educators understand and use assessment for formative purposes as well as traditional summative purposes. This small-scale exploratory study tested the Teachers Conceptions of Assessment (TCoA) inventory in the Portuguese higher education context. A convenience sample of Portuguese academic faculty (n=185) from five public universities and across multiple scientific areas were surveyed. Confirmatory factor analysis rejected the original model and preferred a four-factor model (i.e., improvement, assessment quality, institutional quality, and reject assessment use) using just 15 of 27 items. Findings from this study indicate that, in line with Bologna intentions, Portuguese faculty seem to be taking a positive and constructive view of assessment as a tool for improved outcomes and have confidence in their evaluative practices. Faculty agreed that assessment was a high-quality process for improved outcomes and rejected its irrelevance. At the same time, they had a much weaker but positive view that assessment evaluated institutional quality. The study indicates that the TCoA inventory needs to be supplemented with different items and factors to capture the quality of Portuguese faculty conceptions of assessment. Keywords: Higher Education. Faculty. Teachers Conceptions of assessment (TCoA).
Referências
ALEAMONI, Lawrence M. Issues in Linking Instructional-Improvement Research to Faculty Development in Higher Education. Journal of Personnel Evaluation in Education, [s. l.], v. 11, n. 1, p. 31–37, 1997. https://doi.org/10.1023/A:1007995103634.
ANDERSON, James C.; GERBING, David W. Structural equation modeling in practice - a review and recommended 2-step approach. Psychological Bulletin, 103(3), 411–423, 1988. https://doi.org/10.1037/0033-2909.103.3.411.
AZIS, Astuti. Indonesian junior secondary school teachers’ conceptions of assessment: A mixed methods study. Thesis submitted to the Victoria University of Wellington in fulfilment of the requirement for the degree of Doctor of Philosophy in Education. Victoria University of Wellington, 2014.
BANDALOS, Deborah. L.; FINNEY, Sarah. J. Factor analysis: Exploratory and confirmatory. In: HANCOCK, Gregory. R.; MUELLER, Ralph. O. (Eds.). The Reviewer's Guide to Quantitative Methods in the Social Sciences. New York: Routledge, 2010, p. 93-114.
BARNES, Nicole; FIVES, Helenrose.; DACEY, Charity M. Teachers’ beliefs about assessment. In FIVES, Helenrose; GILL, Michelle Gregoire (Eds.). International Handbook of Research on Teacher Beliefs. New York: Routledge, 2015, p. 284-300.
BLACK, Paul; WILIAM, Dylan. Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), p. 7-74, 1998. https://doi.org/10.1080/0969595980050102.
BOLLEN, Kenneth. A. Structural Equations with Latent Variables. New York: John Wiley & Sons, Inc, 1989.
BONNER, Sarah. M. Teachers’ Perceptions about Assessment: Competing Narratives. In: BROWN, Gavin T.L.; HARRIS, Louis R. (Eds.), Handbook of Human and Social Conditions in Assessment. New York: Routledge, 2016, p.21-39.
BROWN, Gavin T. L.; HARRIS, Louis. R. Unintended consequences of using tests to improve learning: How improvement-oriented resources heighten conceptions of assessment as school accountability. Journal of MultiDisciplinary Evaluation, 6(12), p.68-91, 2009. http://journals.sfu.ca/jmde/index.php/jmde_1/article/view/236.
BROWN, Gavin T.L. (2013). Student conceptions of assessment across cultural and contextual differences: University student perspectives of assessment from Brazil, China, Hong Kong, and New Zealand. In: LIEM, Gregory Arief D.; BERNARDO, Allan B.I. (Eds.), Advancing Cross-cultural Perspectives on Educational Psychology: A Festschrift for Dennis McInerney. USA: Information Age Publishing, 2013, p.143-168.
BROWN, Gavin T.L. Conceptions of assessment: Understanding what assessment means to teachers and students. New York, NY: Nova Science Publishers, 2008.
BROWN, Gavin T.L. Teachers' conceptions of assessment inventory--Abridged (TCoA-IIIA-Version 3-Abridged). Unpublished test. Auckland, NZ: University of Auckland, 2006a.
BROWN, Gavin T.L. An exploration of secondary school teachers’ conceptions of assessment. In: KOZUH, B.; BERAN, T.; BERAN, A. K. T. (Eds.). Measurement and Assessment in Educational and Social Research. Krakow, Poland: Oficyna Wydawnicza AFM, 2005, p.39-48.
BROWN, Gavin T.L. Teachers’ conceptions of assessment: Implications for policy and professional development. Assessment in Education: Policy, Principles and Practice, vol. 11, issue 3, p.301-318, 2004. https://doi.org/10.1080/0969594042000304609.
BROWN, Gavin T.L. Teachers' conceptions of assessment: Validation of an abridged instrument. Psychological Reports, 99, p. 166-170, 2006b. https://doi.org/10.2466/pr0.99.1.166-170.
BROWN, Gavin T.L. Teachers’ conceptions of assessment. Unpublished doctoral dissertation. Auckland, NZ: University of Auckland, 2002. Retrieved from http://hdl.handle.net/2292/63.
BROWN, Gavin T.L. Teachers’ self-reported assessment practices and conceptions: Using structural equation modelling to examine measurement and structural models. In: TEO, Timothy; Khine, Myint Swe (Eds.), Structural equation modelling in educational research: Concepts and applications. Rotterdam, NL: SensePublishers, 2009, p. 243-266.
BROWN, Gavin T.L.; GEBRIL, Atta; MICHAELIDES, Michalis P. (2019). Teachers’ Conceptions of Assessment: A global phenomenon or a global localism. Frontiers in Educ, p. 1-13, March, 2019. https://doi.org/10.3389/feduc.2019.00016.
BROWN, Gavin T.L.; KENNEDY, Kerry J.; FOK, Ping Kwan; CHAN, Jacqueline Kin Sang; YU, Wai Ming. Assessment for student improvement: understanding Hong Kong teachers’ conceptions and practices of assessment. Assessment in Education: Principles, Policy & Practice, vol. 16, issue 13, p. 347-363, 2009. https://doi.org/10.1080/09695940903319737.
BROWN, Gavin T.L.; LAKE, Robert; MATTERS, Gabrielle (2011). Queensland teachers’ conceptions of assessment: The impact of policy priorities on teacher attitudes. Teaching and Teacher Education, Volume 27, Issue 1, p. 210-220, January, 2011. https://doi.org/10.1016/j.tate.2010.08.003.
BROWN, Gavin T.L.; Michaelides, M.P. Ecological rationality in teachers’ conceptions of assessment across samples from Cyprus and New Zealand. European Journal of Psychology of Education, 26 (3), p. 319–337, 2011. https://doi.org/10.1007/s10212-010-0052-3.
BROWN, Gavin T.L.; REMESAL, Ana. Prospective Teachers' Conceptions of Assessment: A Cross-Cultural Comparison. The Spanish Journal of Psychology, vol. 15, issue 1, p. 75-89, March, 2012. https://doi.org/10.5209/rev_SJOP.2012.v15.n1.37286.
BROWN, Gavin. T. L. The psychology of evaluation: Addressing the pressures teachers face. Revista Contemporânea de Educação, v. 18, n. 41, p. 9-30, 2023. https://revistas.ufrj.br/index.php/rce/article/view/54691/pdf_1.
BROWN, Gavin. T. L. What do teachers think of assessment? Professional Development Today, v. 23, n. 3, 2024. https://www.teachingtimes.com/what-do-teachers-think-of-assessment/.
BROWN, Gavin. T. L.; ANDERSSON, C.; WINBERG, M.; PALMBERG, B.; PALM, T. Swedish teacher conceptions of assessment: A focus on improving outcomes. Education Inquiry, (231778842), 2024. https://doi.org/10.1080/20004508.2024.2375111.
BURNHAM, Kenneth. P.; ANDERSON, David. R. Multimodel Inference: Understanding AIC and BIC in Model Selection. Sociological Methods & Research, vol. 33, issue 2, p. 261-304, 2004. https://doi.org/10.1177/0049124104268644.
CARLESS, David; SALTER, Diane; YANG, Min; LAM, Joy. Developing Sustainable Feedback Practices. Studies in Higher Education, 36(4), p. 395–407, 2011. https://doi.org/10.1080/03075071003642449.
CARLESS, David. Excellence in university assessment: learning from award-winning practice. New York: Routledge, 2015.
CARLESS, David. Trust, distrust and their impact on assessment reform. Assessment & Evaluation in Higher Education, vol. 34, núm. 1, p. 79-89, 2009. https://doi.org/10.1080/02602930801895786.
COSTELLO, Anna B.; OSBORNE, Jason. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment Research & Evaluation, 10(7), p. 1-9, 2005. http://pareonline.net/getvn.asp?v=10&n=7.
COURTNEY, Matthew. Determining the number of factors to retain in EFA: Using the SPSS R-Menu v2.0 to make more judicious estimations. Practical Assessment Research & Evaluation, 18(8), p. 1-14, 2013. https://doi.org/10.7275/9cf5-2m72.
DANIELS, Lia M.; POTH, Cheryl; PAPILE, Chiara; HUTCHISON, Marnie Validating the conceptions of assessment-III scale in Canadian preservice teachers. Educational Assessment, 19(2), p. 139-158, 2014. https://doi.org/10.1080/10627197.2014.903654.
DARMODY, M. Irish post-primary teachers' conceptions of assessment. Doctor of Education thesis. Dublin City University, 2017.
DAYAL, H. C. How teachers use formative assessment strategies during teaching: evidence from the classroom. Australian Journal of Teacher Education, [S.l.], v. 46, n. 7, 2021. https://doi.org/10.14221/ajte.2021v46n7.1.
Decree-Law 107/2008 of June 25. Diário da República, 1.ª série, n.º 121, 25-06-2008.
Decree-Law 90/2008 of May 30. Diário da República, 1.ª série, n.º 104, 30-05-2008.
DEMPSTER, Arthur P.; LAIRD, Nan M.; RUBIN, Donald B. Maximum likelihood estimation from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, Series B, 39(1), p. 1-38, 1977. https://www.jstor.org/stable/2984875?seq=1#metadata_info_tab_contents.
DENEEN, Christopher Charles; FULMER, Gavin W.; BROWN, Gavin T.L.; TAN, Kelvin; LEONG, Wei Shin; TAY, Hui Yong. Value, practice and proficiency: Teachers' complex relationship with Assessment for Learning. Teaching and Teacher Education, 80, p. 39-47, 2019. https://doi.org/10.1016/j.tate.2018.12.022
DILORETO, Melanie Anne. Multi-Group Invariance of the Conceptions of Assessment Scale Among University Faculty and Students. Dissertation Submitted to the Graduate School of The University of Southern Mississippi in Partial Fulfilment of the Requirements for the Degree of Doctor of Philosophy, 2013. https://aquila.usm.edu/dissertations/214.
DISTEFANO, Christine; ZHU, Min; MÎNDRIL?, Diana. Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research & Evaluation, 14(20), p. 1-20, 2009. https://doi.org/10.7275/da8t-4g52.
ESTAJI, M.; BANITALEBI, Z.; BROWN, G. T. L. The key competencies and components of teacher assessment literacy in digital environments: A scoping review. Teaching and Teacher Education, v. 141, p. 104497, 2024. https://doi.org/10.1016/j.tate.2024.104497.
ESTRELA, Albano; NÓVOA, António (orgs.). Avaliações em Educação: Novas Perspetivas. Porto: Porto Editora, 1993.
EWELL, Peter T. Assessment, accountability, and improvement: Revisiting the tension. Urbana, IL: University of Illinois and Indiana University, National Institute for Learning Outcomes Assessment (NILOA), nov. 2009. (Occasional Paper, n. 1).
FAN, Xitao; SIVO, Stephen A. Sensitivity of fit indices to model misspecification and model types. Multivariate Behavioral Research, 42:3, p. 509-529, 2007. https://doi.org/10.1080/00273170701382864.
FERNANDES, Domingos. Articulação da aprendizagem, da avaliação e do ensino: questões teóricas, práticas e metodológicas. In: ALVES, Maria Palmira; DE KETELE, Jean-Marie, Do currículo à avaliação, da avaliação ao currículo. Porto: Porto Editora, 2011, p. 132-142.
FERNANDES, E. L.; FLORES, M. A. Assessment in Higher Education: Voices of programme directors. Assessment & Evaluation in Higher Education, v. 47, n. 1, p. 45-60, 2022. Disponível em: https://doi.org/10.1080/02602938.2021.1888869.
FERNANDES, E. L.; FLORES, M. A.; CADIME, I.; COUTINHO, C. P. Práticas de avaliação no ensino superior: Um estudo com professores portugueses. Estudos em Avaliação Educacional, São Paulo, v. 34, p. e09219, 2023. DOI: 10.18222/eae.v34.9219.
FERNANDES, Eva Lopes. Conceptions and Practices of Assessment in Higher Education: A Study of University Teachers. Thesis submitted to the University of Minho in fulfilment of the requirement for the degree of Doctor of Educational Sciences – Curricular Development. Victoria University of Wellington, 2020.
FLETCHER, Richard; MEYER, Luanna; ANDERSON, Helen; JOHNSTON, Patricia; REES, Malcolm. Faculty and students’ conceptions of assessment in higher education. Higher Education, 64, p. 119–133, 2012. https://doi.org/10.1007/s10734-011-9484-1.
FLORES, Maria Assunção; VEIGA SIMÃO, Ana Maria. Barros, Alexandra, Pereira, Diana. Perceptions of effectiveness, fairnessand feedback of assessment methods: a study in higher education. Studies in Higher Education,vol. 40, no 9, p. 1523–1534, 2015. https://10.1080/03075079.2014.881348.
FLORES, Maria Assunção; VEIGA SIMÃO, Ana Maria. Competências desenvolvidas no contexto do Ensino Superior: a perspetiva dos diplomados. In V Jornadas de Redes de Investigación en Docencia Universitaria. Alicante, Espanha, 4-5 junho, 2007.
FULMER, Gavin.W.; LEE, Iris C.H.; TAN, KELVIN H.K. Multi-level model of contextual factors and teachers’ assessment practices: an integrative review of research. Assessment in Education: Principles, Policy & Practice, 22:4, p. 475-494, 2015. https://doi.org/10.1080/0969594X.2015.1017445.
GEBRIL, Atta; BROWN, Gavin T.L. The effect of high-stakes examination systems on teacher beliefs: Egyptian Teachers’ Conceptions of Assessment. Assessment in Education: Principles, Policy and Practice, 21(1), p. 16-33, 2014. https://doi.org/10.1080/0969594X.2013.831030 .
GONÇALVES, Rui. Conceções de Avaliação em Contexto de Ensino Clínico de Enfermagem: Um Estudo na Escola Superior de Enfermagem de Coimbra. Tese de Doutoramento. Universidade de Aveiro: Departamento de Educação e Psicologia, 2016.
GONÇALVES, Rui. Cuestionario Abreviado de Concepciones de Evaluación del Aprendizaje. Unpublished translation of Teachers' Conceptions of Assessment inventory (CoA-IIIA). Nursing School of Coimbra, Portugal, 2011.
HADJI, Charles. A avaliação, regras do jogo. Porto: Porto Editora, 1994.
HATTIE, John; TIMPERLEY, Helen. The Power of Feedback. Review of Educational Research, Volume 77, issue 1, p. 81-112, March, 2007. https://doi.org/10.3102/003465430298487.
HIDRI, Sahbi. Conceptions of assessment: Investigating what assessment means to secondary and university teachers. Arab Journal of Applied Linguistics, Vol. 1, No. 1, p. 19-43, January, 2016. https://doi.org/10.1234/ajal.v1i1.43.
ION, Georgeta; CANO, Elena. Assessment practices at Spanish universities: from a learning to a competencies approach. Evaluation & Research in Education, 24:3, p. 167-181, 2011. https://doi.org/10.1080/09500790.2011.610503.
KEMBER, David. A reconceptualisation of the research into university academics' conceptions of teaching. Learning and Instruction, 7(3), p. 255-275, 1997. https://doi.org/10.1016/S0959-4752(96)00028-X .
LEVY-VERED, Adi; NASSER-ABU ALHIJA, Fadia. Modelling beginning teachers’ assessment literacy: the contribution of training, self-efficacy, and conceptions of assessment. Educational Research and Evaluation, 21:5-6, p. 378-406, 2015. https://doi.org/10.1080/13803611.2015.1117980.
MATOS, Daniel Abud Seabra. A avaliação no ensino superior: conceções múltiplas de estudantes Brasileiros. Tese de Doutoramento. Universidade Federal de Minas Gerais, 2010.
MCDOWELL, Liz; WAKELIN, Delia; MONTGOMERY, Catherine; KING, Sara. Does assessment for learning make a difference? The development of a questionnaire to explore the student response. Assessment & Evaluation in Higher Education, 36(7), p. 749-765, 2011. https://doi.org/10.1080/02602938.2010.488792.
MOIINVAZIRI, Marjan. University Teachers' Conception of Assessment: A Structural Equation Modeling Approach. Journal of Language, Linguistics and Literature, Vol. 1, No. 3, p. 75-85, 2015. http://www.aiscience.org/journal/j3l
MUÑOZ, Ana Patrícia; PALACIO, Marcela; ESCOBAR, Liliana. Teachers’ Beliefs About Assessment in an EFL Context in Colombia. PROFILE, Vol. 14, No. 1, p. 143-158, April, 2012. ISSN 1657-0790.
NASSER-ABU ALHIJA, Fadia. Teaching in higher education: Good teaching through students’ lens. Studies in Educational Evaluation, 54, p. 4–12, 2017. https://doi.org/10.1016/j.stueduc.2016.10.006
OPRE, Dana. Teachers’ Conceptions of Assessment. Social and Behavioral Sciences, 209, p. 229-233, 2015. https://doi.org/10.1016/j.sbspro.2015.11.222
PAJARES, M. Frank. Teachers' Beliefs and Educational Research: Cleaning Up a Messy Construct. Review of Educational Research, Vol. 62, no. 3, p. 307-332, 1992. https://doi.org/10.3102/00346543062003307
PASTORE, Serafina; PENTASSUGLIA, Monica. Teachers’ and students’ conceptions of assessment within the Italian higher education system. Practitioner Research in Higher Education, 10 (1), p. 109-120, 2016. http://insight.cumbria.ac.uk/id/eprint/2488/.
PEREIRA, Diana Ribeiro; FLORES, Maria Assunção; VEIGA SIMÃO, Ana Margarida; BARROS, Alexandra. Effectiveness and relevance of feedback in Higher Education: A study of undergraduate students. Studies in Educational Evaluation, 49, p. 7-15, 2016. https://doi.org/10.1016/j.stueduc.2016.03.004
PEREIRA, Diana Ribeiro; FLORES, Maria Assunção. Conceptions and practices of assessment in Higher Education: A study of Portuguese university teachers. Revista Iberoamericana de Evaluación Educativa, 9(1), p. 9-29, 2016. http://dx.doi.org/10.15366/riee2016.9.1.001.
PEREIRA, Diana Ribeiro; FLORES, Maria Assunção. Percepções dos estudantes universitários sobre a avaliação das aprendizagens: um estudo exploratório. Avaliação (Campinas) [online], vol. 17, no. 2, p. 521-555, 2012. http://dx.doi.org/10.1590/S1414-40772012000200012.
PERRENOUD, Philippe. Avaliação: da excelência à regulação das aprendizagens: entre duas lógicas. Porto Alegre: Artmed, 1999.
POSTAREFF, L., VIRTANEN, V., KATAJAVUORI, N.; LINDBLOM-YLÄNNE, S. Academics’ conceptions of assessment and their assessment practices. Studies in Educational Evaluation, vol. 28, issues 3-4, p. 84-92, 2012. https://doi.org/10.1016/j.stueduc.2012.06.003.
RIESKAMP, Jörg; REIMER, Torsten. Ecological rationality. In: BAUMEISTER; Roy F.; VOHS, Kathleen D. (Eds.), Encyclopedia of Social Psychology. Thousand Oaks, CA: Sage, 2007, p. 273-275.
SAMBELL, Kay; MCDOWELL, Liz. The construction of the hidden curriculum: Messages and meanings in the assessment of student learning. Assessment & Evaluation in Higher Education, 23(4), p. 391-402, 1998. https://doi.org/10.1080/0260293980230406.
SAMUELOWICZ, Katherine; BAIN, John. Identifying academics’ orientations to assessment practice. Higher Education, 43(2), p. 173–201, 2002. https://doi.org/10.1023/A:1013796916022.
SAMUELOWICZ, Katherine. Teaching conceptions and teaching practice: A case of assessment. In: BALLANTYNE; Roy; BRUCE, Christine (Eds.), Phenomenography: Philosophy and practice. Brisbane, Aus: Queensland University of Technology, Centre for Applied Environmental and Social Education Research, 1994, p. 343-353.
SEGERS, Mien; GIJBELS, David; THURLINGS, Marieke. The relationship between students' perceptions of portfolio assessment practice and their approaches to learning. Educational Studies, v.34, n.1, p. 35-44, 2008. https://doi.org/10.1080/03055690701785269.
SEGERS, Mien; TILLEMA, Harm. How do Dutch secondary teachers and students perceive the purpose of assessment? Studies in Educational Education (special issue), 37, p. 49–54, 2011. https://doi.org/10.1016/j.stueduc.2011.03.008.
STRUYVEN, Katrien; DOCHY, Filip; JANSSENS, Steven. Students’ perceptions about evaluation and assessment in higher education: A review. Assessment & Evaluation in Higher Education, 30 (4), p. 331–347, 2005. https://doi.org/10.1080/02602930500099102.
VAN DEN BERGH, Linda; ROS, Anje; BEIJAARD, Douwe. Teacher learning in the context of a continuing professional development programme: a case study. Teaching and Teacher Education, 47, p.142-150, 2015. https://doi.org/10.1016/j.tate.2015.01.002.
WATERING, Gerard van de; GIJBELS, David; DOCHY, Filip; RIJT, Janine van der. Students’ assessment preferences, perceptions of assessment and their relationships to study results. Higher Education, 56, p. 645–58, 2008. https://doi.org/10.1007/s10734-008-9116-6.
WHEATON, Blair; MUTHÉN, Bengt; ALWIN, Duane F.; SUMMERS, Gene. Assessing reliability and stability in panel models. Sociological methodology, vol. 8, p. 84-136, 1997. https://doi.org/10.2307/270754.
XU, Yueting; BROWN, Gavin T.L. Teacher assessment literacy in practice: A reconceptualization. Teaching and Teacher Education, 58, p. 149-62, 2016. https://doi.org/10.1016/j.tate.2016.05.010.
YATES, Anne; JOHNSTON, Michael. The impact of school-based assessment for qualifications on teachers’ conceptions of assessment. Assessment in Education: Principles, Policy & Practice, vol. 25, p. 635-654, 2017. https://doi.org/10.1080/0969594X.2017.1295020.
Downloads
Publicado
Como Citar
Edição
Seção
Licença
Copyright (c) 2024 Revista Triângulo
Este trabalho está licenciado sob uma licença Creative Commons Attribution-NoDerivatives 4.0 International License.
Autores que publicam nesta revista concordam com os seguintes termos: Autores mantém os direitos autorais e concedem à revista o direito de primeira publicação, com o trabalho simultaneamente licenciado sob a Licença Creative Commons Attribution que permite o compartilhamento do trabalho com reconhecimento da autoria e publicação inicial nesta revista.
