A card-sorting tool to measure expert versus novice thinking in scientific research.

Undergraduate research and laboratory experiences provide a wide range of benefits to student learning in science and are integral to imbed authentic research experiences in biology labs. While the benefit of courses with research experience is widely accepted, it can be challenging to measure conceptual research skills in a quick and easily scalable manner. We developed a card-sorting task to differentiate between novice and expert conceptualization of research principles. There were significant differences in the way faculty/postdocs, graduate students, and undergraduate students organized their information, with faculty/postdocs more likely to use deep feature sorting patterns related to research approach. When provided scaffolding of group names reflecting expert-like organization, participant groups were better able to sort by that organization, but undergraduate students did not reach expert levels. Undergraduates with Advanced Placement experience were more likely to display expert-like thinking than undergraduates without Advanced Placement Biology experience and non-PEER (persons excluded because of their Ethnicity or Race) students displayed more expert-like thinking than PEER students. We found evidence of undergraduates in various stages of development toward expert-like thinking in written responses. This card-sorting task can provide a framework for analyzing student's conceptualizations of research and identify areas to provide added scaffolding to help shift from novice-like to expert-like thinking.