By and large, the group has used the Force Concept Inventory (FCI) to assess the qualitative understanding gained by introductory mechanics students. The FCI is a 30-item multiple choice test focusing on the core concepts of force and motion. It does not contain items about energy, angular momentum, energy quantization (M&I) or statistical mechanics (M&I). The “distractors” (i.e., the incorrect answers) are very strong on this assessment, as the test was designed around naive notions of force and motion that introductory students have. A copy of the assessment can be obtained by emailing Danny Caballero.
In performing these very large studies, students are often given the FCI as a pre-assessment. This data combined with incoming GPAs and SAT scores form the set of data used to serve as a baseline for global measures of performance on the FCI after instruction. A statistical test of these metrics: FCI pre-test, incoming GPA, and SAT scores, shows that the students entering each course can be considered to be from the same populations. That is, better than average (or worse than average) students are not drawn to one or other course.
Students in the M&I course underperform on the FCI relative to their standard course (TRAD) cohorts. Recent work has shown that the reason for this underperformance may be attributed to the types of qualitative items not delivered to M&I students. Indeed standard course students are able to select correct responses more often because the FCI is more suited to the types of qualitative items that appear in their course. Work is in progress to bring these items, in the context of the M&I curriculum, to the M&I course. For more information on these efforts, please contact Danny Caballero.
There are several references to consider when discussing the FCI. Those references are listed below:
- Hestenes, D. and Wells, M. and Swackhamer, G., Force concept inventory, The Physics Teacher, vol. 30, pgs. 141-158, 1992
- Huffman, D. and Heller, P., What does the Force Concept Inventory actually measure?, The Physics Teacher, vol. 33, pg 138, 1995
- Hestenes, D. and Halloun, I., Interpreting the force concept inventory: A response to March 1995 critique by Huffman and Heller, The Physics Teacher, vol. 33, pg 502, 1995
- Heller, P. and Huffman, D., Interpreting the force concept inventory: A reply to Hestenes and Halloun, The Physics Teacher, vol. 33, pg. 503, 1995
- Henderson, C. and Heller, K. and Heller, P., Common concerns about the force concept inventory, The Physics Teacher, vol. 40, pgs. 542-542, 2002
Some of the results of this work are shown below. Please contact a member of the group for more information. This work has been published in PhysRev ST PER: https://journals.aps.org/prper/abstract/10.1103/PhysRevSTPER.8.020106
Average pre- and post-instruction FCI scores at Georgia Tech – The average FCI post-test scores are shown for students who have completed a one-semester mechanics course with either the traditional (TRAD) or Matter & Interactions (M&I) curriculum. Additionally, the average FCI pre-test score are shown for students before instruction in either the TRAD or M&I curriculum. The number of students tested for each curriculum at each institution is indicated in the figure. The error bounds represent the 95% confidence intervals on the estimate of the average score.
Average FCI scores by instructor – The average end-of-semester FCI scores for 4 M&I (MX) and 6 traditional (TX) sections are shown. The error bounds indicate 95% confidence intervals on the estimates of the average for each section. The number of students tested in a particular section is given by NO in the table below. All instructors used the Personal Response System (PRS) during lecture except for instructor TC.
Fractional difference in performance for mechanics subtopics – The fractional difference in performance ΔGi/ΔG between traditional and M&I students at GT is shown for each question on the FCI. Positive (negative) ΔGi/ΔG indicates superior performance by traditional (M&I) students. The numerical labels indicate the corresponding question number in order of appearance on the FCI. The ΔGi/ΔG are grouped together into one of six topics: Projectile Motion (PROJ), Newton’s first law (1st), Newton’s second law (2nd), Newton’s third law (3rd), Force Identification (FORCE), and Miscellaneous (MISC). The horizontal lines (dot-dash) correspond to ΔGi/ΔG = +/- 0.0333.
Georgia Tech FCI test results are shown for twenty-two traditional sections (T1-T22) and six Matter & Interactions sections (M1-M6). Different lecturers are distinguished by a unique letter in column L. The average FCI score O for NO students completing the course is shown for all sections. Moreover, in those sections where data is available, the average FCI score I for NI students entering the course are indicated. Nm is the number of students in a given section who took the FCI both at the beginning and at the end of their mechanics course.