Sample Mensa Research Journal Article

First-year college performance: A study of home school graduates and traditional school graduates

By Paul Jones, Georgia College and State University, and Gene Gloeckner, Colorado State University

Reprinted in the fall 2007 Mensa Research Journal, with permission from the Journal of College Admission, where this article originally appeared in the spring 2004 issue. Copyright 2004 National Association for College Admission Counseling.

Background

During the past three decades, the number of families choosing to exercise their legal option to educate their children at home, rather than enroll them in public schools, has grown throughout the United States (Mayberry, Knowles, Ray, and Marlow 1995, Osborn 2000, Ray 2000). According to recent estimates, the home school K-12 population may be as high as 1.6 million students nationwide and may grow nearly 7 percent annually, thus reaching three million by the year 2010 (Lines 1996, Ray 1999).

During this period of growth, home school advocates challenged state policy officials’ and school boards’ compulsory regulations, while the same advocates left many colleges and universities relatively alone. College admission officers across the United States were trying to grapple with how to address a growing population of the newly graduated home school students knocking at their doors.

Admission officers know little about the performance of a home school graduate’s academic performance in college, but this fact doesn’t stop colleges and universities from developing admission policies (accommodating or unaccommodating) for the home school population. Much of the existing research on academic performance centers on K-12 home school students and many of these studies show that home school children outperform their public school peers on several national standardized exams, including the Stanford Achievement Test and the Iowa Tests of Basic Skills, and at nearly all grade levels (Rakestraw 1987, Frost 1987, Wartes 1990, Ray 1990, Rudner 1999).

Three empirical studies, specifically focused on the first-year academic performance of the home school college student (Galloway 1995, Gray 1998, Jenkins 1998), attempted to remedy higher education and policy makers’ lack of knowledge. Galloway (1995) found home school graduates outperformed their conventional private school peers on the ACT English subtest. Jenkins (1998) found that full- and part-time community college home school students’ average first-year grade point averages were higher than non-home school graduates. Jenkins also found that the home school students outperformed their peers in reading and mathematics on the Texas Academic Skills Program. Finally, Gray (1998) found no significant differences between home school and traditional students at three institutions in Georgia (including a public university, a private university and a private college) on the SAT scores, English grades or cumulative grade point averages.

Purpose

The purpose of this study was to determine differences in first-year college academic performance between home school and traditional high school graduates, measured by grade point average, retention, ACT test scores, and credits.

To accomplish the purpose, nine null hypotheses were tested to determine if there were differences between home school graduates and traditional high school graduates. The null hypotheses were:

  • No significant difference in first-year grade point averages.
  • No significant difference in college retention during their first year (fall to spring semester).
  • No significant difference in first-year credit hours earned.
  • No significant difference in the ACT Composite scores.
  • No significant difference in the ACT English test scores.
  • No significant difference in the ACT Mathematics test.
  • No significant difference in the ACT Reading test scores.
  • No significant difference in the ACT Science Reasoning test scores.
  • No correlation between the variables: first-year grade point average, first year earned credit hours, first-year retention, and the ACT Composite test score.

Method

The samples for this study consisted of 55 first-year, degree-seeking, home school graduates who enrolled in Colorado four-year public colleges or universities from 1998 to 2000. Once the home school sample was identified, a random sample of 53 traditional high school graduates (public, private, parochial, etc.) who met the same criteria as the home school sample and matched the home school institution (n = 53) was chosen.

The Colorado Commission on Higher Education (CCHE) obtained the data and identified home school graduates by a high school code, a transcript type or an identification number. The dependent variables were: overall freshman cumulative grade point average; cumulative credit hours earned; SAT Combined test score (converted to ACT Composite score and only used for those students who did not have an ACT Composite score); gender; race/ethnicity; and ACT Composite and subtest scores.

Data Collection and Instruments

CCHE collected data, the ACT Composite test scores and the four subtest scores (English, Mathematics, Reading, and Science Reasoning), for the first phase. Additionally, they collected data to determine first-year academic performance, measured by first-year grade point average, retention and first-year credit earned.

Several studies show the ACT Composite test score as a reliable predictor of first-year success in college (ACT Assessment: Technical Manual 1997, Galloway 1995, House and Keeley 1997, Kern, Fagley, and Miller 1998, Rodriguez 1996, Schade 1977, Snyder and Elmore 1983). House and Keeley (1997) also found that the ACT Composite Test score was a valid assessment for Native American students as a predictor of college success, while Rodriguez (1996) found similar results for Mexican American students.

In a 1995 study conducted by ACT on the reliability of the ACT Assessment scores, reliability coefficients were high (at .85 to .92 on each subtest and a coefficient of .96 on the ACT Composite test score). To ensure content validity, ACT provides ongoing assessment of the content validity by ensuring that the “test content is representative of current high school and university curricula” (37).

Analyses

Researchers designed this study to compare the first-year academic performance of home school graduates and traditional high school graduates measured on the following four dependent variables: (1) grade point average; (2) retention; (3) ACT Test scores; and (4) credits earned in their first year of college.

The final section determined if there were statistical differences between home school graduates and traditional high school graduates on the following three variables: (1) gender, (2) race/ethnicity (minority versus non-minority students), and (3) institutional type (college versus university enrolled).

Results

Table 1: Number of home school graduates and traditional high school graduates by gender, ethnicity, and institutional type
Researchers rejected eight of the nine null hypotheses.

Table 1 shows the equivalence of the groups on gender, race/ethnicity (minority versus non-minority), and college or university enrolled.

The researchers found no differences between first-year mean grade point average, first rear retention rate, and the number of credits earned between homeschooled and public schooled students. The homeschool first-year mean grade point average 2.78 and traditional high school graduates’ mean grade point average at 2.59 [t (106) = .923, p = .358]. As to first-year retention, 42 students were retained for both homeschool and traditional high school graduates after their first semester [X² (1, N = 108) = .130, p = .818]. Homeschool graduates earned 23.85 credit hours compared to 22.69 credit hours earned in the first year for traditional high school graduates [t (106) = .554, p = .581].

Table 2: ACT composite scores for home school and tradititional high school graduates.

Although eight of the nine hull hypotheses were rejected, Table 2 shows that the ACT Composite, Mathematics and Science subtests scores of home school graduates approached statistical significance compared to the same scores for traditional graduates. Because the previous research did not support home school graduates consistently outperforming their traditional high school peers, the researchers did not predict that home school graduates would have performed better than traditional high school graduates. If the researchers would have expected this difference and tested the variables as a one-tailed test, home school graduates would have scored statistically higher than their peers on the ACT Composite, Mathematics and Science subtests scores.

table 3

Finally, researchers conducted a test to determine if first-year grade point average, first-year earned credit hours, first-year retention, and the ACT Composite test score correlate.

Table 3 shows a strong link between ACT Composite test scores and the other three variables: retention, cumulative grade point average, and cumulative credits earned. Retention and cumulative credit hours earned were strongly connected. Students’ ACT Composite test scores generally predicted first-year retention, first-year grade point average and cumulative credits earned. Logically, retained students earned more cumulative credits hours.

Conclusions

Families who home school their children should not feel that the education they are providing is inferior to the traditional K-12 education of their neighborhood peers.

Although not statistically significant, the average first-year GPAs, credits earned in the first year, ACT Composite test scores, and ACT English, Mathematics, Reading, and Science and Reasoning subtests for home school graduates were all higher than traditional high school graduates. Although the sample was relatively small, the ACT Composite test score results for home school graduates was an average of 22.8, which matched identically to the national average in 2000 for home school students (ACT 2000). The national average for all students in 2000 was 21, which was nearly identical to the 21.3 average for the traditional high school graduate.

The academic performance analyses indicate that home school graduates are as ready for college as traditional high school graduates and that they perform as well on national college assessment tests as traditional high school graduates. The results of this study are also consistent with other studies on the academic performance of home school students compared to traditional high school graduates (Galloway 1995, Gray 1998, Jenkins 1998, Mexcur 1993). These results also suggest that a parent-guided K-12 education does not have a negative effect on a student’s college success.

With the anticipated growth in the home school population, state policy makers, home school advocates, and the families who educate their children at home should also benefit from this study on the academic performance of home school graduates.

References
  • ACT (2000). 2000 ACT national and state scores. Retrieved March 1, 2002, from actorg/news/data/00/t9.html
  • American College Testing Program (1997). Validity evidence for the tests of educational development. In ACT Assessment Technical Manual (pp. 37-88). Iowa City, IA: ACT.
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.) Hillsdale, NJ: Lawrence Erlbaum Associates.
  • Frost, E. A., Jr. (1987). A descriptive study of the academic achievement of selected elementary school-aged children educated at home in five Illinois counties. Doctoral dissertation, Northern Illinois University, 1987.
  • Galloway, R. A. S. (1995). Home schooled adults: Are they ready for college? Paper presented at the Annual Meeting of the American Educational Research Association, San Francisco, CA.
  • Gray, D. W. (1998). A study of the academic achievements of home-schooled students who have matriculated into post-secondary institutions. DAI, 59, 021, (1998) 0418 Doctoral dissertation, University of Sarasota, Sarasota, FL,98.
  • Hill, P. T. (2000). Home Schooling and the Future of Public Education. Peabody Journal of Education, 75, 20-31.
  • House, J. D. and Keeley, E. J. (1997). Predictive validity of college admissions test scores for American Indian students. Journal of Psychology, 131, 572-575.
  • Jenkins, T. P. (1998). The performance of home schooled students in community colleges. Doctoral dissertation, Texas A&M University-Commerce, 1998.
  • Kern, C. W., Fagley, N. S., and Miller, P. M. (1998). Correlates of college retention and GPA: Learning and study strategies, testwiseness, attitudes, and ACT. Journal of College Counseling, 1, 26-35.
  • Knowles, G. J., Marlow, S. E., and Muchmore, J. A. (1992). From Pedagogy to Ideology: Origins and Phases of Home Education in the United States, 1970-1990. American Journal of Education, 195-235.
  • Lines, P. M. (1996). Home Schooling Comes of Age. Educational Leadership, 54, 63-67.
  • Mayberry, M., Knowles, G. J., Ray, B., and Marlow, S. E. (1995). Home Schooling: Parents as Educators. Thousand Oaks, CA: Corwin Press, Inc.
  • Mexcur, D. (1993). A comparison of academic performance among public school graduates, conventional Christian school graduates, accelerated Christian school graduates, and home school graduates in three Christian colleges. Doctoral dissertation, Bob Jones University, Greenville, SC, 1993.
  • Osborn, S. B. (2000, August). Capitalizing on the growing trend of home schooling. Chain Store Age, 76, 30.
  • Rakestraw, J. F. (1987). An analysis of home schooling for elementary school-aged children in Alabama. Doctoral dissertation, University of Alabama, Tuscaloosa, AL, 1987.
  • Ray, B. D. (1990). A nationwide study of home education: Family characteristics, legal matters, and student achievement. Salem, OR: National Home Education Research Institute.
  • Ray, B. D. (2000). Home Schooling on the Threshold: A Survey of Research at the Dawn of the New Millennium. 1999. Salem, OR, NHERI Publications.
  • Ray, B. D. (2000). Home Schooling for Individuals’ Gain and Society’s Common Good. Peabody Journal of Education, 75, 272-293.
  • Rodriguez, N. (1996). Predicting the academic success of Mexican American and White college students. Hispanic Journal of Behavioral Sciences, 18, 329-343.
  • Rudner, L. M. (1999). Scholastic achievement and demographic characteristics of home school students in 1998. Education Policy Analysis Archives, 7.
  • Schade, H. C. (1977). The ability of the ACT and MCPT to predict the college grade point average (Rep. No. ERIC Document Reproduction Service No. ED 188 683). Neosho, MO: Crowder College.
  • Snyder, V. and Elmore, P. B. (1983). The validity of the ACT and descriptive tests of language skills for developmental students over a four-year college program (Rep. No. ERIC Document Reproduction Service No. 228 309).
  • Wartes, J. (1990). Recent results from the Washington Homeschool Research Project. Home School Researcher, 6, 1-7.