Incentive Matters!—The Benefit of Reminding Students About Their Academic Standing in Introductory Economics Courses

In this article, the authors illustrate how incentives can improve student performance in introductory economics courses. They implemented a policy experiment in a large introductory economics class in which they reminded students who scored below an announced cutoff score on the midterm exam about the risk of failing the course. The authors employed a regression-discontinuity method to estimate the causal impact of their policy on students’ performance on the final exam. The results suggest that the policy had a significant impact on students’ performance on the final exam. In fact, the gain in test scores was sufficient to boost a student's overall course grade by one letter grade.     

Do Morning Classes Improve Student Learning of Microeconomics Principles?

This article analyzes the impact of class time on students’ grades by using data from Middle Tennessee State University. The data cover a period of six years and are based on a sample of 5803 individuals who enrolled in 133 sections of principles of microeconomics. To identify the causal impact of class time on students’ grades, I used a bootstrapping method which allowed assigning measures of accuracy to sample estimates. For males, the estimated coefficients were negative and statistically significant at the 10% level, and the coefficients suggested that a male student in an afternoon class could expect to earn a letter grade that is 0.029 points lower than he would have earned by taking the class in the morning. For females, the estimated coefficients were not statistically significant.     

What's in a grade? Grading policies and practices in principles of economics

This study created an experimental design with which students can empirically assess their risk behavior with respect to exam grades within an expected utility framework. Specifically, the authors analyzed students’ risk preferences associated with taking exams and earning a “risky” unknown grade versus not taking exams and instead obtaining a “sure” grade. Students have grade-choice decisions in nonhypothetical situations that impact their actual exam grades. Estimates indicate that the more risk-averse a student is, the more willing he or she is to accept a lower certain grade and not take an exam than to run the risk of actually taking it. We believe that this experimental setup and its binding results make it an easy but effective way of teaching the obtuse concept of risk aversion.     

Accountability,incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools

The recent federal education bill, No Child Left Behind, requires states to test students in grades 3 to 8 each year and to judge school performance on the basis of these test scores. While intended to maximize student learning, there is little empirical evidence about the effectiveness of such policies. This study examines the impact of an accountability policy implemented in the Chicago Public Schools in 1996–1997. Using a panel of student-level, administrative data, I find that math and reading achievement increased sharply following the introduction of the accountability policy, in comparison to both prior achievement trends in the district and to changes experienced by other large, urban districts in the mid-west. However, for younger students, the policy did not increase performance on a state-administered, low-stakes exam. An item-level analysis suggests that the observed achievement gains were driven by increases in test-specific skills and student effort. I also find that teachers responded strategically to the incentives along a variety of dimensions—by increasing special education placements, preemptively retaining students and substituting away from low-stakes subjects like science and social studies.     

Early Tracking and the Misfortune of Being Young

Recent research suggests that the relative age of a student within a grade has a causal effect on educational achievement, and that this effect fades with the duration of schooling. In this study, we estimate the causal relative‐age effect on track choice in Austria, a country where students are first tracked in grade 5 (at the age of 10 years), and again in grade 9. We find a strong positive relative‐age effect on track choice in grades 5–8. The age effect persists beyond grade 8 for students from less‐favorable socioeconomic backgrounds and students in urban areas.     

A Comment on “Grade Inflation: A Way Out”

The authors develop an original measure of learning in higher education, based on grades in subsequent courses. Using this measure of learning, they show that student evaluations are positively related to current grades but unrelated to learning once current grades are controlled. They offer evidence that the weak relationship between learning and student evaluations arises, in part, because students are unaware of how much they have learned in a course. They conclude with a discussion of easily implemented, optimal methods for evaluating teaching.     

Starting Wages Respond to Employer's Risk

Firms hiring new graduates face uncertainty on the future productivity of workers. Theory suggests that starting wages reflect this, with lower pay for greater uncertainty. We use the dispersion of exam grades within a field of education as an indicator of the unobserved heterogeneity that employers face. We find solid evidence that starting wages are lower if the variance of exam grades is higher and higher if the skew is higher: employers shift the cost of productivity risk to new hires, but pay for the opportunity to catch a really good worker. Estimating the extent of risk cost sharing between firm and worker shows that shifting to workers is larger in the market sector than in the public sector and diminishes with experience.     

DOES TEACHER QUALITY AFFECT STUDENT PERFORMANCE? EVIDENCE FROM AN ITALIAN UNIVERSITY

In this paper, we analyse whether the characteristics of university teaching staff matter with regard to students' performance and interest in the discipline. We use data on about 1000 students enrolled on the first-level degree course in business and economics at a medium-sized Italian university. Thanks to the random assignment of students to different teaching classes during their first year, we are able to analyse the effect that teachers with different characteristics, in terms of experience and research productivity, produce both on students' performance, measured in terms of the grades obtained at subsequent examinations, and on courses chosen. Our results suggest that teacher quality has statistically significant effects on students' grades in subsequent courses. These effects are also robust after controlling for unobserved individual characteristics. On the other hand, we find less clear evidence when relating teacher quality to student involvement with a subject. It emerges that research productivity does not produce a statistically significant effect on the probability of a student undertaking additional courses in a subject, while more experienced teachers have a negative impact. However, also this effect does not become statistically significant when we run separate regressions for different disciplines.     

Industrial actions in schools: strikes and student achievement

Many jurisdictions ban teacher strikes on the assumption that they negatively affect student achievement, but there is surprisingly little research on this question. The majority of existing studies make cross‐section comparisons of the achievement of students who do or do not experience a strike. They conclude that strikes do not have an impact. I present new estimates of this impact of strikes using an empirical strategy that controls for fixed student characteristics at the school cohort level, and a sample of industrial actions by teachers in the province of Ontario. The results indicate that teacher strikes in grades 5 or 6 have a negative, statistically significant impact on test score growth between grade 3 and grade 6. The largest impact is on math scores: 29% of the standard deviation of test scores across school/grade cohorts.     

An Evaluation of Collaborative Problem Solving for Learning Economics

The use of student evaluations of courses and professors has been examined by Professor Kelley in an effort to learn more about the factors that appear to be associated with “good” or “poor” ratings. Using student evaluations of the Principles of Economics course at the University of Wisconsin in Madison, Kelly investigated two dependent variables: measures of course evaluation and measures of professor evaluation. Eleven independent variables were included in the analysis, and two different regression models were used. The results are tentative, of course, but the study reveals some interesting findings on the impact of teaching assistants, the student's expectation of his course grade, and the professor's propensity to be generous or niggardly in awarding high grades.     

The Effect of Attending a Small Class in the Early Grades on College-test Taking and Middle School Test Results: Evidence from Project Star

This paper provides a long-term follow-up analysis of students who participated in the Tennessee STAR experiment. In this experiment, students and their teachers were randomly assigned to small, regular-size, or regular-size classes with a teacher aide in the first four years of school. We analyse the effect of past attendance in small classes on student test scores and whether they took the ACT or SAT college entrance exam. Attending a small class in the early grades is associated with an increased likelihood of taking a college-entrance exam, especially among minority students, and somewhat higher test scores.     

EXAM SCHEDULING AND STUDENT PERFORMANCE

This paper uses data from a single School of a UK university to estimate the impact of a switch from end‐of‐semester to end‐of‐year final exams on student performance. The identification strategy exploits the fact that while the timing of final exams changed, the timing of mid‐term exams remained the same. Estimates are based on a difference‐in‐differences methodology that compares final and mid‐term exam scores after the switch, with final and mid‐term exam scores before the switch. The empirical findings suggest that the shift of final exams to the end of the academic year had a negative effect on student achievement. Many changes in higher education are often done on the basis of financial, administrative or ideological considerations, underestimating the magnitude of their effect on student learning and student performance.     

Tenure system and its impact on grading leniency,teaching effectiveness and student effort

This study provides new evidence of the causal effect of the tenure system on grading leniency, teaching effectiveness, and student effort by taking advantage of a natural experiment in one public university in Taiwan. The results show that assistant professors subject to the tenure system tend to grade more leniently and fail fewer students, as opposed to assistant professors not affected by the policy. The tenure policy lowers the probability of failing a class by 15%. Teaching effectiveness measured by the valued-added model also falls significantly by 0.32 standard deviation of the average grades in subsequent courses, roughly 6.6% of the sample means. The effect on student effort also is significant. Study time and class absences decline by 3 and 10%, respectively. The results suggest that the tenure system reduces teaching effectiveness and leads to lenient grading. Moreover, although used as a measure of teaching effectiveness in tenure promotion, student evaluation of teaching cannot truly reflect teaching quality.     

Schooling as a Lottery: Racial Differences in School Advancement in Urban South Africa

This paper analyzes the large racial differences in progress through secondary school in South Africa. Using recently collected longitudinal data we find that grade advancement is strongly associated with scores on a baseline literacy and numeracy test. In grades 8-11 the effect of these scores on grade progression is much stronger for white and coloured students than for African students, while there is no racial difference in the impact of the scores on passing the nationally standardized grade 12 matriculation exam. We develop a stochastic model of grade repetition that generates predictions consistent with these results. The model predicts that a larger stochastic component in the link between learning and measured performance will generate higher enrollment, higher failure rates, and a weaker link between ability and grade progression. The results suggest that grade progression in African schools is poorly linked to actual ability and learning. The results point to the importance of considering the stochastic component of grade repetition in analyzing school systems with high failure rates.     

Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS

We estimate the effect of class size on student performance in 11 countries, combining school fixed effects and instrumental variables to identify random class-size variation between two adjacent grades within individual schools. Conventional estimates of class-size effects are shown to be severely biased by the non-random placement of students between and within schools. While we find sizable beneficial effects of smaller classes in Greece and Iceland, we reject the possibility of even small effects in four countries and of large beneficial effects in an additional four countries. Noteworthy class-size effects are observed only in countries with relatively low teacher salaries.     

SYSTEMATIC INFLUENCES ON TEACHING EVALUATIONS: THE CASE FOR CAUTION*

In this paper, we examine eight years of Quality of Teaching (QOT) responses from an Economics Department in an Australian University. This is done to determine what factors, besides the instructor, have an impact on the raw average student evaluation scores. Most of the previous research on student ratings has been conducted in the US. One significant difference between US and Australian tertiary education is that, on average, the number of foreign undergraduate students in Australia is ten times the number in US institutions. We find that cultural background significantly affects student evaluations. Other factors that have an influence on the average QOT score include: year level; enrolment size; the quantitative nature of the subject; the gender of the student; fee‐paying status by gender; course of study; the differences between the course mark and previous marks; the quality of workbooks; the quality of textbooks; and the QOT score relative to those in other subjects taught at the same time. In addition, average QOT scores for instructors who have taught in a mix of subjects are similar to those based on scores adjusted to account for subject and student characteristics.     

On the peer effects of star students

We estimate the effect that star students have on their siblings’ learning outcomes, measured by their high school grade point average (GPA) and their math grades. To this end, we couple administrative school data on grades with an unusual natural experiment in Peru that generates exogenous variation in the presence of star students at home. We find that star students increase their siblings’ GPA by 0.33 SDs and their math grades by 0.22 SDs. The effect size is inversely related to number of siblings, suggesting that the remaining siblings act as substitutes for the star student.     

Public Debt,Economic Growth and the Real Interest Rate: A Panel VAR Approach to EU and OECD Countries

ABSTRACT

We investigate the causal relationship between public debt ratios and economic growth rates for 31 EU and OECD countries. We estimate a panel VAR model that incorporates the long-term real interest rate on government bonds as a vehicle to transmit shocks in both the public debt to GDP ratio and the economic growth rate. We find no causal link from public debt to growth, irrespective of the levels of the public debt ratio. Rather, we find a causal relationship from growth to public debt. In high-debt countries, the direct negative impact of growth on public debt is enhanced by an increase in the long-term real interest rate, which in its turn decreases interest-sensitive demand and leads to a further increase in the public debt ratio.     

The impact of charter school attendance on student performance

We employ a panel of individual student data on math and reading test performance for five cohorts of students in Texas to study the impact of charter school attendance. We control for school mobility effects and distinguish movement to a charter school from movement within and between traditional public school districts. We find students experience poor test score growth in their initial year in a charter school, but that this is followed by recovery in the subsequent years. Failure to account for this pattern may lead to potentially misleading estimates of the impact of charter attendance on student achievement. Students who remain in charters largely recover from the initial disruption within approximately 3 years, and there is weak evidence that there may be overall gains from charter attendance within this period. Furthermore, students who return to traditional public schools after just 1 or 2 years in a charter do not appear to suffer a lasting negative impact despite their poor average performance in their first year of charter attendance.