A sound investment: The benefits of large-scale learning assessments

As delegates gather in New Delhi for the South Asia Regional Conference on Using Large-Scale Assessments to Improve Teaching and Learning, a new synthesis paper from the UIS makes the case for greater investment.

April 25, 2018 by Silvia Montoya, UNESCO Institute for Statistics, and David Coleman, Australian Department of Foreign Affairs and Trade
|
10 minutes read
Children waiting in line in a school in Sierra Leone. Credit: GPE/Stephan Bachenheimer
Children waiting in line in a school in Sierra Leone.
Credit: GPE/Stephan Bachenheimer

.flat-table-container { background: #fff; overflow-x: auto; margin: 10px auto 30px auto; } .flat-table-container, .flat-table { width: 100%; } .flat-table, .flat-table th, .flat-table td { border-collapse: collapse; } .flat-table thead th { font-size: 18px; vertical-align: middle; white-space: nowrap; } .flat-table tbody th, .flat-table tbody td, .landing-list .landing-detail-content li { font-size: 14px !important; } .flat-table ul { margin: 0 !important; padding: 0 0 0 10px !important; } .flat-table th, .flat-table td { border: 1px solid #ccc; padding: 15px; text-align: left; vertical-align: top; } .flat-table thead th, .flat-table thead td { background: #ddd; font-weight: bold; } .flat-table tbody tr:nth-child(odd) th { background: rgba(0,0,0,0.03); } .flat-table tbody tr:nth-child(even) td { background: rgba(0,0,0,0.03); } .flat-table tbody th { background: #f0f0f0; font-weight: bold; } .photo-center img { border: 1px solid #f2f2f2; } @media only screen and (min-width: 0px) and (max-width: 768px) { .flat-table thead th { font-size: 16px; white-space: normal; } }

It's time to make a much stronger case for investment in the data we need to reach Sustainable Development Goal 4 (SDG 4) on education. The clock is ticking towards the 2030 deadline for quality education for every child and adolescent but, as recent data show, there are still too many out of school and too many who are not learning what they need to know.

Such evidence provides a much-needed 'carrot and stick.' Good data is a very attractive carrot, helping decision makers to target their available resources for maximum impact. Strong evidence is also a useful stick, helping to hold governments and key stakeholders to account for their policies and investment choices.

Making the case for large-scale assessment of learning

There is, however, a problem – particularly on measuring learning outcomes. Not all countries conduct national assessments or participate in cross-national (regional or international) assessments of learning. This poses a real challenge for the basic information needed to monitor and report on progress towards SDG 4. So it's time to set out the financial advantages of educational assessments, and most particularly the large-scale cross-national assessments, that can support the pursuit of national education priorities.

A new synthesis paper from the UNESCO Institute for Statistics (UIS) explains how many countries already use data from these large-scale assessments to enhance their educational practice and policy. It also spells out the implications for investment in education resources and the potential challenges.

The paper draws on the Review of the Use of Cross-National Assessment Data in Educational Practice and Policy and builds on the UIS Investment Case for SDG 4 Data, which compares the resources needed to produce the global and thematic indicators in relation to the costs of doing business as usual. It is also aligned with work by Australia's Department of Foreign Affairs and Trade (DFAT) to unpack what actually works to get kids into school, keep them there and learning.

Investments in cross-national assessments have had clear benefits, as shown in the table below. In these examples, we have seen more resources being targeted to various aspects of education

Resources invested on the basis of cross-national assessments

Area of resource investmentExamples of actions taken by countries

Teachers, training, and professional development

  • New online in-service professional development programs for teachers and leaders
  • Teacher training workshops/integrating technology into classroom activities
  • Incentives to participate in in-service teacher training programs, encouraging high-performing students to join the teaching profession through incentives, and increasing salaries
  • Improving teachers' pedagogical skills and teaching literacy
  • Incentives for teachers

Education funding

  • Increasing budget for education to provide primary and secondary education with additional financial resources to reduce class size, raise teacher salaries, and develop infrastructure
  • Several initiative investments to strengthen literacy development, including a generous Quality Education Fund
  • Funding programs to promote reading and literacy
  • Donors helping to stimulate a policy response in terms of resource allocation in part through the administration of the assessment
  • Interventions based on the findings, which are also used to influence policy dialogue and action

Education materials and time resources

  • An increase in classroom instruction time dedicated to mathematics leading to improved scores
  • Reduction in teacher shortages as a result of policy changes and efforts
  • Hybrid assessment data being incorporated into a national assessment system to inform curriculum and instruction
  • Hybrid assessment data to inform the development of materials and strategies for teaching and continuous assessment
  • Influencing the national educational program, resulting in the allocation of significant funding to the building of classrooms, providing instructional materials, and addressing out-of-school children through non-formal education programs

The variations in the extent to which countries have benefited from cross-national assessments only serve to reinforce the argument for more investment, with the countries making the greatest use of the findings reaping the greatest benefits.

Figure 1 shows the geographic distribution of large-scale learning assessments. The data gaps are apparent, with many countries – particularly in South Asia and parts of Africa – not participating in any form of cross-national assessment. Some gaps are linked to lack of coverage: for example, a regional assessment for South Asia does not yet exist.

Some gaps are linked to national capacity issues, with countries lacking the financial or technical capacity to administer national learning assessments or join cross-national learning assessments. We must also recognize that some countries are reluctant to join regional or international assessments out of concern of being compared to those with better resourced education systems. The vast majority of non-participating countries are either low-income or lower-middle-income countries.

Figure 1. Geographic distribution of large-scale learning assessments

Source: UIS Quick Guide #2: Making the Case for a Learning Assessment

Source: UIS Quick Guide #2: Making the Case for a Learning Assessment

Figure 2 summarizes the degree to which countries have used cross-national and regional assessments to shape their education systems. The darker the blue: the greater the application. For example, New Zealand is making more use of – and gaining more from – cross-national assessment data than Canada and the United States. They, in turn, are benefiting more than Brazil and the Russian Federation. A comparison between Figures 1 and 2 shows that some countries participate in large-scale assessments but do not apply the data from these assessments directly to educational policy and planning.

Figure 2. Countries using cross-national assessments in educational policy and practice

Figure 2. Countries using cross-national assessments in educational policy and practice

Source: Review of the Use of Cross-National Assessment Data in Educational Practice and Policy

Better data for better education

By showing the clear benefits, we want to help mobilize the necessary resources – whether domestic or supported by donors – to close the data gaps on cross-national assessments, and to emphasize the financial and student performance benefits of applying the lessons from assessment results to targeted policy making and to operational practice. This would be a 'win-win' for the effectiveness of national education systems and for the production of internationally comparable data.

We already know the immense value of education itself. Study after study has confirmed the vast benefits of education for each individual and for every society. We know that education plays a critical role in helping people to lift themselves out of poverty, improve their own quality of life and increasing their chances of contributing to the economic well-being of their communities and countries.

It is high time we positioned the collection and meaningful use of education data as a crucial part of this education narrative – as one of the most fundamental prerequisites for progress towards the world's education goals.

Related blogs

Comments

Although we value the documents and information you put out, one aspect that always puzzles us so much is that even with all the time and effort that is put into scale, Evidence based info and M&E, the game doesn’t seem to change as much as it should or could!

As a small Foundation we have found that the critical missing factor in most initiatives or changes is that the person or individuals within each system are not taken enough care of! Nourishment, nurturing and enabling people to understand who they are and what life is all about should be paramount. And top of this list is for teachers to be supported in this realm too!

So large scale increase in teaching of STEM, extra lessons or technology are not going to change anything fundamentally in our view, and we’d love to have an opinion or some feedback (or links for us to process) that show what GP4E is doing in this critical realm.

Leave a comment

Your email address will not be published. All fields are required.

The content of this field is kept private and will not be shown publicly.

Plain text

  • Global and entity tokens are replaced with their values. Browse available tokens.
  • No HTML tags allowed.
  • Lines and paragraphs break automatically.
  • Web page addresses and email addresses turn into links automatically.