How Pisa became the world's most important exam

Pupil in China in lesson taught by astronaut Rising star: Chinese pupil in lesson taught live from space by a Chinese astronaut

"Your education today is your economy tomorrow," says Andreas Schleicher from the Organisation for Economic Co-operation and Development, who has become one of the world's most influential figures in education.

And next week, the state of today's education standards across the developed world will be revealed with the publication of the results of the OECD's Programme for International Student Assessment, better known as the "Pisa tests".

This mammoth, three-yearly exercise, will produce international education rankings for more than 60 countries and dozens of regional administrations, based on tests in reading, maths and science taken by more than 500,000 15-year-olds.

And in the future it could get even bigger, with Mr Schleicher saying he wants to develop OECD rankings for universities.

Global league table

This latest world cup of school standards will reveal whether the Asian school systems, such as in Shanghai in China, Singapore and South Korea, remain world-beaters.

Shanghai mother meets son after gaokao exam Mother meets son after exam: Shanghai was top performer in the 2009 Pisa tests

And will the old Western powers, such as the US, the UK and France, remain stuck in the "must do better" category of this global classroom?

But what's the point of this vast piece of number crunching?

Mr Schleicher, now courted and quoted by education ministers, says the idea began in the 1990s with the simple recognition that governments were being compared on how much cash they were spending on education, rather than levels of achievement.

It was all about what was going in and nothing about what was coming out.

So the idea was launched for pupils in different countries to take pen and paper tests in core subjects and see how they compared.

And the name Pisa was chosen, not for any link to the Italian city, but because it was an acronym that was spelt the same in English and French.

Pisa topping

Mr Schleicher says that in a globalised world the key comparisons are with other countries - and this is true for education as much as economics.

Andreas Schleicher, OECD Andreas Schleicher wants to extend OECD rankings to higher education

"Your country's competitiveness and your individual job prospects are heavily influenced by what happens in other countries," he says.

"In a global economy improvement by national standards is not a measure of success. You compete globally."

Only relying on national exams, where the grades seem to keep improving, is a dishonest disservice to young people, he argues.

"It's like telling a disadvantaged student in your classroom, 'It doesn't matter how you compare with people in other schools, I'll give you a good mark because you're doing the best you can.'

"That's very nice, but once the student gets out into the labour market they're going to feel the brunt of reality."

"It is very important to know how well our students are prepared for a global economy."

Bringing bad news

This hasn't always made Pisa many friends. It can puncture the idea that everything is getting better.

The first victim of "Pisa shock" was Mr Schleicher's own country, Germany, a country that had nurtured a self-image of a high-performing education system.

US Dept of Education The US Department of Education has faced tough messages from Pisa results

But the Pisa results from 2000 suggested that it was only mediocre, causing a storm of controversy and national soul-searching. A German newspaper described the experience as an "instructive disaster".

Among the starkest revelations has been the decline of the US school system. This former education superpower has been caught up and left behind by many other countries, particularly in Asia.

This was distasteful medicine and Mr Schleicher says that the US administration was deeply unhappy with the 2006 results and was trying to apply pressure on the OECD.

The US politician who intervened to defend the importance of publishing the results was Ted Kennedy, says Mr Schleicher. Kennedy, who had chaired the senate committee on education, had become very supportive of the Pisa project.

"It was Senator Kennedy who saved my life at the OECD," he says.

In Italy, the 2009 results revealed another hidden weakness. While top grades in national exams were spread evenly across the country, the Pisa tests showed that pupils in the north were performing at a much higher level.

This meant that it was much easier to get a high grade in the south of Italy - and since public jobs depended on such grades, it represented an "incredible unfairness".

Without the external measurement of Pisa such problems would remain invisible.

There are other critics who warn against the impact of the narrow focus of Pisa - which ranks school systems on a very limited number of measures.

The influential UK head teacher, Anthony Seldon, warned of governments becoming "increasingly mesmerised and bedazzled" by the Pisa tests.

"Such tests are deeply flawed and their impact is profoundly damaging to young people," he says.

Rise of Asia

The tests have also revealed the changing face of the education world. Pisa has recorded the rise and rise of countries and cities in Asia, such as South Korea, Singapore, Hong Kong and Shanghai, where investment in education has been used as a way of fast-forwarding their economies.

Graduation ceremony in Shanghai Class of 2013: Almost seven million Chinese students graduated this summer

Looking to England, Mr Schleicher says he welcomes the readiness of Education Secretary Michael Gove to "open all the cupboards and see what's inside, see what the problems are".

"That's an essential starting point. You can debate about some of the medicine, but at least there's a serious search for the issues and challenges."

He says schools in England should move away from an "industrial mindset" and teachers should be given a "high degree of professional autonomy".

But Mr Schleicher remains unconvinced by changes to the national curriculum.

So how can international comparisons in education standards ever be really fair? Is it meaningful to compare countries as different as Finland, Peru and Vietnam?

Mr Schleicher is a robust defender of such comparisons, saying whether or not they are fair, young people from all those countries are competing with one another in a globalised economy. The skills they learn are going to be hugely important to their life chances.

"It's not about the elite, it's the poor who are affected by globalisation, they are the ones who are going to lose their jobs because they're not keeping up with the skills on the other side of the world."

In terms of the methodology, the test results are based on a representative sample of around 5,000 pupils in each school system, overseen by the OECD. Some have bigger numbers, with more than 12,000 in the UK and 38,000 in Italy.

The tests are designed by Australian researchers with the requirement that questions are culturally neutral, as relevant in Tunisia as Estonia.

The forthcoming results will also provide a much more detailed picture of regional differences. It will show how US states such as Massachusetts or regions within Spain and Italy would have scored if they were ranked as countries.

But this isn't just one giant data fest. There is a human purpose to all this, says Mr Schleicher.

These tests show the gaps in some basic skills needed by young people. And once these youngsters have left school without these skills, he says, it is "very hard to fix retrospectively".

"In the US the whole pipeline is broken and in Europe there are 80 million who can't read better than a 10-year-old child.

"What are you going to do with these people. That's the real challenge.

"The countries with good school systems have great assets."

How important are international tests? Do they give a fair comparison between schools? What else could they show?

If you are happy to be contacted by a BBC journalist please leave a telephone number that we can contact you on. In some cases a selection of your comments will be published, displaying your name as you provide it and location, unless you state otherwise. Your contact details will never be published. When sending us pictures, video or eyewitness accounts at no time should you endanger yourself or others, take any unnecessary risks or infringe any laws. Please ensure you have read the terms and conditions.

Terms and conditions

More on This Story

More Business stories

RSS

BBC Business Live

  1.  
    FOOTBALL FUNDS 12:52:
    Di Maria

    As the Premier League's transfer deadline day gets into full swing, records are being smashed left, right and centre. English clubs have spent more than £745m in the latest buying spree, according to Deloitte. In comparison, last year, teams spent a total of £630m. You can follow the latest transfer news on the BBC Sport website.

     
  2.  
    MARKET UPDATE 12:38:

    European stocks have slid somewhat, following weak manufacturing data from the Eurozone. The crisis in Ukraine could also be harming sentiment.

    • London's benchmark FTSE 100 index lost 0.10% to 6,812.65
    • Frankfurt's DAX 30 index dropped 0.19% to 9,451.82
    • Paris's CAC 40 index dipped 0.34% to 4,365.64
     
  3.  
    LAKE LIVING 12:32:

    Copeland, in the Lake District, is last place left in Britain with "easily affordable" housing, according to the TUC. It says the average house price in the area is less than three times the average annual salary.

     
  4.  
    LISTEN AGAIN 12:15: World Service
    Russia

    The conflict in Ukraine is intensifying and the EU is preparing a new wave of sanctions against Russia, but what leverage does it have left? Business Daily talks to Lilit Gevorgyan, senior Russian analyst at IHS, who says Europe's dependence on Russian gas will limit their room to move.

     
  5.  
    GERMAN SURPLUS 12:00:

    Germany posted a surplus in its public finances for the first six months of 2014, while economic growth faltered. The country's local and national budgets had a surplus of 16.1bn euros (£12.7bn), helped by high employment.

     
  6.  
    TRUCK WARNING 11:40:
    Trucks

    The Daily Mail reports that lorry drivers are being ordered to avoid the French port of Calais, because of confrontations with migrants - some of them armed - who are trying to get to Britain. The Times says Britons returning from summer holidays with caravans and motor-homes are also being targeted by groups of migrants trying to break into their vehicles.

     
  7.  
    UK MANUFACTURING Via Email Robin Johnson head of diversified industrials at law firm Eversheds

    "Everything still points to a strong and sustainable recovery in manufacturing in the UK. The weakness of the eurozone is a negative impact as is the strength of sterling. Long term investment in training and research and development must also be maintained... While today's numbers may show a slight dip, the overall long term prognosis is very positive."

     
  8.  
    RAIL OVERTIME BAN 11:12:

    Rail managers plan a three-week ban on weekend overtime which they say may disrupt travel across the network. More than 2,000 members of the Transport Salaried Staffs Association (TSSA) are protesting at a below-inflation pay offer and will begin industrial action on Friday.

     
  9.  
    RUSSIAN SANCTIONS 10:55:
    Russian President Vladimir Putin

    Russian President Vladimir Putin said he hopes "common sense" will win the day concerning the prospect of more sanctions, according to Russian news agency Interfax. "I hope that common sense will prevail and we will work in a normal modern way, and that neither we nor our partners will bear the costs of these mutual jabs," the agency reported him as saying.

     
  10.  
    SCHOOL COMPUTING Via Twitter Rory Cellan-Jones Technology correspondent

    tweets: New computing curriculum in England comes in this term and will mean children as young as 5 will learn about algorithms - blog from me later

     
  11.  
    NATO COMES TO NEWPORT 10:25:
    Celtic Manor Resort, Newport

    "Every hotel between Swansea and Swindon" will be fully booked as a result of the Nato summit coming to Newport in Wales. That's according to Simon Gibson, director of the Celtic Manor resort, where the event will take place on Thursday. He added there could be "lucrative benefits if Wales showcases itself correctly" and that the summit was a "massive opportunity" for the Welsh economy.

     
  12.  
    EUROZONE MANUFACTURING 10:10:
    Flags

    News from the Eurozone is no better, alas. Manufacturing growth slowed to a 13-month low in August, as the PMI reading dipped to 50.7 - down from 51.8 in July. New orders dwindled and factories suffered amid rising tensions between the EU and Russia over Ukraine.

     
  13.  
    HEADLINES
    • UK and EU manufacturing growth slows
    • Fund manager abandons HSBC over fines
    • Mortgage approvals fall in UK
     
  14.  
    UK MANUFACTURING 09:56:

    The UK's manufacturing industry grew at the slowest rate in 14 months in August, following a drop in new orders. The Manufacturing Purchasing Managers' Index, or PMI, fell to 52.5, the lowest since June last year. A reading above 50 indicates growth.

     
  15.  
    WOODFORD ABANDONS HSBC 09:39:
    HSBC

    Neil Woodford, one of the UK's most well-known fund managers, has sold his stake in HSBC. "I am worried that the ongoing investigation into the historic manipulation of Libor and foreign exchange markets could expose HSBC to significant financial penalties," he said on his website. Mr Woodford had 2.68% of his fund's assets invested in HSBC, a package worth £64m at the time of sale.

     
  16.  
    UK MORTGAGES 09:33:

    The Bank of England says British mortgage approvals fell slightly in July compared with the previous month, to 66,569. In January, the measure reached 76,000, but has been wavering as the housing market shows some signs of cooling.

     
  17.  
    MARKET REPORT 09:26:

    The major European stock markets have had a muted start this morning.

    • The FTSE 100 is down 0.12% at 6811.88
    • The Dax is up 0.02% at 9472.17
    • The Cac 40 is down 0.12% at 4375.75

    BAE Systems is the biggest winner in London, up almost 3%, while Morrison Supermarkets has dropped 2.25%.

     
  18.  
    ISLAND FLING 09:11:
    Apia

    Some conferences are more appealing than others. The third UN Conference on Small Island Developing States begins in Apia, Samoa today. Some 50 countries are invited, and the agenda covers a wide-range of topics, including sustainable energy, water and sanitation, and biodiversity.

     
  19.  
    Via Twitter Jamie McGeever, chief markets correspondent for Europe, Reuters

    tweets: "Italian manufacturing sector contracts for first time in over a year. PMI falls to 49.8 in Aug from 51.9 in July, expected 50.8."

     
  20.  
    PERFORM BUYOUT 08:50:

    Perform Group, which owns the Omnisport sport news agency, rose 26% to 256.7 pence in London after Access Industries Group said it would buy the company. It already owns 42.5%.

     
  21.  
    SAMSUNG EXPANDS 08:35:
    Samsung

    South Korean giant Samsung Group is to become even bigger, Bloomberg reports, after merging its shipbuilding and engineering units. Shares in both firms rose as a result of the announcement.

     
  22.  
    ECUADOR'S BITCOIN 08:19:

    Ecuador says its new digital currency will begin circulating in December. The electronic money will be the first backed by a central bank, and will work alongside the country's current currency - the US dollar. The president says it will help poorer people gain access to banking.

     
  23.  
    MICROSOFT ULTIMATUM 08:06:
    Microsoft China

    The clock is ticking for Microsoft in China. Competition authorities have given the firm 20 days to reply to questions over the compatibility of some of its software, Reuters reports. Microsoft is one of several foreign companies that have come under scrutiny in the country in recent weeks.

     
  24.  
    PUTIN SEEKS PARTITION 07:51:
    Putin

    The Financial Times leads with Vladimir Putin's call for talks on "statehood" for south-east Ukraine. The paper calls it a provocative comment, which will heighten fears that Moscow is seeking partition for Ukraine. The Daily Telegraph says David Cameron and Barack Obama are to respond to the Russian president by urging NATO allies to increase defence spending. In a leader article the paper also recommends fresh sanctions.

     
  25.  
    BERKELEY PERFORMANCE 07:37:

    Berkeley Group, the home builder, is having its annual meeting today. The firm is "well positioned to continue to invest in the business and deliver returns to shareholders. Earnings this year are anticipated to be in line with current market expectations," chairman Tony Pidgley will say.

     
  26.  
    KIER CONTRACT 07:23:

    Kier Group, the builder, says it is the preferred bidder to design and build a new £50m residential tower in London. The company says it will "design and construct 224 luxury apartments arranged in four blocks".

     
  27.  
    GOING SOUTH 07:11:
    St Andrews

    The Guardian reports that Scotland's top universities are bracing themselves for a "brain drain" of their most talented scientists if there's a "yes" vote for independence. The paper says senior figures believe Scotland's best known universities would lose access to billions of pounds of funding - the subjects most at risk are said to include advanced computing and genetic research. However a source close to the Scottish government says the concerns are misplaced and research funding will be maintained.

     
  28.  
    CUBAN IMPORTS 06:57:

    New rules are coming into force in Cuba, limiting the amount of goods people can take into the country in their luggage. For example, Cubans will be allowed only 10 kilos of detergent rather than 40, 24 bras rather than 48, and just two flat screen televisions. Many Cubans see the new restrictions as throttling one of the few sources of high-quality consumer goods.

     
  29.  
    RAC LISTING 06:47: Radio 5 live
    RAC rescue vehicle

    Holly Cook, of Morningstar, was on 5 live too, talking about the car breakdown specialists RAC, who are said to be considering a stock market flotation. How come? It shows "more confidence in the market" and may be seen as a good investment as its business is easily understood, she says.

     
  30.  
    FINANCE LITERACY 06:41: Radio 5 live

    Tracey Bleakley adds that the first rule of money management is "knowing the difference between something you need and something you want." Think about that in the lunch queue.

     
  31.  
    FINANCE LITERACY 06:35: Radio 5 live
    Classroom

    Tracey Bleakley, chief executive of the Personal Finance Education Group is talking about the government's new plan to provide education on financial planning. "We've all got to talk about it," she says, adding that children could educate their parents. That way people can see through "the marketing" that lots of debt is a good idea.

     
  32.  
    TESCO PERFORMANCE 06:30: Radio 5 live

    Tesco is struggling to compete with the likes of Aldi and Lidl because the smaller supermarkets stock fewer lines and focus on keeping prices low. "Tesco are giving people far too many reasons to go elsewhere," Steve Dresser, retail analyst, tells Wake up to Money.

     
  33.  
    TESCO'S NEXT MOVE 06:27: BBC Radio 4

    Tesco's new boss, Dave Lewis, starts work today at the beleaguered supermarket chain, and Holly Cook, of the investment site Morningstar, tells Today that his first move may be to slash prices. Tesco, she says, "used to be a value proposition," but is now "not that much cheaper" than its rivals.

     
  34.  
    EU REVOLT 06:20:
    Cameron

    In its main front page story, the Independent says David Cameron is facing a damaging new revolt over Europe. It says up to 100 Conservative MPs are planning to defy him by declaring that they'll vote to leave the EU - regardless of what concessions he wins for Britain.

     
  35.  
    NETWORK RAIL 06:17: Radio 5 live

    Philip Haigh, railway writer, is still on Wake up to Money. Why is Network Rail in £33bn of debt? It's been spending lots of late, he says. Railway stations, for example, have never looked better. "You just have to look at King's Cross and see what they've done there," he says.

     
  36.  
    BORIS TAKES OFF 06:14:

    Boris's comments come as we await news on whether the Airports Commission will put his favoured plan for a Thames estuary airport back onto its shortlist of options. Incidentally, Mr Johnson is seeking nomination as the Conservative parliamentary candidate in Uxbridge and South Ruislip - where Heathrow expansion is widely opposed.

     
  37.  
    BORIS TAKES OFF 06:07:
    Plane over Heathrow

    The Telegraph carries a piece by the Mayor of London, Boris Johnson, in which he warns that expanding Heathrow, and ditching his plan for a new airport in the Thames estuary, would be a "disaster". But Mr Johnson, who has previously called for the closure of Heathrow, now suggests it could remain open as a secondary airport.

     
  38.  
    NETWORK RAIL 06:03: Radio 5 live

    Philip Haigh, railway writer, is on Wake up to Money, talking about Network Rail's move to the government's balance sheet. On the one hand, he says, it means the state-owned company can borrow more cheaply from the government, but the government will also be able to appoint directors and intervene in things like executive pay.

     
  39.  
    06:01: Howard Mustoe Business reporter

    Morning! Get in touch via email bizlivepage@bbc.co.uk or via Twitter @BBCBusiness

     
  40.  
    06:00: Joe Miller Business Reporter

    Good morning. It's a good day for current account holders - particularly those who have experienced the maddening misfortune of being charged for going overdrawn by a few pennies. Banks will now have to give customers until 2pm to cover funds before slapping on a levy. Stay tuned for reaction to that news, and the rest of the business headlines.

     

Features

  • Alana Saarinen at pianoMum, Dad and Mum

    The girl with three biological parents


  • Polish and British flags alongside British roadsideWar debt

    Does the UK still feel a sense of obligation towards Poles?


  • Islamic State fighters parade in Raqqa, Syria (30 June 2014)Who backs IS?

    Where Islamic State finds support to become a formidable force


  • Bride and groom-to-be photographed underwaterWetted bliss

    Chinese couples told to smile, but please hold your breath


BBC © 2014 The BBC is not responsible for the content of external sites. Read more.

This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.