Feeds:
Posts
Comments

Posts Tagged ‘learning’

Happily I retired from the university teaching scene before Chat GPT and his mates came along, because it has apparently made life rather difficult.

Generally the most subtle assessment method, at least in the humanities, is the essay. You set the topic, send the student away, and assess the resulting masterpiece a week later.

People in other necks of the woods have other choices, of course. Mathematicians can be asked to tackle a problem on the spot. Subjects which consist primarily of absorbing a lot of memorable material can be tested with multiple-choice questions, which have the additional advantage that they can be graded by a computer.

The most picturesque assessment method was applied to trainee aircraft engineers. The class assembled at 9 am and each member was presented with a small engine. At 1 pm the examiner returned, by which time the engine had to be dismantled entirely into its component parts. The class then had lunch, then reassembled to reassemble their engines.

At 5 pm the examiner returned and tried to start each engine. If it started first time you had passed, and if not…

But I digress. The problem with setting essays now is that you do not know if the result was partly, or indeed wholly, written by artificial intelligence. This has in turn produced a lot of interest in detection, which is sometimes possible. The person who told me about this problem recalled a case in which the essay included the word “albeit”.

This is not the sort of word which comes up often in sociable chat so the writer was asked what it meant… and could not answer.

Clearly though there is going to be an ongoing arms race here between AI users and programmers, trying to produce ever more convincing forgeries, and teachers and other detectives looking for ways to spot traces of computer composition.

The answer, I fear, is going to be a return to the primitive practices of the past.

When I took my first degree, half a century ago, there was no continuous assessment, multiple choice was regarded as simplistic, and computers were monstrous machines which had to be fed punched cards.

We wrote essays at least once a week and these had to be submitted and discussed, but they were not part of the assessment. There was also a small examination each term intended to reassure your personal academic adviser that you were still alive and working, but this was not part of the assessment either.

After three years of this regime you encountered an ordeal more like the old Chinese civil service exam (in which candidates were locked up for a week and, according to legend, invited to write down everything they knew) than modern gentle testing methods.

Starting on Wednesday we had three-hour exams each morning and afternoon until Sunday, when you had a day off, a relic of the days when universities were mainly intended to train clergymen. The ordeal resumed on Monday and ended at lunchtime on Tuesday, at which point there was an understandable tendency for the survivors to get resoundingly drunk.

The actual examination was quite Spartan. You were allowed (times had changed) to use a Biro. The paper was white and completely blank. People were agitating for lined paper, to help authors whose writing tended to diverge gradually from the horizontal as they got down the page. This came eventually, but too late to help me.

There was a list of about a dozen questions, of which in your three hours you were expected to attempt four. As the marks available were divided equally between your four answers it was an elementary point of exam technique to get to four somehow.

There were no “open books”, bringing in notes of any kind was cheating, and the examiners were not – with rare exceptions – the people who had taught you. We were not asked our opinions of the teachers, but because the examiners were applying consistent standards, the outcomes of individuals and groups could be compared.

This was a stressful system and I would not recommend copying it in all its details. It favoured glib bullshitters and people who could write quickly. It was a great preparation for journalism, which is perhaps not a recommendation.

But as AI tramples its way across the academic landscape it may be time to rediscover the merits of putting the students in a room with paper, pen, questions and a time limit. At least you know who has written what.

Read Full Post »

The newspapers are full, as is customary at this time of the year, of stories about local kids who have done well in the school-leaving exams. It seems that most of the stars of this show want to become doctors, which shows a touching faith in the inability of AI to take over the routine parts of medicine.

For a discordant note readers could turn to The Economist, which printed a long piece lamenting the fact that, as a subsidiary headline put it, “the bottom has fallen out of the graduate job market”.

The primary evidence for this comes from America, where graduates in their 20s have been found in one study to have higher unemployment rates than the general population. Things are apparently moving in a similar direction, but much more slowly, outside America.

Graduates – again from the evidence we are back in the USA – find jobs harder to come by and also less satisfying than they used to. Very good international example from the BBC on Thursday: mainlander with degree from Oxford and PhD from Singapore university is working … as a food delivery driver.

The Economist’s writer dismisses as an unsatisfactory explanation claims that many graduates of American universities are ill-educated and in some cases actually illiterate. These stories may be true, but the brightest and best are also finding employment elusive.

Some formerly entry-level jobs are certainly falling to AI. A more original suggestion is that people used to go to university to achieve digital literacy; now everyone gets it from their smart phone so for many button-pushing jobs a degree looks unnecessary.

The writer concludes that many American students are now deciding that university is not worth it: the time… the debt … the disappointment. This is not happening in Europe where, as our scribe puts it, “”Governments are subsidising useless degrees, encouraging kids to waste time studying.”

What do we mean by “useless degrees”? “Outside America, the share in arts, humanities and social sciences mostly grows. So, inexplicably, does enrolment in journalism courses. If these trends reveal young people’s ideas about the future of work, they truly are in trouble.”

Really? Underlying this lament appears to be the unspoken assumption that the main or only reason for any form of study is to increase your future income. Education of any other kind amounts to “encouraging kids to waste time.”

I am reminded of Oscar Wilde’s lament that people “know the price of everything and the value of nothing.” This might usefully be adapted. Economists – and The Economist – know the price of everything and erroneously suppose that the value is the same thing.

“Until recently,” says our author, “the obvious path for a British student hoping to make money was a graduate scheme at a bank.” But making money is only one of the things people hope to find in a job. Some British students would rather shovel sewage for a living than work in a bank and I was once one of them.

Only a Philistine society will limit its educational offerings to subjects with an immediate practical application, or indeed an ironclad promise of future wealth attached to them.

Indeed there are some areas of human activity where the attainment of the highest standards requires that many are tested, most of whom will fail. Training for air traffic controllers is a notorious example. Thousands apply, hundreds are accepted, tens actually complete the course and get into a control tower, some of whom drop out later when they find the work too stressful.

Many of the more demanding military specialities have similar attrition rates. In university programmes this is obscured by the fact that every student who makes a reasonable amount of effort will get the degree. But in general music grads do not become musicians, Eng Lit grads do not become novelists, philosophy grads do not become professional philosophers and the only graduate archaeologist I ever met was teaching in a primary school.

This brings us to the “inexplicable” attraction of journalism courses, which I flogged happily and successfully for nearly three decades. It was a platitude among teachers of journalism that most of our students were not going to be journalists, or if they became journalists would not stay that way.

At one time there was a spirited debate in the journalism education business about whether we should continue to design courses on the basis that the graduate would be able to meet the requirements of the trade (art, craft, science, con trick or disease, whichever you prefer) or we should accept that we were teaching non-journalists and adapt courses accordingly.

Generally we concluded that the practical aspects of a journalism programme were one of the things which students liked, even if they were not going to be practitioners themselves. Most of my students never became journalists. A surprising number (at least to me) became police people. Journalism may be (as Max Hastings puts it) a pursuit for “cads and bounders”, but it still has a whiff of adventure around it that you are not going to get in the Business School. But if you really want to be rich … your choice.

Read Full Post »