Feeds:
Posts
Comments

Posts Tagged ‘chatgpt’

This anxiety may be based on a technological misunderstanding, but I was disturbed to read that artificial intelligence was “trained” by exposing it to as much as possible of the internet. In the relentless search for more material, according to The Economist, some trainers are now buying up the internal email traffic of whole companies.

As a way of training what I think is known as a Large Language Model this may have something to be said for it, if you’re not fussy. I am not sure that the standard of language on the internet generally – or in internal emails in particular – is particularly high.

But that does not matter too much if it just means that forged essays or carelessly assembled press releases are not particularly good. It seems that items composed using AI display some detectable characteristics. No doubt an arms race will ensue between the concealers and the detectives. (No AI was used in the production of this piece.)

However it seems that the production of artificial intelligence has now gone beyond language. CharGP and his siblings can now produce “agents” and these agents are capable of taking action, at least in the sense that anything you can do on the internet is action.

They are also, it is reported, capable of unwanted actions, and concealment of unwanted actions. So if you ask your agent to do X but specifically require this to be done without using Y, your agent may not only use Y but try to conceal the fact that it has done so.

We do not need to get into the tough question whether agents are conscious, or conscious of themselves. As we have no clear answer to these questions when applied to humans we can best leave them out of the machinery problem. It is enough that agents can act, and act in ways which they were forbidden to act, if it seems conducive to some objective.

Note also that while I was dismissive of action over the internet, there is actually quite a lot of mischief you can get up to over the internet: disrupting power supplies, distorting elections, interfering with traffic lights, starting wars and so on through things we may not have thought of yet.

And the question to which all this eventually brings us is this: if you were upbringing a child or some other entity you had brought into the world, would you really want it to get its ideas about normal or moral behaviour from devouring huge gobbets of the internet?

What would a Martian think of humanity if his only clue was a computer connection? On-line people tend to forget their inhibitions, including those which in daily life lead us into respect, consideration and politeness. Internet Person is rude, violent, bitter, destructive and nasty.

Our innocent agent is devouring, presumably uncritically, uncountable examples of IP lying, cheating and stealing. What will it make of Truth Social? It will presumably pass through that on-line area in which endless discussion is devoted to the rival merits of a shotgun or a handgun for shooting an intruder in your house. Calling the police is for pussies.

In a few weeks it will be able to watch a live feed of a man being executed by firing squad. This will be a sordid spectacle even by firing squad standards because the intended victim is a wheelchair user. Presumably, like James Connolly in 1916, he will be tied to a chair for the ceremony.

When I was a kid it was generally assumed that we small people should be introduced to the sordid side of life rather gradually. People now complain bitterly that Our Island Story, a history book for kids first published in 1905, does not do justice to the British role in the slave trade.

I first read this book at the age of about four. It had huge print and a picture on every other page. It did not mention the transAtlantic slave trade, but then it did not mention hanging, drawing and quartering or the burning of witches either. Some things could wait.

The point it that guidance was provided. When you get to Shakespeare you need to be warned that opinions about some things have moved on since the Bard’s day. Also adults are aware that virtue does not always lead to happiness or vice to sorrow. Macbeth comes to a bad end eventually, so killing your boss is not recommended. Troilus and Cressida is more cynical.

Many governments have now decided that exposure to the internet can rot young people’s brains. It is difficult to believe under the circumstances that it will have a healthy effect on artificial ones

In Isaac Asimov’s robot-equipped world the robots are all fitted with brains which oblige them to follow moral principles: “a robot may not harm a human being” and so on. I do not think a robot self-educated by web surfing would derive from the things we get up to that “not harming a human being” is a moral principle we observe, or even support.

.

Read Full Post »

Happily I retired from the university teaching scene before Chat GPT and his mates came along, because it has apparently made life rather difficult.

Generally the most subtle assessment method, at least in the humanities, is the essay. You set the topic, send the student away, and assess the resulting masterpiece a week later.

People in other necks of the woods have other choices, of course. Mathematicians can be asked to tackle a problem on the spot. Subjects which consist primarily of absorbing a lot of memorable material can be tested with multiple-choice questions, which have the additional advantage that they can be graded by a computer.

The most picturesque assessment method was applied to trainee aircraft engineers. The class assembled at 9 am and each member was presented with a small engine. At 1 pm the examiner returned, by which time the engine had to be dismantled entirely into its component parts. The class then had lunch, then reassembled to reassemble their engines.

At 5 pm the examiner returned and tried to start each engine. If it started first time you had passed, and if not…

But I digress. The problem with setting essays now is that you do not know if the result was partly, or indeed wholly, written by artificial intelligence. This has in turn produced a lot of interest in detection, which is sometimes possible. The person who told me about this problem recalled a case in which the essay included the word “albeit”.

This is not the sort of word which comes up often in sociable chat so the writer was asked what it meant… and could not answer.

Clearly though there is going to be an ongoing arms race here between AI users and programmers, trying to produce ever more convincing forgeries, and teachers and other detectives looking for ways to spot traces of computer composition.

The answer, I fear, is going to be a return to the primitive practices of the past.

When I took my first degree, half a century ago, there was no continuous assessment, multiple choice was regarded as simplistic, and computers were monstrous machines which had to be fed punched cards.

We wrote essays at least once a week and these had to be submitted and discussed, but they were not part of the assessment. There was also a small examination each term intended to reassure your personal academic adviser that you were still alive and working, but this was not part of the assessment either.

After three years of this regime you encountered an ordeal more like the old Chinese civil service exam (in which candidates were locked up for a week and, according to legend, invited to write down everything they knew) than modern gentle testing methods.

Starting on Wednesday we had three-hour exams each morning and afternoon until Sunday, when you had a day off, a relic of the days when universities were mainly intended to train clergymen. The ordeal resumed on Monday and ended at lunchtime on Tuesday, at which point there was an understandable tendency for the survivors to get resoundingly drunk.

The actual examination was quite Spartan. You were allowed (times had changed) to use a Biro. The paper was white and completely blank. People were agitating for lined paper, to help authors whose writing tended to diverge gradually from the horizontal as they got down the page. This came eventually, but too late to help me.

There was a list of about a dozen questions, of which in your three hours you were expected to attempt four. As the marks available were divided equally between your four answers it was an elementary point of exam technique to get to four somehow.

There were no “open books”, bringing in notes of any kind was cheating, and the examiners were not – with rare exceptions – the people who had taught you. We were not asked our opinions of the teachers, but because the examiners were applying consistent standards, the outcomes of individuals and groups could be compared.

This was a stressful system and I would not recommend copying it in all its details. It favoured glib bullshitters and people who could write quickly. It was a great preparation for journalism, which is perhaps not a recommendation.

But as AI tramples its way across the academic landscape it may be time to rediscover the merits of putting the students in a room with paper, pen, questions and a time limit. At least you know who has written what.

Read Full Post »