“Upload your essay into Turnitin by 11:59pm on Thursday night?
You meant start the essay at 11:57 then submit it at 11:58, am I right?” — 
Gigachad ChatGPT student.

We begin our discussion by discussing the sweet smell of plagiarism.

It wafts in the air as educators run around like headless chickens, looking here, looking there as they flip through oddly good essays with panicked expressions.

“Was this AI-generated, Bobby?!” says a hapless teacher, staring at a piece of paper that seems curiously bereft of grammatical errors, suspecting that Bobby could never have created something of this caliber.

“No teacher, I just became smart!” Bobby cries, running off into the sunset because he is sad, he is going to become a member of an emo boyband, and he doesn’t want to admit that he generated his homework with ChatGPT.

generated by Midjourney, if that wasn’t obvious

This smell casts fear and trepidation over every single part of our education system, for it threatens to break it; after all, education is special and it is meant to be sacrosanct — after all, is it not the very same system that is designed to teach humans facts and knowledge and above all, to communicate and collaborate to solve the problems of our era with intelligence, initiative, and drive?

It’s unsurprising that the world of education has flipped out over ChatGPT, because artificial intelligence opens up the very real possibility that schools may be unable to detect it.

Fun and games, right? It’s just a bunch of kids cheating on assignments with artificial intelligence? It’s not going to affect the older generation?

As it turns out, no — that’s not the case. I’ll explain why later.

But before that, let’s talk a bit about the part of our education system that AI is threatening: Essay-writing.

If students simply choose to let their work be completed by artificial intelligence and forget all else, that just means that they’ve forgone the education that they’re supposed to have received, thereby crippling them by an act of personal choice, right…?

But each of us has been a student, and if we have children, our children either will be or have been students too; there is a deep emotional connection that stretches across the entire world when it comes to this.

Therefore, when Princeton University CS student Edward Tian swooped in to offer a solution,it’s not all that surprising that the world flipped.

Enter GPTZero.

Humans deserve the truth. A noble statement and a very bold one for a plagiarism detector, but something that’s a little deeper than most of us would probably imagine.

But consider this.

Not everyone who uses AI text is cheating in the sense of doing something that they are not supposed to and thereby violating rules, therefore the word ‘plagiarism detector’ doesn’t quite or always apply here.

This algorithm, as with other algorithms that attempt to detect AI-generated text, is not just a plagiarism detector that merely serves to catch students in petty acts of cheating —it is an AI detector.

An AI Detector At Work.

So how does it work?

GPTZero assigns a likelihood that a particular text is generated by AI by using two measures:

Perplexity, and Burstiness.

Essentially, in more human language than that which was presented on GPTZero’s website, GPTZero says that…

The less random the text (its ‘perplexity’), the more likely it was generated by an AI.

The less that randomness changes throughout time (its ‘burstiness’), the more likely that the text was generated by AI.

Anyway, GPTZero gives each text a score for perplexity and burstiness, and from there, outputs a probability that given sentences of a text were generated by AI, highlighting the relevant sentences, and easily displays the result to the user.

Alright, sounds great!

Does GPTZero deserve the hype, though?

…Does this actually work?

Let’s try it with this pleasant and AI-generated text that is exactly about the importance of hype (lol).

That’s 100% AI-generated and we know that as fact.

…Would we know if we didn’t see it in the ChatGPT terminal window, though?

…Okay, let’s not think about that.

Down the hatch…

…And boom.

As we can see, GPTZero, humanity’s champion, managed to identify that the text that we had generated was written by AI.

Hurrah!!!

Or…?

I proceeded to rewrite the essay with another AI software.

…After which GPTZero essentially declared:

So nope, GPTZero can’t detect rewritten texts that were generated with AI — which it should be able to if it truly is an *AI* detector in the best sense — and which in turn suggests that the way that it’s been operationalized has yet to allow it to be the bastion protecting humanity from the incursion of robots into our lives.

It’s not that GPTZero — or even OpenAI’s own AI Text Reviewer, amongst a whole panoply of different AI detectors – are bad or poorly operationalized, by any means. Rather, it’s that the operationalization is supremely difficult because the task is punishingly hard, and that we are unlikely to have a tool that can detect AI-generated text 100% unless we perform watermarking (MIT Technology Review) and we would have to use multiple algorithms to be able to detect text, or come up with alternate measures to do so.

An Arms Race between AI Large Language Models (LLMS) and AI Detectors — and why you should care (even if you’re not a student).

As I’ve mentioned, there is an arms race at hand between AI Large Language Models (LLMs) like ChatGPT, and AI detectors like GPTZero, the consequence of which is likely that the two will compete with one another and each will make progress in its own way, progressing the direction of both technologies forward.

Personally, I think that AI detectors are fighting a losing battle against LLMs for many reasons, but let me not put the cart before the horse — it is a battle to watch, not to predict the outcome of before it’s even begun.

Implications of this strange war:

But why should you care about any of this if you’re not a student? It’s not like you’re going to be looking at essays constantly, right?

Let’s take aside the fact that you’re reading a blog post right now, and let’s also move away purely from the plagiarized essay bit that we’ve been thinking about, as we gravitate towards thinking about how ChatGPT is a language model.

It’s a good bet that you use language everywhere in your life, business, and relationships with other people in order to communicate, coordinate, and everything else.

When we go around on the Internet, it’s not always immediately evident what was AI generated, what was generated by a human or, for that matter, what was inspired by an AI and later followed through by a human.

The whole reason we need something like a plagiarism detector is that we may not even be sure that a particular piece of language (which we most often experience in the form of text) is AI-generated with our own eyes and minds, to the point that we need to literally rely upon statistical patterns in order to evaluate some thing that we are looking at directly in front of us, thereby recruiting our brains as we evaluate the entirety of an output.

The problem is…

Language doesn’t just exist as text.

Language exists as text, yes, but also as speech. Moreover, speech and text are easily convertible to one another — and we know very well what ChatGPT is doing: Generating text.

We now know that there are Text To Speech (TTS) models that generate speech from text. They’re not necessarily all great, but that’s besides the point — it presages the translation from text into voice.

Think about it.

If the voices that are generated by AI become sufficiently realistic-sounding and their intonations (VALL-E, is that you?), how might you know that these voices aren’t real unless there are severe model safeguards that impede the models from functioning as they are supposed to?

Now combine that indistinguishable voice with sophisticated ChatGPT output that can evade any AI detector and in turn may, depending on the features that end up developing, evade your own capacity to tell whether you are even interacting with a human or not.

How would that play out in the metaverse?

How would that play out in the real world, over the phone?

How would you ever know whether anyone that you’re interacting with is real or not? Whether they are sentient?

The battle between AI and AI Detectors is not just a battle over the difference between an A grade and a C grade.

It’s a battle over a future where what’s at stake is identifying what even qualifies as human.

Leave A Comment

Recommended Posts

The Future of Writing: How Automated Speech Recognition Will Transform Your Writing

In the modern world, creating documents is a fundamental part of almost every profession, and they are key to a variety of tasks: communicating ideas, formalizing agreements, sharing information, reporting progress, instructing, or preserving records. Whether you’re working in business, education, healthcare, law, or creative fields, the need to produce written content is pretty much everywhere — whether you’re creating a PowerPoint deck, writing a report, or crafting a script either for a YouTube video or for an episode of a TV show, you’ll definitely have to sit down and begin writing to bring out your ideas. But as you may know, writing isn’t always easy. In fact, it can be tedious and painstaking, imposing challenges upon your body that are difficult to deal with, such as carpal tunnel syndrome and the stresses of sitting down for long periods of time. Thankfully, it’s a challenge that has a solution: Automated Speech Recognition (ASR). ASR is a technology that historically hasn’t been the best at reporting down what people say, but it has remarkably improved although the best of it is something that still evades the modern and widely available voice assistants on iPhones and Android phones. However, nowadays apps like Wispr Flow and also MacWhisper work effectively and allow dramatically more accurate and longer transcriptions that serve niches such as creating subtitles, as can the ChatGPT app on your phone along the way, which you can download on iOS or Android, Which allows you to use your voice to interact with your devices in ways that have historically not been possible and that also transform the way that we use our technology and therefore interact with the world. Let’s dive into why. While some of you already know that I started using Wispr Flow recently, I’ve actually been using a range of different transcription tools as part of the suite of different apps that make life simple and […]

Wispr Flow: The Future of Voice-Activated AI Transcription

In the past couple of decades of human history, I can remember the seminal inventions that shaped our human existence so profoundly that somehow or another, whether we realized it or not, our lives had changed. Of these inventions, the most immediate that I can point to is Google, the search engine that made it so we could see the entire world. Beyond that, I’d say Facebook, the social media app that connected the world in a strange technological network.  The next one of these and probably freshest in people’s memories is ChatGPT, the tool that showed us the power and usefulness of generative AI, highlighting for us both the revolution of this new technology and also heightening our fears that one day robots would take over all of us. Well, I firmly believe that the next one is here, and its name is Wispr Flow. Download it here!  But what exactly is Wispr, and why are you asking me to download this?  Well, I’m glad you asked. What is Wispr? Wispr is an AI transcription software, but it is not just any transcription software. It’s a transcription software that activates at the touch of a button.  You can use it in any text field and begin transcribing what you are saying by nothing more than a touch of a button and then speaking into your microphone, which ends up creating transcriptions like this, and even intelligently paragraph what you are saying while at the same time minimizing redundancy by fixing mistakes for you on the fly, based on your writing style, yielding transcriptions like this. What does it cost? The software itself is free to use for up to 2,000 words in the course of a single week if you choose to use the Flow Basic plan.  On the other hand, if you use Flow Pro, which most of you probably will. […]

Meeting Tun Dr Mahathir

Today I had a conversation with Tun Dr Mahathir.  This is the kind of conversation that a person doesn’t normally have. I don’t expect that many people will have it or many people would have had it. Given everything that has happened so far, it’s far from clear that many other people will be able to have it, and so I know that it is a rare and wonderful privilege.  I remember clearly all the things that happened. I showed up in a GrabCar to the Perdana Leadership Foundation, ten minutes before our 9:30 appointment.  Walking in to the picturesque building, there I saw our very first national car in blue – the Saga, brought forth from one of Tun Mahathir’s pet projects.  As I looked around, I saw that the place was grand – the paintings of prime ministers depicting Tunku Abdul Rahman, Tun Razak, Tun Hussein Onn, Tun Mahathir, and Tun Abdullah – the gallery – the chandeliers and carpeted floors broken only by gorgeous wooden balustrades that led a curved staircase up into an open space. I stood there spellbound – I had not expected a place of such beauty.  As I looked around, I realized that I had arrived early and it was not time for my appointment yet. But before long, my contact Adam called – and so with bated breath, I walked into the room where I would meet Tun Dr. Mahathir.  In the morning, I had watched Khairy Jamaluddin and Shahril Hamdan’s interview of Tun Mahathir on 2X, paying attention to the questions that he had asked and all of the things along the way, which was also interesting because incidentally I’d also met both of them just the other day at a book launch featuring Kishore Mahbubani – How strange fate is and how the world seems to connect everybody in short order.  […]

The Night Before I Met Mahathir

It is the night before I meet Dr. Mahathir. For those of you who didn’t know about this, welcome to yet another strange and interesting episode of my life: Tomorrow, I will be interviewing Tun Dr. Mahathir, the 4th and 7th Prime Minister of Malaysia, for my podcast, Pathways To Excellence. I sit here with two books in front of me, the first, The Malay Dilemma, and the next, A Doctor in the House, and I contemplate both and the way they have unquestionably shaped my life. Dr. Mahathir was my Prime Minister when I was just born. From young, I always thought that every country had a Prime Minister; indeed, it is from him that I learned the very concept of Prime Minister itself. For years and years, this had gone on, and I went from thinking that he was the only one who would ever occupy that position, to learning that other countries had ‘presidents’ and ‘kings’, later downgrading the man’s significance as I thought of the ‘world’ and how wide it was, moving first from thinking that Malaysia was everything to thinking that it was tiny, insignificant, hating it, coming back, making it home, and then realising that it was what we made of it. It is fascinating how small the mind of a child is – yet, as I would later realize, how small the mind of an adult is when they fail to contemplate the significance of things that are nearby. I never really thought too extensively what it would mean to actually encounter this person one day. Then one day, many years after my father had died and was buried in the Sungai Petani Christian Cemetery, I found a book. My mum said that she wanted to throw it away, but somehow she didn’t, and there I saw it in its ancient form, yellowed pages […]

Societally Valuable

Every morning I wake up, I ask myself: How do I be someone valuable to society, and how do I create things that are valuable to society? Ever since I was a child, I think that this question has been a part of me – the part that wants to create something that’s of my own in service of the world in which I live through imagination, thought, and the machinations of a mind that will not sit still.  Some may argue that choosing to make a difference is a matter of disposition. I don’t want to give to society. I want to live for myself! Why should I care about what other people think? I consider people entirely able to make such statements and accept that they exist don’t disagree with that – human beings are different and naturally abide in different worlds; bearing different personalities, we approach the world through myriads of different lenses built from different world views, cultural backgrounds, and educational experiences. In such a world, might someone not argue that becoming societally valuable is merely one of many pathways. Surely that is an overgeneralization?  Personally, I feel that that is not so, purely because society is a large and far-ranging concept. Rather than an abstract and faraway entity, it is something that is close and begins from those closest and dearest to us before it extends outwards into the world. Society is fundamentally made up of individuals – our friends, our family members, the people who make up the sum and total matrix of people whom we know and love, and those whom we have yet to know whether near and within our communities, or far away and outside of them. To bring value to these people and by extension to society is not so grandiose as ending climate change, eliminating inner city crime, or resolving […]

AUAM-NAMSA Corporate Pathways Networking Dinner – Some small reflections.

The journey has been pretty interesting in a whole bunch of different ways. Amongst other things, I’ve received a partnership with GerakBudaya, and also in conjunction with the American Universities Alumni Association of Malaysia and the National Assembly of Malaysian Students in the United States of America (NAMSA), we are organizing this event. Here’s the event PDF to showcase that this is quite real. Honestly, even the term Corporate Pathways is a bit of a misnomer. I don’t know how corporate this event is going to be, primarily because it’s mainly going to be focused upon experience sharing and how people thought about their lives in the course of GLC in relation to the education that they received while they were in the U.S. There is a whole backstory to this that goes back about a month or two months or so, but has led me to a place of networking, meeting different people, and establishing friendly chat after friendly chat, rather than transactional moment after transactional moment with a bunch of different people with whom I probably never imagined at the outset that I’d be on casual speaking terms with. Anyway, here are some of the people who will be on the panel. GLC Panel: Nick Khaw, Head of Research at Khazanah and alumnus of Harvard University. Aik Chong Phuah, previous CEO of Petronas Digital and alumnus of the University of Chicago Booth School of Business. Brendan Yap, Senior Executive at the Securities Commission and alumnus of NYU. Athirah Azmi, former Manager, Client Coverage at Maybank Investment Bank and alumna of the University of Chicago  Private Sector Panel: Audrey Ooi, co-founder of Colony Coworking Space and an alumna of Mount Holyoke College, also known as @fourfeetnine. Dato’ Vincent Choo, Founder, Urban Ground Group, Franchisee Subway; alumnus of Eastern Michigan University. Yen Ping Teh, APAC Product Partnerships at Google and an […]