The Economist has a great story from Sept. 23rd, 2026 about how MPs in countries like Britain, Australia and Canada are using AI to help write their speeches. They used Pangram, the latest AI detection tool, to go over speeches from a number of countries. Canadian MPs come out as using AI about 20% of the time. Th
Rather than merely spotting iffy constructions, AI-detection tools are trained on vast databases of text, like the models they sniff out. Pangram now touts just one-in-24,000 false positives. Researchers at the University of Chicago similarly found a “near-zero” error rate on longer text. On parliamentary data, it flags vanishingly few speeches from before the release of ChatGPT in November 2022.
If Pangram truly has a low false-positive rate, this could bring some relief to academics, especially in the humanities where we tend to ask students to write papers as a way of demonstrating research and thinking. The Atlantic has a story on the use of AI detection tools in the academy and beyond. (The Atlantic also has a story about how AI detection can turn into a witch hunt.)
Given how AI detection tools are in a race with other companies that create tools to evade detection (by “humanizing” your text) we probably need to be careful about any accusations. The Economist article is more about politicians in general and while they may have assessed some speeches incorrectly, the overall picture is probably correct. Politicians and their staff are, like many, turning to AI for help in writing. I imagine AI may be particularly useful in checking written speeches to make sure you don’t say anything incorrect or foolish.
So, some general guidelines:
- Test AI-detectors extensively on your own work before you use it on the work of others. Try it on older and newer works. Try it on short and long writings. Try it on writings influenced by AI research.
- If you are going to use AI-detectors then be intentional about the use. Decide before hand what you will use it for and what you will do with the results. Remember that the detection is only going to part of a more complicated practice.
- If you are going to use it on the writings of others submitted to you, inform them before hand.
- If you plan to use it on student work, check the relevant university policies and guidance. Also, consider changing your assignments so that they are less vulnerable to AI. Think about trying a verbal defense, for example.
- Tell students you plan to use detectors before you do. If your detector suggests a work is written by an AI then give the student a chance to explain themselves. Treat this as a learning opportunity to help the student. Be open to the possibility that the detector was wrong.
- If possible, use multiple detectors on works flagged by a detector to confirm the detection, especially in situations where you are going to act on the detection.
- Stay up on the research around these tools and their effectiveness.
- Inform youself as to what the services do with writings uploaded. Do they keep copies, do they use them for training, could this be a privacy violation? Remember that uploading another person’s work to a detector could be a violation of their copyright or moral rights.
