ChatGPT in job applications: ‘Is using AI the key to success, or a pitfall?

ChatGPT in job applications: ‘Is using AI the key to success, or a pitfall?

ChatGPT is a wildly popular AI program with millions of users worldwide. The program is increasingly being used by job seekers to write cover letters. But what do recruiters think about it? Former psychology student Daisy Grootscholten investigated the language model: ‘Focus letters written with ChatGPT received a higher rating than letters without this tool.’

Illustration: Jeroen de Leijer

What is your thesis about?

‘ChatGTP is a ‘hot topic’. It is a relatively new advanced language model that is developing rapidly. The program uses artificial intelligence (AI) and machine learning to understand and produce texts that sound very natural and fluent.

‘Within one week, millions of people worldwide were already using the program. The language model is used for all kinds of things, including by job seekers who increasingly use it to write a cover letter.

‘By using the right prompt – a question to ChatGPT to generate a text output – you can make a letter very closely match the desired qualities of a vacancy. The chatbot also makes hardly any language or grammatical errors, something that recruiters pay close attention to. A cover letter full of errors is often an immediate ‘no go’.

‘Together with other students, I investigated the use of ChatGPT in writing cover letters and how recruiters relate to it. What do they think of using an AI tool in a job application? And are recruiters aware of the consequences when they hire someone who uses artificial intelligence?

How did you research that?

‘Each recruiter who participated in our research received six cover letters for an open vacancy. They assessed the letters on a number of things. First of all, an ‘overall hireability index’. This is a questionnaire in which recruiters assess whether a candidate has a chance of being hired. In addition, the recruiters assessed the candidate’s writing style and determined whether the content of the letter matched the job requirements of the vacancy.

‘After recruiters read and assessed all letters in the first round, we informed them about the growing use of ChatGPT as a tool for writing application letters. We asked them to look at all the letters again and indicate for each letter whether they suspected that the candidate had used ChatGPT. They then had to indicate again how likely it was that they would invite the candidate for a job interview.

‘What turned out? Cover letters written with ChatGPT were rated higher than letters without this tool. But as soon as a recruiter suspected that ChatGPT had been used, the letter was rated lower. This reduced the chance that the candidate would be invited for a job interview.’

Daisy Grootscholten: ‘As soon as a recruiter suspected that ChatGPT had been used, the letter was rated lower.’ Image: Jack Tummers

Is this because recruiters are concerned that ChatGPT makes it difficult to identify authentic candidates?

‘Previous research has indeed shown that they struggle with this. For some companies, it is actually a plus if a candidate can handle AI well, because this promotes an efficient and innovative working method. But for companies that value authenticity and independent writing skills, it is less desirable for applicants to use AI.

‘Further research should show in which sectors and for which functions recruiters are open to the use of AI. This has not yet been clearly established: a creative company can appreciate innovation, but at the same time value authenticity, something that may be lost with ChatGPT.’

Do you use ChatGPT yourself?

‘When ChatGPT was introduced, I started using it almost immediately. It is incredibly useful, especially for improving texts. I also use it a lot in my current job. When I need an answer to a question, it provides faster results than Google, for example. However, I remain critical and do not blindly accept everything, because it is not always a guarantee that the information is correct.

‘In addition, there is uncertainty about the privacy and data processing of the program. I noticed that during my internship. The company where I worked blocked access to ChatGPT on all computers for security reasons to protect company data.’

What tip would you give to upcoming scriptwriters?

‘Choose a topic that you are really interested in and that you can easily research. If the topic is relevant and applicable, you will stay motivated and sharp. In addition, it is crucial to choose a supervisor with whom you have a good connection. Such a ‘professional click’ can make all the difference during your thesis period. Furthermore, it is important to zoom out every now and then and add structure to your text.

‘It may sound like a cliché, but it really helps to be critical of what you have written. Sometimes it is also good to leave a thesis part aside for a while and come back to it later. Often the puzzle pieces will fall into place by themselves.’

Master’s thesis

A literature study, experimenting in the lab or still working with SPSS? The students of Tilburg University write the most diverse theses. In the section Master’s thesis, Univers highlights one each month.

Author: Daisy Grootscholten
Title: Recruiters’ Evaluations of ChatGPT-enhanced Cover Letters: Does Company Environment Matter?
Supervisor: Djurre Holtrop
Rating: 8.0
Master: Economic Psychology

Bekijk meer recent nieuws

Schrijf je in voor onze nieuwsbrief

Blijf op de hoogte. Meld je aan voor de nieuwsbrief van Univers.