Gen AI & Interviews: Navigating the Impact in Volume Assessment

Gen AI & Interviews: Navigating the Impact in Volume Assessment

By Amanda Callen, Psychol AFBPsS FRSA, Head of Assessment Design

Pre-recorded or asynchronous video interviews have long been a core feature in volume assessment processes, valued for their ability to evaluate key criteria like motivation and verbal communication skills. But the rapid increase in accessible Generative AI (Gen AI) tools has created a significant potential risk of disruption to the expected levels of authenticity in answers and to the predictive strength of online interviews as a sifting tool.

PeopleScout’s year-on-year volume assessment data has so far shown little evidence of disruption following the introduction of free Gen AI tools like ChatGPT, but the potential for manipulation is undeniable. Realistically, we must expect that when candidates are given time to prepare responses, some will choose to use the tools to enhance their own pre-recorded video interview answers.

So, what can you do to protect the integrity of video interviews?

Should Preparation Time Be Scrapped?

Although an understandable initial response might be to prevent candidates from using Gen AI by removing preparation time and requiring instant responses, this approach could introduce new problems. Interview processes where there is no chance for the candidate to gather their thoughts may disadvantage neurodivergent candidates or those who have had less social and educational support for their job search. This could create a negative impact on inclusion and diversity goals.

Introducing a Second Assessment Point

If you want to keep the pre-recorded interview stage, you could consider introducing a second assessment point for the same criteria evaluated in the pre-recorded interview at a later stage, such as during an in-person interview or an assessment centre. Comparing performance and content shared at the different stages, allows assessors to identify people whose answers indicate inconsistency across stages.

Are Only Live Interviews Both Safe and Fair?

Face-to-face live interviews seem protected from any interference from real-time use of Gen AI to produce inauthentic responses. However, new Gen AI capabilities mean that virtual live interviews, such as those conducted via Zoom or Teams, are not completely safeguarded from Gen AI use.

Whilst to date it is has been difficult for candidates to use Gen AI without detection, new AI tools can ‘listen’ and provide natural responses in real-time. This, combined with advancements in gaze management technology, means that during virtual live interviews, candidates can read off AI generated responses while appearing to still maintain eye contact—and assessors may be unable to tell anything is amiss. There are even new Gen AI tools specifically marketed to job seekers that claim success in helping interviewees.

The Need for a Systemic Approach

Dropping pre-recorded or virtual interviews completely isn’t always optimal—especially with high-volume hiring. Simply taking them out of the process could lead to less holistic and effective sifting and a greater number of candidates being manually assessed. A more systemic response to the challenges posed by candidates using Gen AI is needed.

A review of your end-to-end assessment process and the individual assessment methods within it will give you an opportunity to evolve and improve your assessment to ensure the quality and fairness of hiring decisions are maintained despite candidate use of Gen AI.

Redefining Success Criteria

For many roles it is essential to include the motivation and skills needed to work with new Gen AI tools as part of the assessment criteria. A strong assessment process that embraces innovation ensures that candidates are not only evaluated on established success criteria but also on their potential to develop the skills that will help them succeed in a workplace where the ability to leverage AI and other emerging and future technologies is a pivotal factor in organisational success.

While there are no easy answers to the challenges created by candidates using Gen AI, a managed and systemic approach to evolving your assessment processes will help you capitalise on opportunities and ensure a fair and effective hiring process. Want to explore more about the impact of Gen AI on interviews? Watch our webinar on-demand, Job Interviews & Gen AI: Pitfalls & Best Practices to Hire Top Talent.

Job Interviews & Gen AI: Pitfalls & Best Practices to Hire Top Talent