The science behind the assessment.

The majority of hiring decisions, made with resumes, conversations and gut feel, produce outcomes that disappoint both the organisation and the person hired. The reasons new hires fail break down like this:

Technical skill, what the resume shows and most interviews test, accounts for the smallest share of hiring failures. Leadership IQ

82%of hiring managers saw warning signs and hired anywayLeadership IQ, 2020 The reasons: time pressure, confidence in their ability to coach the candidate, or simply wanting the search to be over.

What this costs

31%US employee engagement in 2024, a ten-year lowGallup, 2024 60%of organizations reported longer time-to-hireGoodTime, 2024

57%of the time a typical interview picks the right hirePsychological Bulletin Unstructured interviews, the most common format, have a predictive validity of about 0.20. A validity score is the correlation between an assessment method and actual job performance. Zero means no relationship. One means perfect prediction. At 0.20, an unstructured interview is marginally better than guessing. Sackett et al., 2022

Three documented mechanisms:

1. First-impression lock-in. 60%of interviewers decide within the first 10 minutesCheckster, 2022 What happens in the remaining time is mostly confirmation: looking for evidence to support the initial judgment, discounting anything that contradicts it.
2. Unconscious bias. 50%of hiring decisions are influenced by unconscious biasCheckster, 2022 Affinity bias, the halo effect, similarity bias. A 2024 peer-reviewed study confirmed that interviewers who pay attention to irrelevant applicant characteristics produce biased judgments that lead to hiring discrimination. Wingate, 2024 Audit studies found a 50%callback gap based on the name on the resumeBertrand & Mullainathan, 2004 and that racial hiring discrimination has not declined since 1989hiring discrimination unchanged sinceQuillian et al., 2017.
3. Resume and experience filters don't work. 31 secondsmedian time a recruiter spends on a resumeLerner, 2024 The filters applied in that time, years of experience, GPA, school prestige, are consistently among the weakest predictors of performance. They reliably screen out certain candidates, just not the wrong ones. 73%of applicants are not qualified for the roleSparkHire, 2024

The resume problem

85 years of research show that resumes are essentially ineffective at predicting job performance.

Google's internal research confirmed this, and led to the removal of degree requirements across most roles.

The landmark reference is Schmidt and Hunter (1998), which synthesised research from 1913 to 1998 across 85 years of published personnel selection data. It remains the most cited paper in industrial-organisational psychology. It was updated and partially revised by Sackett, Zhang, Berry and Lievens (2022).

Why situational judgment tests are the right foundation

A situational judgment test presents the candidate with realistic scenarios, situations they would actually encounter in the role, and evaluates how they respond. Research from multiple meta-analyses shows:

1. They add validity over cognitive ability and personality tests alone. They capture information other methods miss.
2. They are less prone to faking than self-report. Ask someone "are you coachable?" and most say yes. Put them inside a scenario where a manager gives critical feedback and you get a different kind of data.
3. They measure judgment quality, not just knowledge. Knowledge-based ("what should you do") and behavioural-tendency ("what would you do") items are more predictive together than either alone.
4. Delivery that immerses the candidate outperforms plain text. This is why Job Strategy AI is built for active scenarios rather than multiple-choice trivia.
5. They are particularly effective for early-career and customer-facing roles where formal experience may be limited but judgment matters immediately.

Christian et al.PMC, 2019

Key limitation, acknowledged: situational judgment tests capture intended behaviour, not guaranteed actual behaviour. This is why Job Strategy AI uses them as part of a broader picture of signal, never as the only measure. Convergent signals across several scenarios and dimensions are more reliable than any single test.

Why conscientiousness matters more than almost any other trait

Of the Big Five, conscientiousness is the trait with meaningful, consistent predictive validity across roles and industries. The reason is structural: it predicts follow-through. Whether someone will execute when it's inconvenient, meet commitments, and hold standards under pressure. Coachability, the number one reason new hires fail, is a behavioural expression of it. It shows up in how someone handles feedback they disagree with, not how they describe their approach to feedback. PMC, 2019

A multi-study paper in the Journal of Vocational Behavior (three independent studies across industries) found intrinsic motivation was associated with positive work outcomes (performance, commitment, less burnout, less turnover intention), while extrinsic motivation was negatively related or unrelated. Crucially, the two were only moderately negatively correlated: they trade off, but both can coexist. Gagné et al., JVB

The applied finding: once compensation exceeds a subsistence threshold, intrinsic factors become the stronger motivators. Pay still matters. A mismatch creates immediate dissatisfaction. Above a reasonable threshold, it stops being what drives performance.

What this means for assessment: asking "are you here for the money?" is a low-quality signal. What our assessments surface instead is whether the candidate engages with the actual content of the work, responds with genuine curiosity, and shows the specific care for the role that intrinsic drivers produce. These patterns show up in how someone explores a problem, not in what they say their motivation is.

Our assessments read candidates across five behavioural dimensions. Each maps to a documented predictor of job performance.

Results represent patterns of judgment across several scenarios. Not a personality type, not a prediction of success, and not a ranking against other candidates. No assessment can guarantee a hire. What a well-designed situational assessment can do is raise the baseline probability of a good decision by giving you more relevant signal before the conversation.

For hiring teams

The results are most useful as a pre-conversation brief, not a post-interview validation. Review them before your first live conversation. Use them to know where to go deeper, where you already have confidence, and where a scenario created an ambiguous signal worth exploring. Most of the hiring managers who saw warning signs and ignored them did so because the signs came mid-interview, after a positive impression had formed. A pre-conversation brief separates the data from the relationship. Leadership IQ, 2020

Questions to bring into the interview when a read is mixed or thin:

• Coachability: Tell me about a time you received feedback you disagreed with. What did you do?
• Decision quality: Walk me through how you approached a decision where you did not have all the information.
• Emotional signals: How do you handle a situation where a colleague's approach conflicts with how you would do it?
• Role judgment: Take me through the last time you had to choose what not to do in this kind of role.
• Conscientiousness: Tell me about a commitment that became inconvenient to keep. What happened?

For candidates

Read your results honestly. The dimensions where you showed clear, strong signals are your strongest positioning in a role of this type. The dimensions where signals were mixed or thin are worth reflecting on, not as weaknesses, but as places where your natural approach may need adjusting for this kind of environment. A result that shows tension isn't a rejection. It's a conversation starter. Most good interviews go to the places where the answer isn't obvious.

Most of this document is framed around organisational cost. But there's a person on the other side. Someone takes a job they're wrong for. They spend eighteen months struggling, failing quietly, being managed out, or leaving under pressure. They lose confidence and carry it into the next search.

The charismatic candidate who lands a role they weren't right for doesn't win long-term either. They just fail later, more visibly. And the talented candidate who got filtered out because they didn't interview well, and went to a competitor: that's the loss nobody measures.

Job Strategy AI exists because both outcomes are preventable when the evaluation method is built on what the research says about human performance, not on what the last fifty years of hiring tradition assumed.