This video is available to ERE Pro subscribers

Subscribe to watch

Already a member? Log in

AI-Powered Search & Match: Advantages, Limitations, and Performance

June 28, 2023 · Talent42 2023 ·

Speakers

About this video

AI-powered search and match tools promise to find the right candidates faster, but the mechanics behind them are rarely explained to the recruiters who rely on them. A close technical walkthrough covers how these systems actually work, starting with parsing: the process of breaking resumes and profiles into structured data. Poor parsing undermines everything downstream, since matching quality depends entirely on how well a document's content is understood and categorized in the first place.

Several distinctions matter once parsing is done well:

  • Taxonomies, ontologies, and knowledge graphs are not the same thing, and many matching tools fail to model hierarchical relationships correctly. A real example: a search for "Node" returned candidates who only had "JavaScript" listed, because the system never learned that Node implies JavaScript but not the reverse.
  • Word embeddings let AI systems infer relationships between concepts without knowing what the words actually mean, treating everything as numerical vectors in a shared space. This is the same underlying approach used by large language models.
  • Inference lets AI matching tools surface candidates who fit a concept, like "open source contributor" or "past founder," in ways that would be nearly impossible to write as a Boolean string.
  • Relatedness is not relevance. A search for "data scientist" once returned a director of footwear innovation ranked near the top, a clear false positive that shows how distance in vector space doesn't guarantee a meaningful match.
  • Feedback loops built into many tools, like thumbs up or down ratings, are too vague to actually improve results, since neither the user nor the algorithm knows exactly what is being approved or rejected.
  • Ranking signals can quietly bias results. When a platform weighs recruiter behavior, such as who gets saved or messaged, as a top signal for relevance, it steers future results toward people who resemble past choices, narrowing the pool and working against diversity of outcomes.

Confusion matrices, false positives, false negatives, and equality of opportunity all come into play when judging whether a matching solution is genuinely good or just labeled "AI" for marketing purposes. A list of pointed questions worth asking any vendor, or any internal team building these tools, runs throughout: what kind of AI is being used, why that approach was chosen, and how anyone would know if it's actually working.