AI Systems
Semantic search: find it in the words people actually use
Different words for the same problem
Employees describe a problem differently from the document that answers it. Exact keyword search misses the right procedure because its title uses internal terms, and returns the wrong one because it happens to share a word.
Semantic search represents the meaning of each passage, so a question finds passages about the same thing however they're worded. The source, version and access rules stay attached, so results can be inspected and nobody sees what they shouldn't.
Three searches
heater makes a popping noise
as T3
- 1score 0.84
Sediment build-up: flushing procedure (top result)
Procedures
why: describes the noise as “rumbling”
- 2score 0.72
Annual water heater service checklist
Procedures
why: flushing is step 4
- 3score 0.66
Anode rod inspection
Procedures
why: related maintenance
Matched on meaning. The procedure never uses the word “popping”.
E4 on the tankless unit
as T1
- 1score 0.71
Tankless error codes: E4, flame failure (top result)
Manufacturer manual
why: exact term “E4”
- 2score 0.79
Tankless won't light: checklist
Procedures
why: close in meaning
- 3score 0.68
Gas pressure test
Procedures
why: close in meaning
Codes and part numbers are where keywords win. On meaning alone the checklist ranks first; the exact match lifts the manual's E4 entry above it.
what do technicians earn on overtime
as T2
- 1score 0.74
Overtime scheduling procedure (top result)
Scheduling
why: who can approve overtime
- 2score 0.61
On-call rota rules
Scheduling
why: related
Pay rates live in HR documents outside T2's access, so they're never candidates. The results don't hint that they exist.
How a result earns its place
Permitted
Only what this reader may see
Access is applied before anything is compared, so a private passage can't win.
Close in meaning
Not just shared words
Passages are compared by what they're about, however they're worded.
Exact terms count
Codes, names, part numbers
A keyword boost for the things that must match exactly.
Reranked when it helps
A second look at the top
A slower, closer comparison of the leading results, added only when tests show it improves them.
Tested against real questions
What search hands off
In
Out
Worth building when the right words are the obstacle
Good fit
- Useful knowledge exists across documents, but people can't find it with the words those documents use.
- The same questions get asked in many different ways.
- Content has owners and access rules.
Not the right fit
- The task is an exact lookup by an ID, such as an order number. A plain search does that.
- Source quality and access ownership haven't been settled yet.
Questions about semantic search
Is this the same as RAG?
No. Search returns passages and documents. RAG takes those passages and writes an answer from them. Many teams need good search first; RAG adds the answer on top.
Does it replace keyword search?
It works alongside it. Exact matches still matter for codes, names and part numbers, so ranking can combine both when tests show it helps.
Can it search across all our tools at once?
Yes, once content from each tool is brought in with its source and permissions. Every result links back to the original.
How do we know it's better than what we have?
Run the same test questions through both, before and after. The list of questions and expected passages makes the comparison concrete.