Knowledge your team can trust.

A knowledge assistant can make approved information easier to find and use. It can also amplify confusion if the underlying documents are outdated, contradictory, or available to the wrong people. The first project question should be what information the assistant may use and what a trustworthy answer must contain.

Choose a specific audience and task. Helping employees find a current operating procedure is different from answering customer questions or searching confidential project records. Each scenario needs its own permissions, source rules, evaluation cases, and response when the evidence is incomplete.

Understand retrieval

IBM describes retrieval augmented generation as connecting a generative model with external knowledge to provide relevant context. It can support source-linked answers and reduce some errors, but it does not make a model error-proof. IBM research ↗ The quality of retrieval and the interpretation of the retrieved material still require evaluation.

Our recommendation is to begin with a small, well-maintained collection. Assign an owner, establish which version is authoritative, and remove obsolete duplicates from the assistant's eligible sources. If the business cannot agree which policy is current, the interface should expose that uncertainty rather than conceal it behind a confident answer.

VanKpa knowledge-assistant pattern

Ground the answer

1. Authorize

   Resolve the user and allowed information sources.

2. Retrieve

   Find relevant, current passages within that boundary.

3. Respond

   Ground the draft in evidence and expose sources.

4. Review

   Handle uncertainty, corrections, and escalation.

Enforce access when information is retrieved

The assistant should only retrieve information the current user is authorized to access. Apply boundaries to the underlying records, including attachments and derived indexes. A search result, citation, or preview can disclose information even when the final answer avoids quoting it.

Test the same question under different user roles and accounts. Check what happens after access is revoked or a document is removed. Include exports, conversation history, and retained logs in the design. Do not assume that adding a login screen resolves the information-access problem.

Test realistic questions

Build a reviewed question set covering routine tasks, ambiguous wording, missing facts, contradictory sources, and requests outside the intended scope. Define what a good answer should include and when it should decline to infer an answer. Evaluate whether the cited source actually supports the statement, not merely whether a citation is present.

NIST's AI Risk Management Framework provides voluntary guidance for examining AI risks over the system lifecycle. NIST research ↗ Our practical application is to maintain an evaluation record that connects each important risk to a test, an owner, and an operating response. This is a working control, not a claim of certification.

Design a useful no-answer state

When the assistant lacks enough evidence, it should explain what is missing and point to the next appropriate action. That could mean refining the question, opening a source document, or asking a responsible person. The goal is to advance the task without inventing information.

After launch, use unresolved questions to improve the knowledge collection and the product. Measure verified answer usefulness, source coverage, correction effort, and escalation—not only conversation volume. An assistant that honestly identifies a knowledge gap can be more valuable than one that always returns an answer.

• Start with a bounded task and an approved source collection.
• Identify the owner and authoritative version of each source.
• Test retrieval and citations under real permission boundaries.
• Include missing and contradictory information in evaluations.
• Give unanswered questions an operational destination.

Is documentation still needed?

It should make documentation easier to use, not remove the need for it. People still need authoritative records, clear ownership, and a way to inspect the material behind important decisions. The assistant is an access layer within that system.

Evidence behind the guidance

Sources & context

Published research informs this article. VanKpa's frameworks and recommendations are practical applications; illustrative data is labeled where used.

1. IBM — Retrieval augmented generation ↗Accessed September 11, 2026

   RAG connects generation with external knowledge; it does not eliminate model errors.

2. NIST — AI Risk Management Framework ↗Accessed September 11, 2026

   Voluntary risk-management resource; not a certification or legal-compliance determination.