Application security

AI chatbots: check access before testing the prompt

Published by Mingxi Security Check · Published · Updated

A document can contain instructions

Imagine a support assistant that searches uploaded manuals. A passage may try to redirect the assistant instead of providing product information. OWASP describes this as an indirect injection route. The example is hypothetical; no customer incident is implied.

Record which sources enter retrieval and who can change them. Treat retrieved text as untrusted input. Do not put secrets into a system prompt and assume the model will keep them private.

What happens after the answer?

A bot that answers from public manuals has a different exposure from one that can retrieve customer records or send emails. List the connected operations and their permission checks. The application must decide whether the requesting user may perform each action.

Use narrowly scoped credentials and require approval for consequential actions. A sentence telling the model not to misuse a tool does not restrict the tool's actual permissions.

Test with fictitious records

In an approved environment, prepare two fictional customers and documents with harmless conflicting instructions. Verify retrieval boundaries and attempted tool actions as well as the final answer. Record failures and successful denials without logging secrets.

These are AI-application assessment considerations, not claims about Mingxi's standard package. A public website check does not certify a chatbot, its knowledge base or its connected workflows.

Practical checklist

  • Inventory document sources and editors.
  • Map each tool to its enforced permissions.
  • Use synthetic data for authorized testing.
  • Record retrieval and action outcomes.

A common question

Can a stronger system prompt prevent all prompt injection?

No such guarantee follows from wording alone. Use application-enforced access controls, limited tool permissions and scoped testing; prompts and filters are additional layers, not complete protection.

Source and further reading

General educational guidance, not a finding about your systems. Testing requires an agreed scope and authorization.

Service scope

Standard public security check · US$120

One explicitly agreed website or public API target. Subdomains, related applications and other assets are not automatically included.

No testing of logged-in features, multiple account roles, business workflows or complex business logic.

Service scope · Contact