What a useful prompt portfolio measures
A useful portfolio represents questions a plausible shopper may ask before choosing a product or store. It is not a list of prompts engineered to force the brand name into an answer.
Start with five to ten questions. Keep their wording stable long enough to compare observations over time.
Step 1: define the category with evidence
Write one category label supported by product titles, collections, product types, and visible copy. Avoid inferring a category from character names or isolated keywords.
Record three representative products and the evidence supporting the label. If confidence is low, use a neutral phrase such as “stores selling products like [hero products]” until a human confirms the category.
Step 2: list real buying constraints
Useful constraints include:
- Use case or recipient.
- Size, material, ingredient, compatibility, or skill level.
- Budget or shipping requirement.
- Availability or delivery market.
- Product format, bundle, or subscription.
Choose constraints that the storefront can support with public evidence.
Step 3: create five intent groups
Discovery
Which specialist online stores sell [category] for [use case]?
Best for
What is the best [product type] for [constraint]?
Compatibility
Where can I buy [product] compatible with [model or requirement]?
Comparison
Which stores offer [category], and how do their [important facts] compare?
Purchase
Where can I buy [product] with [shipping, stock, or budget constraint]?
Do not add the store name to every prompt. Brand-review prompts measure recognition, while non-branded buyer prompts are more useful for observing competitive discovery.
Step 4: define what counts as an appearance
Before running a test, decide how results will be classified:
- Domain verified.
- Brand mention only.
- Inferred mention.
- Not observed.
- Provider failed or result unavailable.
Do not turn a brand string associated with a marketplace URL into a verified storefront citation.
Step 5: record the full context
For every run retain:
Prompt
Timestamp
Language and market
Platform or endpoint
Visible answer
Visible sources
Matched domain or brand string
Named competitors
Provider error, if any
Common mistakes
- Testing only “Do you know my brand?”
- Changing prompt wording every week.
- Treating one answer as a rank.
- Counting provider failures as no mention.
- Combining all AI platforms into one unexplained score.
- Using an incorrectly inferred product category.
- Ignoring location, language, inventory, and timing.
Expected result
The output is a repeatable observation set, not a guarantee. It should reveal where the storefront appears, which competitors appear, what evidence is visible, and which product facts may need closer inspection.
Rollback
Prompt testing does not change Shopify. If a prompt is discovered to use the wrong category or a misleading assumption, mark the run invalid rather than deleting it silently. Correct the prompt set and preserve the reason for the change.
Community discussion
Add to the article
Ask a technical question, share a storefront result, or challenge a conclusion with evidence.