Settings
Settings is the first area to configure on any new store. Missing a section here — no agency connection, no notifications, no storefront password — creates a gap that silently undermines monitoring.
Agency Access
Agencies connect to a merchant's Shoptest environment using a one-time connection code. No Shopify login credentials are shared.
- The store owner goes to Settings > Agency Access and clicks Generate Connection Code.
- The code is valid for 48 hours and can only be used once.
- Share the code with the agency partner.
- The agency enters the code to connect.
Disconnecting: Clicking Disconnect Agency rotates the store's API key. Any integrations using the previous key will stop working.
Notification Channels
Configure where Shoptest sends alerts. The app supports per-event notification rules for six event types:
| Event | What triggers it |
|---|---|
| Test Failed | A scheduled or manual test run fails |
| Broken Links | New broken links detected in a scan |
| App Outage | A monitored third-party app or service goes down |
| Billing | Credit usage or plan-related alerts |
| Speed Drop | A monitored page shows a significant performance regression |
| Radar Alert | Store Radar detects an anomaly in business metrics |
Recommended setup:
- Add at least two notification channels — one for the agency team (all 6 events) and one for the client (minimum: Test Failed, App Outage, Radar Alert).
- You can add additional channels (like Slack) beyond the initial email configured during onboarding.
AutoFix
AutoFix detects theme-related test breakages and can prepare or apply a repair automatically.
| Mode | Behaviour |
|---|---|
| Automatic | Applies fixes automatically when a theme-related failure is detected |
| Ask me first | Prepares the fix but waits for approval before applying |
| Off | Disabled — all fixes are manual |
Recommended default: Set to Ask me first so every repair is reviewed before it goes live.
AutoFix uses credits per fix attempt. The cost varies depending on the type of repair.
Storefront Password
Required for any password-protected or staging store. Without it, tests and AI generation cannot access the storefront.
- Go to Settings > Storefront Password.
- Enter the password that visitors use to enter the store.
This is not the Shopify admin password. It is the storefront access password configured in Shopify under Online Store > Preferences.
Update this field whenever the password changes in Shopify.
Language
Choose the language for the Shoptest interface and AI-generated reports.
- Go to Settings > Language.
- Select the preferred language from the dropdown.
- Click Save changes.
Plan & credits
Shoptest uses a credit-based model alongside plan tiers. Each plan includes a monthly credit allowance, and many actions consume credits.
Key actions that use credits:
- AI test generation (100 credits per successful test)
- AI failure analysis (20–100 credits)
- AutoFix attempts (varies by repair type)
- Page Speed scans (1 credit per page per device)
- Broken link scans (1 credit per page)
- Safari checks (5 credits desktop, 10 credits mobile)
Spend Cap: Set a maximum extra spend so the store does not incur unexpected overage charges if monthly credits run out. Find this in Settings > Plan & credits.
Current plan details (pricing, included credits, and retention periods) are shown in-app on the Plan & credits screen.
Troubleshooting
Tests fail with "store not accessible" errors
- Check that the storefront password is entered correctly in Settings > Storefront Password.
No alerts are being received
- Verify that at least one notification channel is configured and that the relevant event types are enabled.
Agency cannot connect
- Generate a new connection code — the previous one may have expired (48-hour limit) or already been used.
Credits running out mid-month
- Set a Spend Cap to allow controlled overage, or review which actions are consuming the most credits. Consider upgrading the plan ahead of high-activity periods like campaigns or peak trading.