A fraud score can tell you an order is "medium risk". It can't tell you why, or what to do about it. Those gray-zone orders, between obviously fine and obviously fraudulent, are where Shopify stores lose the most money. This guide gives you a repeatable way to review them, a worked example, and the record to keep so a later chargeback doesn't catch you empty-handed.
Start with what Shopify already shows you
Before you build your own checklist, read the order's Order risk section. Shopify's fraud analysis looks at whether the card passed the address verification (AVS) check, whether the correct card security code (CVV) was entered, whether the customer's location matches the payment method, whether there was unusual device or network activity, and whether the customer tried more than one card. Medium and high risk orders also get a warning symbol next to the order number in your orders list.
That analysis is a starting point, not a verdict. Some orders get no recommendation at all, including Point of Sale orders, orders paid in full with a gift card, B2B orders and subscription renewals. For what each level means, see Shopify order risk levels explained.
Check five signals
Then check five signals of your own. None of them needs a special tool, only the order page and the customer record.
- Order value: Is this order far above what your store usually sees?
- Account age: Is a brand-new customer account placing a large order?
- Address consistency: Do the billing and shipping addresses match, or are they in different countries?
- Velocity: Have there been several orders or payment attempts in a short time?
- History: Is this a returning customer with good past orders?
No single signal proves fraud. What matters is how many line up. A returning customer sending a gift to a new address is normal. A first-time buyer with a failed CVV, a mismatched country and three card attempts in ten minutes is not. For the patterns that tend to show up together, see fraudulent order red flags and billing and shipping address mismatch.
Pick one of three actions
| Action | When |
|---|---|
| Allow | The signals line up. Fulfill as normal. |
| Verify | Something's off. Contact the customer and confirm the details before you ship. |
| Hold | Don't fulfill until you're confident the order is legitimate. |
Verify is the action most stores skip, and it is usually the right one for a medium risk order. Reach out using the contact details on the order, ask a question only the real cardholder can answer easily, and wait for the reply before you ship. How to verify a customer before shipping has the wording and the checks. If verification fails, when to cancel a high risk order covers the next step.
A worked example
Here is how one review at Harbor Goods Co. plays out from start to finish.
- Order: #1042, $486.69, three Linen Crew Tees and two Canvas Totes
- Shopify's analysis: Medium risk. AVS partial match, CVV correct.
- Value: About four times the store's typical order
- Account: Created the same day
- Addresses: Billing in one country, shipping in another
- Velocity: One payment attempt only
- History: None
Three signals line up (value, new account, address mismatch), and two don't (one card, correct CVV). That's a Verify, not a cancel. The store emails the customer, who replies within the hour: the order is a gift for a relative abroad. The store fulfills.
Write down why
Whatever you decide, record the signals you checked and the decision you made. If a chargeback comes in later, that record is the evidence you'll need for the dispute.
- Record: Order #1042 · $486.69 · Billing and shipping countries differ, first order · Verify, customer confirmed by email.
Shopify's guidance on fraudulent chargebacks asks for the fulfillment date and time, the billing information the customer used, the IP address and country of the order, and shipping and tracking details. Your review note adds the context those facts can't show on their own: what you checked, when, and what the customer told you. Keep a copy of the customer's reply too. See how to respond to a chargeback on Shopify for how that evidence is submitted.
Mistakes that cost money
- ❌ Cancelling every medium risk order. You lose real customers along with the fraud.
- ❌ Fulfilling while you wait for a reply. Once it ships, the goods are gone.
- ❌ Reviewing only the risk level and skipping the order history
- ✅ Using the same checklist on every gray-zone order, so your decisions are consistent
Frequently asked questions
Should I cancel medium risk orders on Shopify?
Not automatically. Shopify's own suggestion for medium risk is to confirm with the customer before fulfilling, and many medium risk orders are legitimate.
How do I contact a customer to verify an order?
Use the email or phone number on the order and ask them to confirm a detail of the purchase. Don't ship until they reply, and keep a copy of the conversation.
Does a low risk rating mean the order is safe?
No. A low rating means Shopify's indicators didn't flag it, but fraud can still get through. If an order looks unusual for your store, review it anyway.
What should I record for each risky order?
The order number, the signals you checked, the action you chose and why, and any reply from the customer. That record is what you will rely on if the order turns into a chargeback.
Doing this for every order
Reviewing by hand gets slow as order volume grows, and it's easy to skip the write-up on a busy day. RiskClarity reviews each paid order across these signals, explains the risk in plain English, and recommends allow, verify or hold. You decide with one click, and every decision is logged with its evidence, ready to export for chargeback disputes.