Skip to content
Book a call
AI, consumer · EU

45% fewer payment tickets for an AI media product

Testing of image, voice, audio and video generation, subscriptions and the generation queue under load.

45% fewer payment-related support tickets
  • 45% fewer payment-related support tickets
  • 260+ bugs reported, 32 critical
  • 500 concurrent generation jobs verified
  • Platformsweb, iOS, Android, API
  • Engagement10 months · 3 QA engineers
Challenge

Image, voice, audio and video generation worked differently on web and mobile. Users were charged for failed generations, and the queue slowed down at peak hours with no one measuring it.

What we did

We tested generation of all four media types on every platform, along with storage and delivery of the results. We covered subscriptions, credits and refunds with Stripe and PayPal, verified moderation rules, and load-tested the generation queue.

Result

Payment-related support tickets dropped by 45%. Generation behaves the same on web and mobile, and the queue is verified at 500 concurrent jobs.

Before and after
Before Test SquadAfter
Platforms Generation differs on web and mobile Same behavior everywhere
Billing Charges for failed generations Credits and refunds tested each release
Support Frequent payment tickets 45% fewer
Queue Slows at peak hours, not measured Verified at 500 concurrent jobs
Timeline
  1. Weeks 1–4

    Test strategy, generation test sets for four media types

  2. Weeks 5–16

    Web, mobile and API testing, storage checks

  3. Weeks 17–28

    Subscriptions, credits, refunds, moderation

  4. Weeks 29–40

    Queue load testing, admin dashboards, regression

Tools

  • Playwright
  • Postman
  • Appium
  • BrowserStack
  • k6
  • Datadog
  • Sentry
  • Firebase Crashlytics
  • AWS CloudWatch
  • Mixpanel

Testing types

FunctionalAI output qualityAPImobilecross-browsersubscription and payment testing (Stripe, PayPal)storage (S3)content moderationload testingadmin dashboard testingregression

Related cases

Want results like these?

Book a short call about your product. We can start with a free QA audit or a trial.

Book a call →