Volume Testing Services | Performance at Large Data Volumes Skip to main content
QAonTOP
Contact Us

Volume Testing Services

Your product was built and tested with a few thousand records. Your customers will give it millions. Volume testing shows what happens to search, reports, imports and the database when the data gets big.

We load your system with production-sized and future data volumes, then run real journeys, imports, exports and batch jobs against it. You see which queries slow down, which jobs overrun, which screens time out, and at what data size each problem starts.

  • Production-sized test data
  • Queries, imports and reports timed
  • JMeter, k6, Gatling and more
  • Free one-week POC

[ Why volume testing ]

Most test environments are far too small to show the problem

A table with ten thousand rows hides almost everything. A query without the right index returns instantly, a report that loads every record into memory works fine, and an export finishes before anyone notices. At ten million rows the same code times out, runs out of memory or locks the table for everyone else. Production gets there gradually, so the slowdown arrives quietly, one customer complaint at a time. Volume testing gets there on purpose: we create the data your system will hold, then measure what still works and what doesn’t.

Testing high user traffic rather than large data? See load testing services →

01

Know your data limits

The data size at which each query, report or job stops meeting its target.

02

Reports and search that stay fast

Slow queries and missing indexes found before your biggest customers find them.

03

Imports and migrations that finish

Bulk loads, exports and migrations timed with real volumes, not samples.

04

Plan storage and archiving

How fast data grows, and when archiving or partitioning will be needed.

[ What we test ]

Eight places where big data slows things down

From one slow query on a large table to a full migration rehearsal. Each card lists what we test, when you need it and the problem it prevents.

Large database testing

Millions of rows

We fill your database to production size, or beyond, and measure the queries your product depends on.

What we test
  • Query times at current and future table sizes
  • Indexes used, missing or ignored
  • Locking and contention on large tables
  • Paging, sorting and filtering on big result sets
When you need it

Before data grows significantly, and after schema changes.

The problem it preventsA screen that loads in a second today and in a minute next year

Reports, dashboards & exports

Heavy reads

Reports and exports read the most data at once. We test them at full volume, including your largest customers’ accounts.

What we test
  • Report and dashboard load times on large accounts
  • CSV, Excel and PDF exports of big data sets
  • Memory used while reports are built
  • Timeouts and limits on long-running requests
When you need it

When reporting is a selling point, or big customers complain first.

The problem it preventsReports that time out for exactly the customers who pay most

Bulk imports & data loads

Files, APIs, ETL

Imports of thousands or millions of records through files, APIs or ETL jobs, checked for speed, completeness and side effects.

What we test
  • Large CSV, Excel and API bulk imports
  • Validation, duplicates and error handling at volume
  • The effect of imports on people using the product
  • Partial failures and safe re-runs
When you need it

Before onboarding large customers or adding new data sources.

The problem it preventsAn onboarding import that runs all night and fails at 90%

Batch jobs & scheduled processing

Nightly, hourly

Nightly billing, reconciliation, notification and clean-up jobs, run against full data volumes to check they finish inside their window.

What we test
  • Job duration at current and future volumes
  • Batch size, chunking and memory use
  • Jobs overlapping each other or user traffic
  • Restart and recovery after a failed run
When you need it

When jobs run on growing data with a fixed deadline.

The problem it preventsA nightly job that’s still running when users arrive

Message & event volume

Queues, streams, logs

High volumes of messages, events and logs flowing through queues and streams, checked for throughput, order and backlog.

What we test
  • Millions of messages through Kafka, RabbitMQ or SQS
  • Consumer throughput and lag under sustained volume
  • Large message payloads and batching
  • Event and log storage growth
When you need it

For event-driven systems, analytics pipelines and integrations.

The problem it preventsA backlog that builds silently until data is hours late

Files, uploads & storage

Documents, media

Large files and very many files: uploads, downloads, processing and storage, tested at the sizes your users really send.

What we test
  • Large file uploads and downloads
  • Thousands of files per account or folder
  • Processing such as resizing, parsing and conversion
  • Storage growth and clean-up
When you need it

For document, media and file-heavy products.

The problem it preventsUploads that fail above a size nobody tested

A migration that works on a sample can take days, or fail, on the full data set. We rehearse it at full size.

What we test
  • Migration run time on full production-sized data
  • Record counts, totals and data integrity afterwards
  • Downtime needed, and how long a rollback takes
  • Performance of the new system with migrated data
When you need it

Before database upgrades, platform moves and system replacements.

The problem it preventsA go-live weekend that runs out of time. See also data & database testing.

[ Volume testing vs load and endurance testing ]

Other tests grow the traffic or the time. Volume testing grows the data.

A system can serve thousands of users on a small database and struggle with a handful on a big one. That’s why volume gets a test of its own. On the right is what a volume finding looks like.

AspectLoad testingEndurance testingVolume testing
The questionDo we meet targets at expected user peak?Do we stay stable over hours and days?Do we still perform when the data is big?
What growsUsers and requestsTimeThe amount of data
Typical findingsBottlenecks at peak trafficLeaks, drift and build-upSlow queries, overrunning jobs, failing imports and exports
When to run itBefore every major releaseBefore long runs between releasesBefore data growth, big customers and migrations
Sample volume findingFuture-volume run
Data set
Orders table at 40 million rows: two years of projected growth
Journeys
Account order history and the monthly report
Today’s size
Order history 0.4 s, report 6 s
At 40M rows
Order history 9 s, report timed out after 60 s
Root cause
Sort on an unindexed date column; report built in memory
Fix
Composite index added; report streamed in pages
Retest
Order history 0.5 s, report 11 s at 40M rows

Example only. Real reports use your schema, journeys and data sizes.

[ How we work ]

Six steps from data profile to a faster product

Every data size we test comes from your real numbers and growth. Every script, data set and report belongs to you.

  1. Step 1 of 6

    Profile your data

    How much data you have, how it’s shaped, which tables and files grow fastest, and what you expect next.

    You getData profile
  2. Step 2 of 6

    Agree sizes and targets

    The data sizes to test, from today’s to your future volume, and the targets each journey and job must meet.

    You getVolume test plan
  3. Step 3 of 6

    Generate the data

    Realistic, production-shaped test data at the agreed sizes, created by scripts so no real customer data is needed.

    You getData generation scripts
  4. Step 4 of 6

    Run journeys and jobs

    User journeys, reports, imports and batch jobs run at each data size, with the database and servers monitored.

    You getResults per data size
  5. Step 5 of 6

    Find what slows down

    Query plans, job logs and metrics analysed to show which query, index or job causes each slowdown.

    You getSlow query and job report
  6. Step 6 of 6

    Fix, retest, plan ahead

    Fixes retested at full volume, plus an outlook for when archiving or partitioning will be needed.

    You getBefore-and-after reportData growth outlook
  • Free one-week POCWe run one key report or query at your future data size and show you what changes, so you can judge our work first.
  • No real customer data neededWe generate production-shaped test data, so personal data stays where it belongs.
  • NDA before accessWe sign your NDA first and use test accounts and test data by default.

[ Tools ]

The tools behind our volume testing

12 tools across three jobs. We’re happy to work in the tools and monitoring you already have.

Load generation

Open-source tools we script in most often.

04 TOOLS
  • JMeterProtocol-level load for web and APIs
  • k6Load tests as code, CI-friendly
  • GatlingHigh-throughput HTTP load
  • LocustUser behaviour written in Python

Enterprise & cloud execution

When you need scale or already own a licence.

03 TOOLS
  • LoadRunnerEnterprise protocols and large suites
  • NeoLoadEnterprise load with CI integration
  • BlazeMeterCloud load generators

Monitoring & analysis

Database, server and job metrics at every data size.

05 TOOLS
  • GrafanaLive dashboards and trends
  • PrometheusServer and service metrics
  • New RelicAPM and traces
  • DatadogInfrastructure and APM
  • AWS CloudWatchAWS resource metrics

See every tool we use on our technology stack page →

[ Case Studies ]

Products with a lot of data to handle

Load and performance checks were one part of the wider QA work on these products. Each links to the full write-up.

All case studies →

[ Ways to work ]

Six ways to get volume testing done

A one-off test before a migration or big customer, a performance engineer in your team, or volume checks as your data grows.

Not sure which fits? Find your model in four questions, compare all six or estimate your cost.

[ FAQ ]

Volume testing questions, answered

{{ f.a }}

[ Contact us ]

Find out what happens when your data gets big

✓ Free one-week POC✓ NDA before access✓ A QA lead replies the same day

[ Keep exploring ]

Related testing services

All services →