In a small number of cases, the analytics provided on the Cloudflare dashboard and GraphQL Analytics API are based on a sample—a subset of the data set. In these cases, Cloudflare Analytics returns an estimate derived from the sampled value. For example, suppose that during an attack the sampling rate is 10% and 5,000 events are sampled. Cloudflare will estimate 50,000 total events (5,000 × 10) and report this value in Analytics.
Sampled data sets
Cloudflare Analytics builds the following data sets from sampled data:
|Firewall Activity Log|
|Firewall Rule Preview|
The presence of sampled data is called out in the Cloudflare dashboard and in the description of the data set in the API.
Why sampling is applied
Analytics is designed to provide requested data, at the appropriate level of detail, as quickly as possible. Sampling allows Cloudflare to deliver analytics within seconds, even when data sets scale quickly and unpredictably, such as a burst of Firewall events generated during an attack. And because the volume of underlying data is large, the value estimated from the sample should still be statistically significant–meaning you can rely on sampled data with a high degree of confidence. Without sampling, it might take several minutes or longer to answer a query—a long time to wait when validating mitigation efforts.
Types of sampling
Cloudflare almost always uses adaptive sampling, which means the sample rate fluctuates depending on the volume of data ingested or queried. If the number of records is relatively small, sampling is not used. However, as the volume of records grows larger, progressively lower sample rates are applied. Firewall Analytics and the Firewall Event Log follow this model. Data nodes that use adaptive sampling are easy to identify by the
Adaptive suffix in the node name, as in
The following data nodes are based on fixed sampling, where the sample rate does not vary:
|Firewall Rules Preview|
|1%||Use with caution. A 1% sample rate does not provide accurate estimates for data sets smaller than a certain threshold, a scenario the Cloudflare Dashboard calls out explicitly but the API does not.|
|0.12%||Sampling rate is in terms of packet count (1 of every 8,192 packets).|
Access to raw data
Because sampling is primarily adaptive and automatically adjusts to provide an accurate estimate, the sampling rate cannot be directly controlled. Enterprise customers have access to raw data via Cloudflare Logs.