Logs become available in approximately 1 to 5 minutes.
In the best case, logs take about 1 minute to process, and so we require that calls to the Logpull API be for time periods of at least 1 minute in the past. For example, if it’s 9:43 now, you can ask for logs processed between 9:41 and 9:42. The response will include logs for requests that passed through our network between 9:41 and 9:42 and potentially earlier. It’s normal for our processing to take between 3 and 4 minutes, so when you ask for that same time period, you may also see logs of requests that passed through our network at 9:39 or earlier.
When using Logpush, logs are pushed in 5-minute batches, with at least a 5 to 10 minute delay. For example, if it’s 10:10, you’ll receive a file of logs that were processed between 10 and 10:05, which may include requests that passed through our network as late as 10:04 (assuming the best case processing delay).
These timings are only a guideline, not a guarantee, and may depend on network conditions, the request volume for your domain, and other factors. Although we try to get the logs to you as fast as possible, we prioritize not losing log data over speed. On rare occasions, you may see a longer delay. In this case, you don’t need to take any action–the logs will be available as soon as they’re processed.
Cloudflare guarantees log availability for 3 days or the last 72 hours, to be exact. We try to make them available for longer if possible, but never store them for more than 7 days. If you need your logs for a longer time period, download and store them locally.
Not yet, but we’re planning to make them available to other customer plans in the future.
Yes, this is normal. The time period for which you pull or receive logs is based on our processing time, not the time the requests passed through our network. If you receive an empty response, it does not mean there were no requests during that time period. It just means we did not process any logs for your domain during that time.
Currently not. Talk to your account manager or Cloudflare Support if you’re interested in other formats and we’ll consider them for the future.
When you make a call for the time period of 16:10-16:13, you’re actually asking for the logs that were received and processed by our system during that time (hence the endpoint name, logs/received). the received time is the time the logs are written to disk. There is some delay between the time the request hits the Cloudflare edge and the time it is received and processed. The request time is what you see in the log itself: EdgeStartTimestamp and EdgeEndTimestamp tell you when the edge started and stopped processing the request.
The advantage of basing the responses on the time received rather than the request or edge time is not needing to worry about late-arriving logs. As long as you’re calling our API for continuous time segments, you will always get all of your logs and will never have to make the same call twice. If we based the response on request time, you could never be sure that all the logs for that request time had been processed.
Not yet, but we’re planning to make other destinations available in future. Please fill out this survey to tell us which tools you’re currently using.
Logpush is designed to retry in case of errors. If your destination is temporarily unavailable, we’ll keep trying until it’s online again and the logs are received. We’ll also automatically catch up, so that you don’t miss any logs. However, if we persistently receive errors from your destination for 7 days, we’ll take that as a sign that it’s permanently unavailable and disable your push job. It can always be re-enabled later.
Currently not. We may offer faster speeds or more flexibility in the future. For now, if you’d like to download logs at a different frequency, you can use the Logpull API, which allows you to specify the time period.
No, Logpush only pushes the logs once as they become available, and is unable to backfill. However, the logs are stored for a period of at least 72 hours and can be downloaded using the Logpull API.