# Effects of Varying Traffic During Monthly Crawl

**URL:** <https://discuss.httparchive.org/t/effects-of-varying-traffic-during-monthly-crawl/1865>\
**Category:** Uncategorized\
**Created:** [February 11, 2020, 3:20pm UTC](https://discuss.httparchive.org/t/effects-of-varying-traffic-during-monthly-crawl/1865 "2020-02-11T15:20:39Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![AlexA](https://avatars.discourse-cdn.com/v4/letter/a/e36b37/32.png) [@AlexA](https://discuss.httparchive.org/u/AlexA)\
**Post date:** [February 11, 2020, 3:20pm UTC](https://discuss.httparchive.org/t/effects-of-varying-traffic-during-monthly-crawl/1865/1 "2020-02-11T15:20:39Z")

</div>

I know that the [FAQ](https://httparchive.org/faq) explains that each URL is visited 3 times and the median result is recorded. However, I noticed that the response to [this post in the Meta section](https://discuss.httparchive.org/t/frequency-of-updates/1846) indicates that that the monthly crawl can take several weeks to complete. Taking these two together, I am curious if the repeat measurements mentioned in the FAQ are made consecutively after the initial visit or are they scattered throughout the crawl. If the 3 visits are made consecutively, are there methods to account for the differences in networking conditions between two sites which were measured at different times of day? For example, there is likely to be more traffic and congestion in the Internet at 10am when compared to 2am.

---

<div class="post-metadata">

**Author:** ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\
**Post date:** [February 25, 2020, 5:00pm UTC](https://discuss.httparchive.org/t/effects-of-varying-traffic-during-monthly-crawl/1865/2 "2020-02-25T17:00:41Z")

</div>

The FAQ actually needs to be updated. We’ve reduced the number of runs per test from 3 to 1 to be able to handle the 10x sample size increase last year.

Network conditions are a valid source of concern if what you’re trying to measure is affected by round trip time (RTT). In synthetic testing like this, however, it’s impossible to get a test that’s representative of a typical user experience for all ~5M websites each month. Some users are closer to the web server, some users have slower connections, etc. Similarly, some users have slower phones or laptops and so JS execution may take longer. So I’d recommend that you don’t read too closely into time-based measurements in synthetic testing.

If you want to understand how long it typically takes users to load a page, I strongly recommend using a real-user dataset like the [Chrome UX Report](https://bit.ly/chrome-ux-report) instead.

To answer your underlying question though, when we did run the test 3 times, it was consecutively.

---

<div class="post-metadata">

**Author:** ![charlie.clark](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/charlie.clark/32/842_2.png) [@charlie.clark](https://discuss.httparchive.org/u/charlie.clark)\
**Post date:** [February 25, 2020, 6:02pm UTC](https://discuss.httparchive.org/t/effects-of-varying-traffic-during-monthly-crawl/1865/3 "2020-02-25T18:02:32Z")

</div>

I actually use the [httparchive.org](http://httparchive.org) results to benchmark a group of sites  
that we monitor more frequently, because who monitors the monitor and  
over the time the [httparchive.org](http://httparchive.org) results can be considered indicative  
and a reasonable basis for comparison. However, since the number of  
tests per run has been reduced from three to one the variance for any  
particular site has gone up. This usually seems to be down to “network  
effects” and these can be extremely difficult to track.

Charlie