# Changes to the HTTP Archive corpus **URL:** \ **Category:** Announcements\ **Created:** [December 30, 2018, 2:36am UTC](https://discuss.httparchive.org/t/changes-to-the-http-archive-corpus/1539 "2018-12-30T02:36:52Z")\ **Posts on this page:** 2\ **Page:** 1
**Author:** ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Post date:** [December 30, 2018, 2:36am UTC](https://discuss.httparchive.org/t/changes-to-the-http-archive-corpus/1539/1 "2018-12-30T02:36:52Z")
![image](https://cdck-file-uploads-canada1.s3.dualstack.ca-central-1.amazonaws.com/flex035/uploads/httparchive/original/2X/a/a4dda8a25c22ee17ea9551cea4da1142ddb79da2.png) [“Sample Size” on the State of the Web report](https://httparchive.org/reports/state-of-the-web#numUrls) Our goal is to have a _high quality corpus_ of websites that we test regularly to accurately track the state of the web. To that end, we’ve started making changes to improve the quality of our corpus: 1. As of **2018\_07\_01** we started using URLs from the Chrome UX Report (CrUX). We switched mobile URLs to CrUX on 07\_15. This increased our coverage from 500K URLs to ~1.3M. 2. As of **2018\_12\_01** we have decreased the number of test runs per URL from 3 to 1. The loss of redundancy may affect the reliability of time-based performance metrics but these are not especially useful in synthetic tests. For accurate real-world performance data join with the CrUX dataset. This change reduces the time for the crawl to complete, allowing us to add more URLs. 3. As of **2018\_12\_15** we have increased the desktop URLs to all CrUX URLs for desktop (3.9M). 4. As of **2019\_01\_01** we are reducing the crawl frequency from semi-monthly to monthly. Combined with the reduced runs per URL, this change will enable us to afford testing the full CrUX corpus for both desktop and mobile. As of this crawl we will increase the mobile URLs to all CrUX URLs for mobile (4.2M). Feel free to reply to this thread if you have any questions or comments. ---
**Author:** ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Post date:** [December 30, 2018, 2:37am UTC](https://discuss.httparchive.org/t/changes-to-the-http-archive-corpus/1539/2 "2018-12-30T02:37:36Z")