# Number of domains in HTTPArchive **URL:** \ **Category:** Analysis\ **Created:** [September 12, 2017, 4:13pm UTC](https://discuss.httparchive.org/t/number-of-domains-in-httparchive/1069 "2017-09-12T16:13:36Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![amirian](https://avatars.discourse-cdn.com/v4/letter/a/e19b73/32.png) [@amirian](https://discuss.httparchive.org/u/amirian)\ **Post date:** [September 12, 2017, 4:13pm UTC](https://discuss.httparchive.org/t/number-of-domains-in-httparchive/1069/1 "2017-09-12T16:13:36Z")
Why are there only about 470K domains, even though the FAQ states that the http archive crawls the Alexa Top 1 Mil? Along those notes, when crawling, do you use the updated Alexa file from that day? So, if you run a scan on 9/1, do you use the Alexa file from 9/1, or is there a set that you are scanning? ---
**Author:** ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Post date:** [September 13, 2017, 5:29pm UTC](https://discuss.httparchive.org/t/number-of-domains-in-httparchive/1069/2 "2017-09-13T17:29:23Z")
Hi @amirian good questions! > [@amirian](#): > > Why are there only about 470K domains, even though the FAQ states that the http archive crawls the Alexa Top 1 Mil? HTTP Archive does use the Alexa Top 1M websites to seed its list of pages to crawl. However, from that list of 1M we only use the first 500K – that’s all we can fit in the 2 week window between crawls! So then why are you seeing 470K instead of 500K? Approximately 30K of the tests fail each crawl. This could be due to an error in WebPageTest or the website itself. Check out [Handle errors · Issue #115 · HTTPArchive/legacy.httparchive.org · GitHub](https://github.com/HTTPArchive/httparchive/issues/115) to learn more about these errors and how we plan to mitigate them. > [@amirian](#): > > Along those notes, when crawling, do you use the updated Alexa file from that day? So, if you run a scan on 9/1, do you use the Alexa file from 9/1, or is there a set that you are scanning? [Alexa has stopped updating their list of 1M sites](https://github.com/HTTPArchive/hosts/issues/1). HTTP Archive uses an older snapshot of the list for each of the crawls, so you should expect to see the same URLs and page ranks in all of the crawls this year. The link above has more info about the Alexa list and some alternatives. ---
**Author:** ![Yeribel](https://avatars.discourse-cdn.com/v4/letter/y/858c86/32.png) [@Yeribel](https://discuss.httparchive.org/u/Yeribel)\ **Post date:** [September 22, 2017, 2:58pm UTC](https://discuss.httparchive.org/t/number-of-domains-in-httparchive/1069/3 "2017-09-22T14:58:19Z")
Si mi [Sitio web de Anuncios Clasificados](https://www.marketplace.com.do) no está en el top 1mill de alexa ranks no podré verlo en httparchive? o qué más se toma en cuenta? ---
**Author:** ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Post date:** [September 24, 2017, 7:56pm UTC](https://discuss.httparchive.org/t/number-of-domains-in-httparchive/1069/4 "2017-09-24T19:56:10Z")
> [@Yeribel](#): > > Si mi Sitio web de Anuncios Clasificados no está en el top 1mill de alexa ranks no podré verlo en httparchive? > If my Classified Ads Website is not in the top 1mill of alexa ranks I will not be able to see it on httparchive? Correct, by default only the first 500,000 websites in Alexa’s top 1 million list are included. HTTP Archive does have a way to add URLs that are not in the top 500k. Go to [http://httparchive.org/addsite.php](http://httparchive.org/addsite.php) and enter your website’s URL to add it to future crawls. Be advised that this functionality may not work in the future beta site.