Per the FAQ : Only the URLs whose domain is in the Alexa Top 1,000,000 ranked list are included. However, research shows that the Alexa ranking (and similar rankings) can change significantly on a daily basis and can trivially be manipulated by malicious actors. The researchers present the Tranco…

I believe HTTP Archive no longer uses Alexa rankings, though @rviscomi knows better than I.

Hi @mathias - thanks for sharing! This looks really interesting. @developit is right, we don’t currently have a ranking indicator in the HTTP Archive data. That Alexa list was outdated as well, since the top million list is no longer available to us. There was a GitHub issue on this topic here - h…

The rankings really are SEO or advertising oriented. The CrUX list has the advantage (and disadvantage) of being entirely quantitative and, as it has no ranking, pointless to try and game. I think sectoral or national groupings probably make more sense than any kind ranking.

If we’re no longer using the Alexa list, can we update the FAQ entry accordingly? Thanks.

Hey! One of the authors of the Tranco list here If you are using the CrUX list in its entirety, I belief that it provides a better source of domains for HTTP Archive. In fact, in the near future we’re adding a configuration option to only include domains that are also in CrUX. If you’d like to use…

[image] mathias: If we’re no longer using the Alexa list, can we update the FAQ entry accordingly? Thanks. Yes, thanks for pointing that out. Filed this bug: Update the FAQ about where HA gets its URLs · Issue #129 · HTTPArchive/httparchive.org · GitHub

PR #130 (merged) https://github.com/HTTPArchive/httparchive.org/pull/130 indicates CrUX is used, and Alexa not.

Use Tranco list instead of Alexa Top 1M

Analysis

rviscomi February 25, 2019, 5:03pm 7

Yes, thanks for pointing that out. Filed this bug: Update the FAQ about where HA gets its URLs · Issue #129 · HTTPArchive/httparchive.org · GitHub

Topic		Replies	Views
Recent Alexa Ranks	4	1674	June 22, 2021
Number of domains in HTTPArchive Analysis	3	2092	September 24, 2017
Alexa Rank for each url Meta	1	1932	January 27, 2020
Getting domain rank with the new rank-less Chrome UX Report corpus Analysis	0	3000	August 24, 2018
Why number of URLs are changing in each month?	8	1250	April 22, 2020

Use Tranco list instead of Alexa Top 1M

Related topics