# Missing: number of requested domains per page

**URL:** https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328
**Category:** Analysis
**Created:** [April 10, 2018, 6:33pm UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328 "2018-04-10T18:33:15Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![wortwart](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/wortwart/32/1124_2.png) [@wortwart](https://discuss.httparchive.org/u/wortwart)
#### Post date: [April 10, 2018, 6:33pm UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328/1 "2018-04-10T18:33:15Z")

</div>

I can’t find information about the number of different domains requested by a page - which used to be the most interesting datapoint for me here. Is this information gone or have I overlooked it?

---

<div class="post-metadata">

### Author: ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)
#### Post date: [April 11, 2018, 7:24pm UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328/2 "2018-04-11T19:24:53Z")

</div>

In the shuffle of launching the beta website, the legacy website is temporarily housed at [legacy.httparchive.org](http://legacy.httparchive.org), which is where you can find older metrics like the number of domains: [https://legacy.httparchive.org/trends.php#numDomains&maxDomainReqs](https://legacy.httparchive.org/trends.php#numDomains&maxDomainReqs)

Curious to hear what you use the data for.

---

<div class="post-metadata">

### Author: ![wortwart](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/wortwart/32/1124_2.png) [@wortwart](https://discuss.httparchive.org/u/wortwart)
#### Post date: [April 12, 2018, 9:05am UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328/3 "2018-04-12T09:05:55Z")

</div>

There it is, thanks! I really like the new layout and hope you will include this stat.

I’m half developer, half tech journalist. I think including content from many different domains is a serious privacy problem that many developers don’t seem to recognize. So I used this number (which I find shockingly high) in several stories and news I wrote trying to raise awareness.

---

<div class="post-metadata">

### Author: ![LesMurphy](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/lesmurphy/32/666_2.png) [@LesMurphy](https://discuss.httparchive.org/u/LesMurphy)
#### Post date: [April 12, 2018, 2:14pm UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328/4 "2018-04-12T14:14:22Z")

</div>

I think it would be really great if there was a flag noting the nature of each domain - which ones are considered third-party and of what type they are (JS libraries, Advertising, Analytics, Fraud prevention, Social media, Live Chat, etc.)

Google already has a starting point for a database of known domains., Could this be worked into a future version of WPT so they get flagged in the JSON content?

We could do a query to lookup the domains into some sort of reference table, but that would be an expensive query to run to do this sort of basic analysis of the composition of the various sites being crawled.

See:

[https://developers.google.com/web/updates/2017/05/devtools-release-notes#badges](https://developers.google.com/web/updates/2017/05/devtools-release-notes#badges)

[https://stackoverflow.com/questions/45720950/how-do-chrome-devtools-3rd-party-badges-get-added](https://stackoverflow.com/questions/45720950/how-do-chrome-devtools-3rd-party-badges-get-added)

Examples:

[native.sharethrough.com](http://native.sharethrough.com) is Advertising

\*.[outbrain.com](http://outbrain.com) is Advertising

\*.[livefyre.com](http://livefyre.com) is Advertising

([cdn3.optimizely.com](http://cdn3.optimizely.com)|[cdn.optimizely.com](http://cdn.optimizely.com)) is CX optimization

[mouseflow.com](http://mouseflow.com)  
is CX optimization

\*.[howtank.com](http://howtank.com) is Live Chat

\*.

[providesupport.com](http://providesupport.com)  
is Live Chat

\*.

[livestatserver.com](http://livestatserver.com) is Analytics

\*.

[pardot.com](http://pardot.com) is Marketing automation

\*.

[optnmnstr.com](http://optnmnstr.com) is Abandonment Detection / eCommerce

\*.[riskified.com](http://riskified.com) is Fraud detection

---

<div class="post-metadata">

### Author: ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)
#### Post date: [April 13, 2018, 6:56am UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328/5 "2018-04-13T06:56:07Z")

</div>

@LesMurphy that reminds me that we have an open feature request to do something very similar: [https://github.com/HTTPArchive/httparchive.org/issues/12](https://github.com/HTTPArchive/httparchive.org/issues/12). Would you be interested to contribute in any way?

---

<div class="post-metadata">

### Author: ![LesMurphy](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/lesmurphy/32/666_2.png) [@LesMurphy](https://discuss.httparchive.org/u/LesMurphy)
#### Post date: [April 13, 2018, 1:03pm UTC](https://discuss.httparchive.org/t/missing-number-of-requested-domains-per-page/1328/6 "2018-04-13T13:03:33Z")

</div>

Somehow I missed seeing that post. See my reply there. Thanks!
