# How many sites are using mod\_pagespeed? **URL:** \ **Category:** Analysis\ **Created:** [October 26, 2013, 10:01pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86 "2013-10-26T22:01:19Z")\ **Posts on this page:** 11\ **Page:** 1
**Author:** ![andydavies](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/andydavies/32/1306_2.png) [@andydavies](https://discuss.httparchive.org/u/andydavies)\ **Post date:** [October 26, 2013, 10:01pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/1 "2013-10-26T22:01:21Z")
Looks like 191 sites in the archive are using mod\_pagespeed and 29 of them have keep-alives disabled ```sql SELECT * FROM [httparchive:runs.latest_requests] WHERE LOWER(respotherheaders) CONTAINS "x-mod-pagespeed" AND LOWER(resp_connection) CONTAINS "close" AND firstreq = true ``` ---
**Author:** ![igrigorik](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/igrigorik/32/925_2.png) [@igrigorik](https://discuss.httparchive.org/u/igrigorik)\ **Post date:** [October 27, 2013, 4:25pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/2 "2013-10-27T16:25:25Z")
@andydavies That doesn’t seem like a valid way to test keep-alive? You’re assuming that firstreq = disabled keepalive, but the browser could have just opened a new connection because others are busy or occupied. Shouldn’t you look for “Keep-Alive: close” instead? ---
**Author:** ![andydavies](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/andydavies/32/1306_2.png) [@andydavies](https://discuss.httparchive.org/u/andydavies)\ **Post date:** [October 27, 2013, 6:12pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/3 "2013-10-27T18:12:06Z")
I should have been clearer, the query returns the 191 sites that use mod\_pagespeed, to filter down to those that don’t have keep-alive enabled needs the extra check for connection = close (don’t have the data in front of me ATM so column name might be wrong) The firstreq = true is an attempt to just filter the request for the document but if the first response is a redirect then some sites might be missed. ---
**Author:** ![igrigorik](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/igrigorik/32/925_2.png) [@igrigorik](https://discuss.httparchive.org/u/igrigorik)\ **Post date:** [October 27, 2013, 6:56pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/4 "2013-10-27T18:56:40Z")
@andydavies right. Updated the query in your original post to include “Connection: close” condition – also getting 29 hosts. ---
**Author:** ![jmarantz](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jmarantz](https://discuss.httparchive.org/u/jmarantz)\ **Post date:** [June 11, 2014, 7:04pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/5 "2014-06-11T19:04:37Z")
For what it’s worth, the actual number of hosts with mod\_pagespeed and ngx\_pagespeed is much higher (hundreds of thousands); I am curious what the difference is. But in any case, when I took Andy’s query and removed the Connection:close test I got 1656 rows. [http://trends.builtwith.com/Server/mod\_pagespeed](http://trends.builtwith.com/Server/mod_pagespeed) reports 235k sites but we believe the number is higher. ---
**Author:** ![andydavies](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/andydavies/32/1306_2.png) [@andydavies](https://discuss.httparchive.org/u/andydavies)\ **Post date:** [June 11, 2014, 7:41pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/6 "2014-06-11T19:41:42Z")
Be interesting to see if we could work out what the penetration of the other accelerators is. I’ve got customers using mod\_pagespeed, Akamai’s Aqua Ion and Radware’s Fastview plus some looking a PSS I think Akamai uses _X-Akamai-Transformed_ and Radware _X-Strangeloop_ but I guess I should check with Guy and Tammy to be certain ---
**Author:** ![jmarantz](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jmarantz](https://discuss.httparchive.org/u/jmarantz)\ **Post date:** [June 11, 2014, 7:55pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/7 "2014-06-11T19:55:45Z")
Those (Akamai & Strangeloop) look like great BigQuery queries to do. What I’m curious is: how many sites total are represented in BigQuery? My extrapolation says that’s somewhere between 1/100 and 1/1000 of the whole internet. Does that sound plausible? I can’t be very accurate in my extrapolation because builtwith’s data indicates mod\_pagespeed percent usage is higher in the top 100k sites than the long tail. ---
**Author:** ![jmarantz](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jmarantz](https://discuss.httparchive.org/u/jmarantz)\ **Post date:** [June 11, 2014, 8:58pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/8 "2014-06-11T20:58:38Z")
The Akamai & Strangeloop queries both worked: 62 and 40 rows, respectively. However they sites using those technologies included large ones on the first page ([www.target.com](http://www.target.com) and [www.walgreens.com](http://www.walgreens.com)) respectively. ---
**Author:** ![igrigorik](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/igrigorik/32/925_2.png) [@igrigorik](https://discuss.httparchive.org/u/igrigorik)\ **Post date:** [June 11, 2014, 9:23pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/9 "2014-06-11T21:23:37Z")
HTTP Archive is currently tracking the top 300K Alexa sites for desktop and top 5K for mobile. Not sure how that extrapolates to the “entire internet”, but all numbers obtained here would be relative to that. ---
**Author:** ![jmarantz](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jmarantz](https://discuss.httparchive.org/u/jmarantz)\ **Post date:** [June 12, 2014, 3:04pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/10 "2014-06-12T15:04:45Z")
Thanks Ilya, that 1656/300k sites correlates plausibly with builtwith’s data, which says MPS is installed on 676 of the top 100k (0.7%) ---
**Author:** ![jmarantz](https://avatars.discourse-cdn.com/v4/letter/j/7cd45c/32.png) [@jmarantz](https://discuss.httparchive.org/u/jmarantz)\ **Post date:** [June 12, 2014, 6:16pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-using-mod-pagespeed/86/11 "2014-06-12T18:16:20Z")
Also of note: there are 952 sites in the archive with the x-page-speed header, which is used by ngx\_pagespeed, PageSpeed Service, and IISpeed from [we-amp.com](http://we-amp.com) So together that’s (952+1656)/300k = 0.8% of the archive.