Which domains are the top third party dependencies?


#1
SELECT DOMAIN(req.url) third_party, COUNT(*) num_requests
FROM [httparchive:runs.latest_requests] as req JOIN (
  SELECT DOMAIN(url) self, pageid
  FROM [httparchive:runs.latest_pages]
) as pages ON pages.pageid = req.pageid
WHERE DOMAIN(req.url) != pages.self
GROUP BY third_party
ORDER BY num_requests desc

#2

Top 100 dependencies for Top 1K sites (for Nov 1, 2014):

SELECT DOMAIN(req.url) third_party, COUNT(*) num_requests
FROM [httparchive:runs.2014_11_01_requests] as req JOIN (
  SELECT DOMAIN(url) self, pageid
  FROM [httparchive:runs.2014_11_01_pages]
  WHERE rank <= 1000
) as pages ON pages.pageid = req.pageid
WHERE DOMAIN(req.url) != pages.self
GROUP BY third_party
ORDER BY num_requests desc
LIMIT 100
third_party,num_requests
doubleclick.net,2892
googlesyndication.com,1737
google.com,1697
facebook.com,1265
google-analytics.com,1258
cloudfront.net,1129
liverail.com,1053
gstatic.com,1022
scorecardresearch.com,986
ebayimg.com,913
rlcdn.com,891
akamaihd.net,880
images-amazon.com,851
adnxs.com,635
twitter.com,580
mathtag.com,515
googleapis.com,468
googleadservices.com,463
bang5mai.com,446
rubiconproject.com,443
openx.net,410
adroll.com,408
mfcimg.com,392
alicdn.com,377
yahoo.com,373
baidu.com,362
krxd.net,354
bluekai.com,326
quantserve.com,323
saraminbanner.co.kr,311
demdex.net,296
phncdn.com,295
taobaocdn.com,292
moatads.com,289
sdlcdn.com,278
ebaystatic.com,273
fsanook.com,271
amazonaws.com,260
crwdcntrl.net,258
k-img.com,258
facebook.net,249
pbwstatic.com,239
52pk.com,236
casalemedia.com,236
criteo.com,236
turn.com,234
2mdn.net,234
qiyipic.com,233
twimg.com,233
tiqcdn.com,223
spotxchange.com,217
pubmatic.com,212
xgo-img.com.cn,212
adap.tv,209
ticketm.net,209
ssl-images-amazon.com,204
imrworldwide.com,204
rakuten-static.com,203
exelator.com,190
turner.com,189
cbsistatic.com,187
slickdealscdn.com,185
yandex.ru,183
deviantart.net,179
amazon-adsystem.com,178
googleusercontent.com,178
googletagservices.com,177
mlstatic.com,173
newrelic.com,172
ol-img.com,170
adsafeprotected.com,170
saraminimage.co.kr,170
nexac.com,168
gannett-cdn.com,168
gcimg.net,167
tanx.com,167
ui-portal.de,161
bleacherreport.net,160
adadvisor.net,159
s-microsoft.com,158
serving-sys.com,158
revsci.net,154
wpimg.pl,154
zdn.vn,154
edgesuite.net,153
xcarimg.com,152
gemius.pl,151
ykimg.com,151
bbci.co.uk,150
espncdn.com,150
advertising.com,149
statig.com.br,148
smartadserver.com,147
truste.com,146
011st.com,145
kinja-img.com,144
btrll.com,141
cdscdn.com,140
st-hatena.com,140
yandex.net,140

#3

Update for May 15, 2016


third_party,num_requests
doubleclick.net,4854
liverail.com,3068
googlesyndication.com,2920
facebook.com,2387
google.com,1955
google-analytics.com,1648
ssl-images-amazon.com,1443
cloudfront.net,1385
rlcdn.com,1377
advertising.com,1321
scorecardresearch.com,1248
openx.net,1196
gstatic.com,1163
btrll.com,1038
mathtag.com,949
adnxs.com,914
moatads.com,912
2mdn.net,872
googleapis.com,827
adsafeprotected.com,811
rubiconproject.com,789
images-amazon.com,782
pubmatic.com,768
alicdn.com,758
ebayimg.com,747
casalemedia.com,742
videe.tv,709
bluekai.com,691
krxd.net,689
spotxchange.com,684
demdex.net,665
quantserve.com,629
turn.com,602
contextweb.com,578
springserve.com,572
twitter.com,570
adsrvr.org,562
adap.tv,519
serving-sys.com,489
googleadservices.com,482
baidu.com,455
fbcdn.net,451
crwdcntrl.net,449
akamaihd.net,440
tiqcdn.com,437
exelator.com,437
altitude-arena.com,427
criteo.com,423
amazonaws.com,422
facebook.net,392
yahoo.com,392
saraminbanner.co.kr,383
klimg.com,376
tubemogul.com,361
nexac.com,348
amazon-adsystem.com,338
taboola.com,334
yandex.ru,331
qhimg.com,327
googletagservices.com,320
twimg.com,314
ebaystatic.com,309
mfcimg.com,295
imrworldwide.com,290
revsci.net,287
rfihub.com,283
k-img.com,274
optimatic.com,273
adadvisor.net,271
w55c.net,260
adtechus.com,257
rakuten-static.com,253
bidswitch.net,253
innovid.com,247
lijit.com,246
phncdn.com,243
tribalfusion.com,238
doubleverify.com,235
betrad.com,231
adobedtm.com,227
360buyimg.com,226
agkn.com,224
everesttech.net,216
truste.com,216
smartadserver.com,214
ytimg.com,213
sinaimg.cn,213
adroll.com,210
optimizely.com,205
bidr.io,200
uecdn.es,199
servedbyopenx.com,199
flashtalking.com,199
lrcdn.net,196
slickdealscdn.com,195
omtrdc.net,193
turner.com,193
isu.pub,191
ipornia.com,191
eyeviewads.com,189