For my master thesis on Early Hints I’d like to find websites that return Early Hints (HTTP | 2022 | The Web Almanac by HTTP Archive) to do performance experiments with them.
How to find urls that return early hints with BigQuery?
1 Like
If you are looking for aggregated metrics, I think the query used in the section you linked should work. To view the SQL query, click on the three dots in the top right of a chart or figure and select View query:
If you’re looking at example URLs which use early hints, you can modify the query slightly. Note that I am excluding Early Hints from Shopify:
WITH requests AS (
SELECT
_TABLE_SUFFIX AS client,
url AS page,
JSON_EXTRACT(payload, '$._early_hint_headers') AS early_hints,
JSON_EXTRACT(payload, '$._contentType') AS type,
FROM
`httparchive.requests.2023_02_01_*` TABLESAMPLE SYSTEM(1 PERCENT)
)
SELECT
client,
page,
early_hints,
type
FROM
requests
WHERE
type = '"text/html"' AND
early_hints IS NOT NULL AND
early_hints NOT LIKE '%shopify%'
Example (random sample):
| desktop | https://www.innovatingtheoutdoors.com/ | ["HTTP/1.1 103","link: <https://static.wixstatic.com/>; rel=preconnect,<https://static.parastorage.com/>; rel=preconnect; crossorigin,<https://static.parastorage.com/>; rel=preconnect"] | "text/html" |
| desktop | https://www.grab.co.jp/ | ["HTTP/1.1 103","link: <https://static.wixstatic.com/>; rel=preconnect,<https://static.parastorage.com/>; rel=preconnect; crossorigin,<https://static.parastorage.com/>; rel=preconnect"] | "text/html" |
| desktop | https://www.tequilasunrise.us/ | ["HTTP/1.1 103","link: <https://static.wixstatic.com/>; rel=preconnect,<https://static.parastorage.com/>; rel=preconnect; crossorigin,<https://static.parastorage.com/>; rel=preconnect"] | "text/html" |
| desktop | https://www.compare-insurance.co.il/ | ["HTTP/1.1 103","link: <https://static.wixstatic.com/>; rel=preconnect,<https://static.parastorage.com/>; rel=preconnect; crossorigin,<https://static.parastorage.com/>; rel=preconnect"] | "text/html" |
| desktop | https://www.gogetcertified.com/ | ["HTTP/1.1 103","link: <https://static.wixstatic.com/>; rel=preconnect,<https://static.parastorage.com/>; rel=preconnect; crossorigin,<https://static.parastorage.com/>; rel=preconnect"] | "text/html" |
| desktop | https://www.thecurrentnow.org/ | ["HTTP/1.1 103","link: <https://static.wixstatic.com/>; rel=preconnect,<https://static.parastorage.com/>; rel=preconnect; crossorigin,<https://static.parastorage.com/>; rel=preconnect"] | "text/html" |
| mobile | https://www.starwest-botanicals.com/ | ["HTTP/1.1 103","link: <https://static.klaviyo.com/onsite/js/klaviyo.js?company_id=eZ6ddc>; as=script; rel=preload, <https://cdn11.bigcommerce.com/s-c5b72e6lyi>; as=font; crossorigin=anonymous; rel=preconnect, <https://fonts.googleapis.com/>; as=font; crossorigin=anonymous; rel=preconnect, <https://fonts.gstatic.com/>; as=font; crossorigin=anonymous; rel=preconnect, <https://fonts.googleapis.com/css?family=Montserrat:700,500,400%7COswald:400&display=block>; as=style; rel=preload, <https://cdn11.bigcommerce.com/s-c5b72e6lyi/stencil/3f36d810-7f05-013b-2fa8-5e658a982588/e/80e87760-8312-013b-f8d4-2a14abfc1e9f/css/theme-85ee9250-83fc-013b-d485-0e44de22823d.css>; as=style; rel=preload"] | "text/html" |
| mobile | https://www.starwest-botanicals.com/blog/-curry-spices-indian-spices-and-thai-spices-for-delicious-dishes/ | ["HTTP/1.1 103","link: <https://static.klaviyo.com/onsite/js/klaviyo.js?company_id=eZ6ddc>; as=script; rel=preload"] | "text/html" |
| mobile | https://www.starwest-botanicals.com/blog/paprika-vs-cayenne-whats-the-difference/ | ["HTTP/1.1 103","link: <https://static.klaviyo.com/onsite/js/klaviyo.js?company_id=eZ6ddc>; as=script; rel=preload"] | "text/html" |
| mobile | https://www.starwest-botanicals.com/blog/is-it-worth-buying-organic-spices/ | ["HTTP/1.1 103","link: <https://static.klaviyo.com/onsite/js/klaviyo.js?company_id=eZ6ddc>; as=script; rel=preload"] | "text/html" |
Hope that helps.
1 Like