# Uncategorized **URL:** https://discuss.httparchive.org/c/uncategorized/7.md [Latest](https://discuss.httparchive.org/latest.md) · [Categories](https://discuss.httparchive.org/categories.md) --- ## [Licence and preferred attribution for Technology Report data](https://discuss.httparchive.org/t/licence-and-preferred-attribution-for-technology-report-data/3117)
**Author:** [@immortal](https://discuss.httparchive.org/u/immortal)\ **Replies:** 1\ **Last updated:** [September 21, 2026, 9:30am UTC](https://discuss.httparchive.org/t/licence-and-preferred-attribution-for-technology-report-data/3117 "2026-09-21T09:30:52Z")
Hi all, I run inetgeek.com, a small comparison site for hosting and infrastructure providers. I’ve started using the Technology Report API to show per-category adoption bars — for example the three PaaS providers I tr… --- ## [Best way to extract gtm.js response bodies at scale, BigQuery cost vs raw HAR access?](https://discuss.httparchive.org/t/best-way-to-extract-gtm-js-response-bodies-at-scale-bigquery-cost-vs-raw-har-access/3104)
**Author:** [@dev.dandp](https://discuss.httparchive.org/u/dev.dandp)\ **Replies:** 1\ **Last updated:** [July 10, 2026, 11:13pm UTC](https://discuss.httparchive.org/t/best-way-to-extract-gtm-js-response-bodies-at-scale-bigquery-cost-vs-raw-har-access/3104 "2026-07-10T23:13:13Z")
I’m doing research that requires collecting the response bodies of gtm.js (Google Tag Manager) resources across crawled sites, ideally over multiple monthly crawls. My filter is essentially: SELECT date, page, url, res… --- ## [Httparchive not found](https://discuss.httparchive.org/t/httparchive-not-found/2983)
**Author:** [@dizel3d](https://discuss.httparchive.org/u/dizel3d)\ **Replies:** 1\ **Last updated:** [February 15, 2026, 7:54pm UTC](https://discuss.httparchive.org/t/httparchive-not-found/2983 "2026-02-15T19:54:46Z")
I cannot find httparchive via BigQuery search. I’m located in Russia. Is it possible that this dataset is hidden or restricted in my country? --- ## [Accessing HAR files for most recent crawl](https://discuss.httparchive.org/t/accessing-har-files-for-most-recent-crawl/2982)
**Author:** [@anisenoff](https://discuss.httparchive.org/u/anisenoff)\ **Replies:** 0\ **Last updated:** [February 11, 2026, 7:06pm UTC](https://discuss.httparchive.org/t/accessing-har-files-for-most-recent-crawl/2982 "2026-02-11T19:06:00Z")
From other posts it is my understanding is that only the HAR files from the most recent crawl are retained. I was wondering if there are instructions as the how to access that data directly rather than reconstructing it … --- ## [Http archive bot/crawler declared?](https://discuss.httparchive.org/t/http-archive-bot-crawler-declared/2941)
**Author:** [@mes271828](https://discuss.httparchive.org/u/mes271828)\ **Replies:** 1\ **Last updated:** [November 24, 2025, 10:29am UTC](https://discuss.httparchive.org/t/http-archive-bot-crawler-declared/2941 "2025-11-24T10:29:42Z")
I’m writing a research paper and need to explain how the http archive crawler declares itself to websites as a bot. can you please explain this to me? I’m particularly interested in learning if it’s included on this li… --- ## [Can I access to raw results of Web Almanac markup query from google BigQuery?](https://discuss.httparchive.org/t/can-i-access-to-raw-results-of-web-almanac-markup-query-from-google-bigquery/2841)
**Author:** [@silentimp](https://discuss.httparchive.org/u/silentimp)\ **Replies:** 2\ **Last updated:** [December 12, 2024, 2:46pm UTC](https://discuss.httparchive.org/t/can-i-access-to-raw-results-of-web-almanac-markup-query-from-google-bigquery/2841 "2024-12-12T14:46:51Z")
Hi, I want to know the adoption of details, summary and dialog html elements, ideally with change over years. And maybe it’s bit too early, but popover and invoker commands-related attributes. I did try to create a qu… --- ## [Examining Web Performance Metric Trends](https://discuss.httparchive.org/t/examining-web-performance-metric-trends/2806)
**Author:** [@harryson614](https://discuss.httparchive.org/u/harryson614)\ **Replies:** 0\ **Last updated:** [October 14, 2024, 12:51pm UTC](https://discuss.httparchive.org/t/examining-web-performance-metric-trends/2806 "2024-10-14T12:51:31Z")
Hello Everyone :hugs:, I’m contacting you in order to get your thoughts and ideas on web performance measurements, with an emphasis on the data trends we’ve noticed in the HTTP Archive. Web performance, as we all know,… --- ## [% of good CWV](https://discuss.httparchive.org/t/of-good-cwv/2757)
**Author:** [@Roman](https://discuss.httparchive.org/u/Roman)\ **Replies:** 1\ **Last updated:** [May 30, 2024, 1:47pm UTC](https://discuss.httparchive.org/t/of-good-cwv/2757 "2024-05-30T13:47:24Z")
Hello, pls help me to understand how Percent good CWV is calculated in my case I have 70% good on INP, 96% good on LCP, 83% good on CLS BUT only 60% of good CWV (which I was assuming like a total average) --- ## [How long does it take for a domain to be labeled to have a given technology](https://discuss.httparchive.org/t/how-long-does-it-take-for-a-domain-to-be-labeled-to-have-a-given-technology/2759)
**Author:** [@gbrlmtrz](https://discuss.httparchive.org/u/gbrlmtrz)\ **Replies:** 1\ **Last updated:** [May 30, 2024, 1:36pm UTC](https://discuss.httparchive.org/t/how-long-does-it-take-for-a-domain-to-be-labeled-to-have-a-given-technology/2759 "2024-05-30T13:36:52Z")
This is a follow up of this question I am curious how long does it take for a domain to be labeled to be using a given technology? I see that this dataset httparchive.technologies.2024\_05\_01\_\* is used to query a given t… --- ## [Translating JavaScript API names to feature names](https://discuss.httparchive.org/t/translating-javascript-api-names-to-feature-names/2712)
**Author:** [@kzar](https://discuss.httparchive.org/u/kzar)\ **Replies:** 2\ **Last updated:** [February 26, 2024, 12:24pm UTC](https://discuss.httparchive.org/t/translating-javascript-api-names-to-feature-names/2712 "2024-02-26T12:24:25Z")
I’m hoping to order a bunch of JavaScript APIs by usage, as a way to understand which of the APIs might be more/less important. Is there a recommended way to translate JavaScript API names (e.g. window.navigator.userAge… --- ## [Warning: $14,000 BigQuery Charge in 2 Hours](https://discuss.httparchive.org/t/warning-14-000-bigquery-charge-in-2-hours/2715)
**Author:** [@Tim](https://discuss.httparchive.org/u/Tim)\ **Replies:** 5\ **Last updated:** [February 22, 2024, 7:46pm UTC](https://discuss.httparchive.org/t/warning-14-000-bigquery-charge-in-2-hours/2715 "2024-02-22T19:46:45Z")
This website makes it seem like this “public” dataset is for the community to use, but it is instead a for-profit money maker for Google Cloud and you can lose tens of thousands of dollars. Last week I ran a script on B… --- ## [Web vitals score](https://discuss.httparchive.org/t/web-vitals-score/2706)
**Author:** [@vebrt99](https://discuss.httparchive.org/u/vebrt99)\ **Replies:** 0\ **Last updated:** [February 11, 2024, 8:53pm UTC](https://discuss.httparchive.org/t/web-vitals-score/2706 "2024-02-11T20:53:50Z")
Hello, I have question about how to get data for Web vitals score. I am using Google Lighthouse and i wanted to edit score values for the latest ones. Right in the source files there are links like this - https://bigque… --- ## [Pages and Requests later than Apr 2022 in gs://httparchive/downloads/](https://discuss.httparchive.org/t/pages-and-requests-later-than-apr-2022-in-gs-httparchive-downloads/2667)
**Author:** [@marty90](https://discuss.httparchive.org/u/marty90)\ **Replies:** 6\ **Last updated:** [November 27, 2023, 5:56pm UTC](https://discuss.httparchive.org/t/pages-and-requests-later-than-apr-2022-in-gs-httparchive-downloads/2667 "2023-11-27T17:56:16Z")
Hello, I used to download the list of pages and requests from gs://httparchive/downloads/ , where there are files like: httparchive\_Sep\_1\_2021\_requests.gz However, there is no data newer than April 2022. Is the data m… --- ## [Accessing Web Almanac 2022's raw data?](https://discuss.httparchive.org/t/accessing-web-almanac-2022s-raw-data/2616)
**Author:** [@d33tah](https://discuss.httparchive.org/u/d33tah)\ **Replies:** 2\ **Last updated:** [August 30, 2023, 9:10am UTC](https://discuss.httparchive.org/t/accessing-web-almanac-2022s-raw-data/2616 "2023-08-30T09:10:40Z")
Hi! Is there a way to download all 42TB of Web Almanac’s data? --- ## [How to find websites that use Early Hints](https://discuss.httparchive.org/t/how-to-find-websites-that-use-early-hints/2528)
**Author:** [@manuel](https://discuss.httparchive.org/u/manuel)\ **Replies:** 1\ **Last updated:** [February 24, 2023, 10:48pm UTC](https://discuss.httparchive.org/t/how-to-find-websites-that-use-early-hints/2528 "2023-02-24T22:48:07Z")
For my master thesis on Early Hints I’d like to find websites that return Early Hints (HTTP | 2022 | The Web Almanac by HTTP Archive) to do performance experiments with them. How to find urls that return early hints wit… --- ## [Find all web sites which share the same Google Analytics ID](https://discuss.httparchive.org/t/find-all-web-sites-which-share-the-same-google-analytics-id/2514)
**Author:** [@dimov](https://discuss.httparchive.org/u/dimov)\ **Replies:** 0\ **Last updated:** [January 23, 2023, 1:11pm UTC](https://discuss.httparchive.org/t/find-all-web-sites-which-share-the-same-google-analytics-id/2514 "2023-01-23T13:11:57Z")
Hi, I have imported the httparchive dataset in BigQuery I have a question, Is it possible to retrieve all of the web pages which share the same google analitics ID? --- ## [Httparchive.technologies Nov 22 missing](https://discuss.httparchive.org/t/httparchive-technologies-nov-22-missing/2498)
**Author:** [@morw](https://discuss.httparchive.org/u/morw)\ **Replies:** 0\ **Last updated:** [December 15, 2022, 8:47am UTC](https://discuss.httparchive.org/t/httparchive-technologies-nov-22-missing/2498 "2022-12-15T08:47:21Z")
Hey, why \`httparchive.technologies.2022\_11\_01\_\*’ tabels are missing? Thanks, Mor Topaz (wix.com) --- ## [BigQuery broken link](https://discuss.httparchive.org/t/bigquery-broken-link/2366)
**Author:** [@Code-Pang](https://discuss.httparchive.org/u/Code-Pang)\ **Replies:** 10\ **Last updated:** [December 3, 2022, 9:48am UTC](https://discuss.httparchive.org/t/bigquery-broken-link/2366 "2022-12-03T09:48:44Z")
Through this link Google Cloud Platform Adding a dataset is always in the loading state --- ## [Is there any way to download daily historical data about website performance (1 year period) in CSV or Excel format for different websites?](https://discuss.httparchive.org/t/is-there-any-way-to-download-daily-historical-data-about-website-performance-1-year-period-in-csv-or-excel-format-for-different-websites/2325)
**Author:** [@imranmehmet](https://discuss.httparchive.org/u/imranmehmet)\ **Replies:** 19\ **Last updated:** [October 19, 2022, 8:18am UTC](https://discuss.httparchive.org/t/is-there-any-way-to-download-daily-historical-data-about-website-performance-1-year-period-in-csv-or-excel-format-for-different-websites/2325 "2022-10-19T08:18:20Z")
My name is Imran and I am currently in the last term of my master’s degree and writing my master’s thesis regarding website performance, SEO, and customer engagement. In terms of my thesis topic, I need the below daily h… --- ## [URL-Level Data](https://discuss.httparchive.org/t/url-level-data/2409)
**Author:** [@rabell](https://discuss.httparchive.org/u/rabell)\ **Replies:** 0\ **Last updated:** [August 19, 2022, 2:23pm UTC](https://discuss.httparchive.org/t/url-level-data/2409 "2022-08-19T14:23:19Z")
Hi there - I stumbled upon this site, and the report and forums are great! Lots of awesome reports and insights to dig through and digest. Do you have URL-level detail available for the reports? I’m probably most inter… --- ## [Proportion of browsers with 3rd party cookies off](https://discuss.httparchive.org/t/proportion-of-browsers-with-3rd-party-cookies-off/2400)
**Author:** [@DaneelOlivaw](https://discuss.httparchive.org/u/DaneelOlivaw)\ **Replies:** 0\ **Last updated:** [July 21, 2022, 3:22am UTC](https://discuss.httparchive.org/t/proportion-of-browsers-with-3rd-party-cookies-off/2400 "2022-07-21T03:22:28Z")
Hi, I’d like to know what proportion of browsers have 3rd part cookies switched off. My searches haven’t come up with anything, yet. Can anybody share links to worthwhile research on that? --- ## [Picture element display values](https://discuss.httparchive.org/t/picture-element-display-values/1745)
**Author:** [@briankardell](https://discuss.httparchive.org/u/briankardell)\ **Replies:** 5\ **Last updated:** [February 18, 2022, 3:15pm UTC](https://discuss.httparchive.org/t/picture-element-display-values/1745 "2022-02-18T15:15:10Z")
Recently there is a question, from a standards and implementation perspective about how often the display value is set by authors for the picture element because of interest in changing something, for example, in a UA de… --- ## [Recent Alexa Ranks](https://discuss.httparchive.org/t/recent-alexa-ranks/2169)
**Author:** [@Lauren2909](https://discuss.httparchive.org/u/Lauren2909)\ **Replies:** 4\ **Last updated:** [June 22, 2021, 8:14am UTC](https://discuss.httparchive.org/t/recent-alexa-ranks/2169 "2021-06-22T08:14:57Z")
Is there any way to access/pay to access more up to date Alexa rankings on the HTTP Archive/ Google Query tables? Under the “URL” table, the Alexa domains and rankings are provided for up to 2017. Thanks! --- ## [Technology detection - Core Web Vitals Technology Report](https://discuss.httparchive.org/t/technology-detection-core-web-vitals-technology-report/2242)
**Author:** [@slvzbvc](https://discuss.httparchive.org/u/slvzbvc)\ **Replies:** 1\ **Last updated:** [October 13, 2021, 12:47pm UTC](https://discuss.httparchive.org/t/technology-detection-core-web-vitals-technology-report/2242 "2021-10-13T12:47:08Z")
Hi, I cannot find an answer, so I am writing here. I represent the Shoper platform, I am wondering how to make your report aware of the larger scale of shops of our solution. Currently I see literally a dozen or so and… --- ## [DNS Server Not-Responding Issue](https://discuss.httparchive.org/t/dns-server-not-responding-issue/2185)
**Author:** [@Michaellanglais](https://discuss.httparchive.org/u/Michaellanglais)\ **Replies:** 3\ **Last updated:** [June 29, 2021, 9:31am UTC](https://discuss.httparchive.org/t/dns-server-not-responding-issue/2185 "2021-06-29T09:31:28Z")
Hello friends. I have not been able to solve a computer’s internet problem for the last 2 days, that is, every time I try to connect the Internet to my computer, the DNS server not responding, the error is showing. I am … --- ## [Does BigQuery contain HAR Archive or cookies of crawled webpages?](https://discuss.httparchive.org/t/does-bigquery-contain-har-archive-or-cookies-of-crawled-webpages/1968)
**Author:** [@\_nurullah](https://discuss.httparchive.org/u/_nurullah)\ **Replies:** 13\ **Last updated:** [June 11, 2021, 6:17pm UTC](https://discuss.httparchive.org/t/does-bigquery-contain-har-archive-or-cookies-of-crawled-webpages/1968 "2021-06-11T18:17:32Z")
Hi, Do we have also HAR Archive of crawled websites or stored cookies while crawling? I didn’t find any table or column in BigQuery. Am I missing something or don’t we have such data? Bests, Nurullah --- ## [Tracking WebP adoption and impact, especially in WordPress](https://discuss.httparchive.org/t/tracking-webp-adoption-and-impact-especially-in-wordpress/2150)
**Author:** [@adamsilverstein](https://discuss.httparchive.org/u/adamsilverstein)\ **Replies:** 5\ **Last updated:** [May 19, 2021, 2:41am UTC](https://discuss.httparchive.org/t/tracking-webp-adoption-and-impact-especially-in-wordpress/2150 "2021-05-19T02:41:56Z")
Hi! I recently helped land WebP support in WordPress (Changeset 50810 – WordPress Trac) and would like to start tracking adoption of WebP images. Mainly I want to track: How many WordPress (\>= version 5.8.0) sites us… --- ## [Cannot find blink feature in the blink\_features.usage table](https://discuss.httparchive.org/t/cannot-find-blink-feature-in-the-blink-features-usage-table/2132)
**Author:** [@shuranh](https://discuss.httparchive.org/u/shuranh)\ **Replies:** 9\ **Last updated:** [April 20, 2021, 4:13pm UTC](https://discuss.httparchive.org/t/cannot-find-blink-feature-in-the-blink-features-usage-table/2132 "2021-04-20T16:13:33Z")
Hi, I added a blink features to be tracked via UseCounters in Chromium a few months ago, and there is usage data in Chrome Status pages (0.6%): CrossBrowsingContextGroupMainFrameNulledNonEmptyNameAccessed. However, the … --- ## [Do results include lazy loaded images?](https://discuss.httparchive.org/t/do-results-include-lazy-loaded-images/2129)
**Author:** [@pemoze](https://discuss.httparchive.org/u/pemoze)\ **Replies:** 3\ **Last updated:** [April 6, 2021, 2:34pm UTC](https://discuss.httparchive.org/t/do-results-include-lazy-loaded-images/2129 "2021-04-06T14:34:32Z")
Hi http-archive team! I read in your FAQ that you test the webpages on your private instance of WebPageTest. Then I tried out the public webpagetest tool with some pages of which I know that they use lazy loading on ima… --- ## [Desktop version har files before 2015](https://discuss.httparchive.org/t/desktop-version-har-files-before-2015/2128)
**Author:** [@YN-Zheng](https://discuss.httparchive.org/u/YN-Zheng)\ **Replies:** 2\ **Last updated:** [April 5, 2021, 12:39pm UTC](https://discuss.httparchive.org/t/desktop-version-har-files-before-2015/2128 "2021-04-05T12:39:18Z")
Hi! I’m doing longitudinal research based on the har files provided by HttpArhive. So far I’ve analysis the har files from chrome-Oct\_15\_2015 till the latest date. I also find that there is an earlier IE version desktop… [Next page](https://discuss.httparchive.org/c/uncategorized/7.md?page=1)