# Latest **URL:** https://discuss.httparchive.org/latest.md [Latest](https://discuss.httparchive.org/latest.md) · [Categories](https://discuss.httparchive.org/categories.md) --- ## [Licence and preferred attribution for Technology Report data](https://discuss.httparchive.org/t/licence-and-preferred-attribution-for-technology-report-data/3117)
**Author:** [@immortal](https://discuss.httparchive.org/u/immortal)\ **Replies:** 1\ **Last updated:** [September 21, 2026, 9:30am UTC](https://discuss.httparchive.org/t/licence-and-preferred-attribution-for-technology-report-data/3117 "2026-09-21T09:30:52Z")
Hi all, I run inetgeek.com, a small comparison site for hosting and infrastructure providers. I’ve started using the Technology Report API to show per-category adoption bars — for example the three PaaS providers I tr… --- ## [Chapter 2. JavaScript](https://discuss.httparchive.org/t/chapter-2-javascript/2038)
**Author:** [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Replies:** 4\ **Last updated:** [August 29, 2026, 10:33am UTC](https://discuss.httparchive.org/t/chapter-2-javascript/2038 "2026-08-29T10:33:21Z")
Tell us what you think! We’d love to hear your feedback on the JavaScript chapter of the 2020 Web Almanac. Leave a comment and tell us your questions, comments, and ideas. poll Chapter resources :nerd\_face: Here are so… --- ## [Response body is empty in the crawl dataset](https://discuss.httparchive.org/t/response-body-is-empty-in-the-crawl-dataset/2935)
**Author:** [@jiboncom](https://discuss.httparchive.org/u/jiboncom)\ **Replies:** 5\ **Last updated:** [August 14, 2026, 5:44pm UTC](https://discuss.httparchive.org/t/response-body-is-empty-in-the-crawl-dataset/2935 "2026-08-14T17:44:07Z")
I’ve been trying to retrieve the response\_body field for certain websites, but I’m running into some issues. For all data before 2015, the content.response\_body field consistently returns NULL. After 2015, the field is p… --- ## [No JSON requests 2022-2024](https://discuss.httparchive.org/t/no-json-requests-2022-2024/3003)
**Author:** [@Wuteken](https://discuss.httparchive.org/u/Wuteken)\ **Replies:** 5\ **Last updated:** [July 26, 2026, 3:43pm UTC](https://discuss.httparchive.org/t/no-json-requests-2022-2024/3003 "2026-07-26T15:43:19Z")
I’m investigating the evolution of the web over time for my masters thesis. One of the things I wanted to map out was the percentage of every type of request per year. When constructing this graph I realized there were … --- ## [Best way to extract gtm.js response bodies at scale, BigQuery cost vs raw HAR access?](https://discuss.httparchive.org/t/best-way-to-extract-gtm-js-response-bodies-at-scale-bigquery-cost-vs-raw-har-access/3104)
**Author:** [@dev.dandp](https://discuss.httparchive.org/u/dev.dandp)\ **Replies:** 1\ **Last updated:** [July 10, 2026, 11:13pm UTC](https://discuss.httparchive.org/t/best-way-to-extract-gtm-js-response-bodies-at-scale-bigquery-cost-vs-raw-har-access/3104 "2026-07-10T23:13:13Z")
I’m doing research that requires collecting the response bodies of gtm.js (Google Tag Manager) resources across crawled sites, ideally over multiple monthly crawls. My filter is essentially: SELECT date, page, url, res… --- ## [Truncated Scripts and Frame Information Questions](https://discuss.httparchive.org/t/truncated-scripts-and-frame-information-questions/3023)
**Author:** [@anisenoff](https://discuss.httparchive.org/u/anisenoff)\ **Replies:** 1\ **Last updated:** [April 14, 2026, 2:48am UTC](https://discuss.httparchive.org/t/truncated-scripts-and-frame-information-questions/3023 "2026-04-14T02:48:12Z")
I noticed that for some of the response\_body values for scripts appear to be truncated. I was wondering if there was a specific reason that might be happening or systematic reason those requests might be different from o… --- ## [Why are some of the crux pages missing?](https://discuss.httparchive.org/t/why-are-some-of-the-crux-pages-missing/2997)
**Author:** [@ydimova11](https://discuss.httparchive.org/u/ydimova11)\ **Replies:** 1\ **Last updated:** [February 21, 2026, 7:16pm UTC](https://discuss.httparchive.org/t/why-are-some-of-the-crux-pages-missing/2997 "2026-02-21T19:16:37Z")
I noticed that the there are less websites included in the HTTPArchive dataset than in the CrUX list. For example, for the top 10k CrUX, only 6531 websites are in httparchive.crawl.pages. The difference seems way to high… --- ## [Httparchive not found](https://discuss.httparchive.org/t/httparchive-not-found/2983)
**Author:** [@dizel3d](https://discuss.httparchive.org/u/dizel3d)\ **Replies:** 1\ **Last updated:** [February 15, 2026, 7:54pm UTC](https://discuss.httparchive.org/t/httparchive-not-found/2983 "2026-02-15T19:54:46Z")
I cannot find httparchive via BigQuery search. I’m located in Russia. Is it possible that this dataset is hidden or restricted in my country? --- ## [Accessing HAR files for most recent crawl](https://discuss.httparchive.org/t/accessing-har-files-for-most-recent-crawl/2982)
**Author:** [@anisenoff](https://discuss.httparchive.org/u/anisenoff)\ **Replies:** 0\ **Last updated:** [February 11, 2026, 7:06pm UTC](https://discuss.httparchive.org/t/accessing-har-files-for-most-recent-crawl/2982 "2026-02-11T19:06:00Z")
From other posts it is my understanding is that only the HAR files from the most recent crawl are retained. I was wondering if there are instructions as the how to access that data directly rather than reconstructing it … --- ## [Http archive bot/crawler declared?](https://discuss.httparchive.org/t/http-archive-bot-crawler-declared/2941)
**Author:** [@mes271828](https://discuss.httparchive.org/u/mes271828)\ **Replies:** 1\ **Last updated:** [November 24, 2025, 10:29am UTC](https://discuss.httparchive.org/t/http-archive-bot-crawler-declared/2941 "2025-11-24T10:29:42Z")
I’m writing a research paper and need to explain how the http archive crawler declares itself to websites as a bot. can you please explain this to me? I’m particularly interested in learning if it’s included on this li… --- ## [The Performance Impact of Cryptocurrency Mining on the Web](https://discuss.httparchive.org/t/the-performance-impact-of-cryptocurrency-mining-on-the-web/1126)
**Author:** [@doug\_sillars](https://discuss.httparchive.org/u/doug_sillars)\ **Replies:** 15\ **Last updated:** [September 27, 2025, 11:57am UTC](https://discuss.httparchive.org/t/the-performance-impact-of-cryptocurrency-mining-on-the-web/1126 "2025-09-27T11:57:26Z")
Last week there was an article pointing out that hundreds of websites have been hacked to add bitcoin cryptocurrency mining scripts into them. This of course is interesting to the media because it uses the words ‘hacke… --- ## [New dashboard: the Core Web Vitals technology report](https://discuss.httparchive.org/t/new-dashboard-the-core-web-vitals-technology-report/2178)
**Author:** [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Replies:** 16\ **Last updated:** [September 12, 2025, 12:49pm UTC](https://discuss.httparchive.org/t/new-dashboard-the-core-web-vitals-technology-report/2178 "2025-09-12T12:49:33Z")
Jump right into the dashboard: httparchive.org/reports/cwv-tech The technologies you use to build your website can have an effect on your ability to deliver good user experiences. Good UX is key to performing well with C… --- ## [Httparchive.technologies table gone on big query?](https://discuss.httparchive.org/t/httparchive-technologies-table-gone-on-big-query/2917)
**Author:** [@gbrlmtrz](https://discuss.httparchive.org/u/gbrlmtrz)\ **Replies:** 2\ **Last updated:** [April 21, 2025, 10:25pm UTC](https://discuss.httparchive.org/t/httparchive-technologies-table-gone-on-big-query/2917 "2025-04-21T22:25:16Z")
Hello everyone, every now and then I would run a report based on the technologies table of the httparchive dataset, today I’ve noticed that the tables are gone, I see the technologies group is still referenced on the doc… --- ## [Adding a new product to the Technology dropdown menu](https://discuss.httparchive.org/t/adding-a-new-product-to-the-technology-dropdown-menu/2868)
**Author:** [@adriansp](https://discuss.httparchive.org/u/adriansp)\ **Replies:** 3\ **Last updated:** [April 1, 2025, 5:08am UTC](https://discuss.httparchive.org/t/adding-a-new-product-to-the-technology-dropdown-menu/2868 "2025-04-01T05:08:01Z")
Hi there, I was just reviewing an HTTP Archive Core Web Vitals Technology Report and was wondering how I could add another product to the Technology menu and have it displayed on the graph. What would be the process for… --- ## [Exploring the Impact of Progressive Web Apps (PWAs) on Core Web Vitals: Insights from HTTP Archive Data](https://discuss.httparchive.org/t/exploring-the-impact-of-progressive-web-apps-pwas-on-core-web-vitals-insights-from-http-archive-data/2893)
**Author:** [@DonnaPaulsen](https://discuss.httparchive.org/u/DonnaPaulsen)\ **Replies:** 0\ **Last updated:** [March 4, 2025, 9:59am UTC](https://discuss.httparchive.org/t/exploring-the-impact-of-progressive-web-apps-pwas-on-core-web-vitals-insights-from-http-archive-data/2893 "2025-03-04T09:59:51Z")
Hello everyone, I’ve been diving deep into how Progressive Web Apps (PWAs) are evolving and wanted to discuss their potential impact on Core Web Vitals, particularly using the data we can extract from HTTP Archive. As … --- ## [What kind of mobile devices does the private instance of webpagetest wihtin HTTP archive use while crawling mobile results?](https://discuss.httparchive.org/t/what-kind-of-mobile-devices-does-the-private-instance-of-webpagetest-wihtin-http-archive-use-while-crawling-mobile-results/626)
**Author:** [@akhil](https://discuss.httparchive.org/u/akhil)\ **Replies:** 5\ **Last updated:** [January 30, 2025, 2:03pm UTC](https://discuss.httparchive.org/t/what-kind-of-mobile-devices-does-the-private-instance-of-webpagetest-wihtin-http-archive-use-while-crawling-mobile-results/626 "2025-01-30T14:03:11Z")
I do realize that HTTP archive uses a private instance of webpagetest - the question is what are the device and browser type does the instance use ? --- ## [Can I access to raw results of Web Almanac markup query from google BigQuery?](https://discuss.httparchive.org/t/can-i-access-to-raw-results-of-web-almanac-markup-query-from-google-bigquery/2841)
**Author:** [@silentimp](https://discuss.httparchive.org/u/silentimp)\ **Replies:** 2\ **Last updated:** [December 12, 2024, 2:46pm UTC](https://discuss.httparchive.org/t/can-i-access-to-raw-results-of-web-almanac-markup-query-from-google-bigquery/2841 "2024-12-12T14:46:51Z")
Hi, I want to know the adoption of details, summary and dialog html elements, ideally with change over years. And maybe it’s bit too early, but popover and invoker commands-related attributes. I did try to create a qu… --- ## [HTTP/2 or HTTP/3 Requests per page and their size distribution](https://discuss.httparchive.org/t/http-2-or-http-3-requests-per-page-and-their-size-distribution/2819)
**Author:** [@csosto-pk](https://discuss.httparchive.org/u/csosto-pk)\ **Replies:** 0\ **Last updated:** [November 25, 2024, 4:04am UTC](https://discuss.httparchive.org/t/http-2-or-http-3-requests-per-page-and-their-size-distribution/2819 "2024-11-25T04:04:45Z")
Hello, There was a recent post by a CDN that shared data about their QUIC connection response sizes (to at least one GET in the request) which have a median of about 7KB. This does not align with HTTP Archive data which… --- ## [New Release: \`httparchive.crawl\` Dataset](https://discuss.httparchive.org/t/new-release-httparchive-crawl-dataset/2814)
**Author:** [@max\_ostapenko](https://discuss.httparchive.org/u/max_ostapenko)\ **Replies:** 0\ **Last updated:** [November 20, 2024, 3:35pm UTC](https://discuss.httparchive.org/t/new-release-httparchive-crawl-dataset/2814 "2024-11-20T15:35:10Z")
:tada: New Release: httparchive.crawl Dataset We’re thrilled to announce the launch of the new httparchive.crawl dataset, now the default and only dataset for HTTP Archive crawls data. This update simplifies data access… --- ## [Examining Web Performance Metric Trends](https://discuss.httparchive.org/t/examining-web-performance-metric-trends/2806)
**Author:** [@harryson614](https://discuss.httparchive.org/u/harryson614)\ **Replies:** 0\ **Last updated:** [October 14, 2024, 12:51pm UTC](https://discuss.httparchive.org/t/examining-web-performance-metric-trends/2806 "2024-10-14T12:51:31Z")
Hello Everyone :hugs:, I’m contacting you in order to get your thoughts and ideas on web performance measurements, with an emphasis on the data trends we’ve noticed in the HTTP Archive. Web performance, as we all know,… --- ## [Detecting the cookies consent popup in HAR](https://discuss.httparchive.org/t/detecting-the-cookies-consent-popup-in-har/2793)
**Author:** [@richard](https://discuss.httparchive.org/u/richard)\ **Replies:** 1\ **Last updated:** [September 15, 2024, 8:23am UTC](https://discuss.httparchive.org/t/detecting-the-cookies-consent-popup-in-har/2793 "2024-09-15T08:23:16Z")
Hi everyone, We are interested in navigating the time trend of webs having a cookie Consent banner. Specifically, we would like to know the proportion of websites that have such banner from 2014-2024. Is there a good wa… --- ## [Have free quota but keep getting error on query quota in bigquery](https://discuss.httparchive.org/t/have-free-quota-but-keep-getting-error-on-query-quota-in-bigquery/2790)
**Author:** [@richard](https://discuss.httparchive.org/u/richard)\ **Replies:** 2\ **Last updated:** [September 8, 2024, 5:53am UTC](https://discuss.httparchive.org/t/have-free-quota-but-keep-getting-error-on-query-quota-in-bigquery/2790 "2024-09-08T05:53:32Z")
Hi everyone, I am new to the bigquery and httparchive. I follow Analysis of Cookie Size and try to extract the informaiton on third-party cookies. Everytime i run the code, it keeps pop up an error msg "Quota exceeded: … --- ## [List of domains using a given technology](https://discuss.httparchive.org/t/list-of-domains-using-a-given-technology/2755)
**Author:** [@gbrlmtrz](https://discuss.httparchive.org/u/gbrlmtrz)\ **Replies:** 2\ **Last updated:** [May 23, 2024, 7:09pm UTC](https://discuss.httparchive.org/t/list-of-domains-using-a-given-technology/2755 "2024-05-23T19:09:21Z")
Hello! I would like to know if there is a way we can check the CMS technology reported by a given domain on the Core Web Vitals technology report Specifically, I am curious to see which are the 93 domains that are flagg… --- ## [SAN Certificates: How Many Alt-Names are Too Many?](https://discuss.httparchive.org/t/san-certificates-how-many-alt-names-are-too-many/1867)
**Author:** [@paulcalvano](https://discuss.httparchive.org/u/paulcalvano)\ **Replies:** 5\ **Last updated:** [July 25, 2024, 1:44pm UTC](https://discuss.httparchive.org/t/san-certificates-how-many-alt-names-are-too-many/1867 "2024-07-25T13:44:35Z")
According to the HTTP Archive, 84% of HTTPS certificates are using the Subject Alternate Name (SAN) extension, which allows multiple hostnames to be protected by a single certificate. The largest certificate I found in t… --- ## [% of good CWV](https://discuss.httparchive.org/t/of-good-cwv/2757)
**Author:** [@Roman](https://discuss.httparchive.org/u/Roman)\ **Replies:** 1\ **Last updated:** [May 30, 2024, 1:47pm UTC](https://discuss.httparchive.org/t/of-good-cwv/2757 "2024-05-30T13:47:24Z")
Hello, pls help me to understand how Percent good CWV is calculated in my case I have 70% good on INP, 96% good on LCP, 83% good on CLS BUT only 60% of good CWV (which I was assuming like a total average) --- ## [How long does it take for a domain to be labeled to have a given technology](https://discuss.httparchive.org/t/how-long-does-it-take-for-a-domain-to-be-labeled-to-have-a-given-technology/2759)
**Author:** [@gbrlmtrz](https://discuss.httparchive.org/u/gbrlmtrz)\ **Replies:** 1\ **Last updated:** [May 30, 2024, 1:36pm UTC](https://discuss.httparchive.org/t/how-long-does-it-take-for-a-domain-to-be-labeled-to-have-a-given-technology/2759 "2024-05-30T13:36:52Z")
This is a follow up of this question I am curious how long does it take for a domain to be labeled to be using a given technology? I see that this dataset httparchive.technologies.2024\_05\_01\_\* is used to query a given t… --- ## [如何获取api 报文数据，进行学习？](https://discuss.httparchive.org/t/api/2746)
**Author:** [@chennian-dev](https://discuss.httparchive.org/u/chennian-dev)\ **Replies:** 1\ **Last updated:** [April 28, 2024, 2:15pm UTC](https://discuss.httparchive.org/t/api/2746 "2024-04-28T14:15:25Z")
从主流网站采集的数据可以开源，进行研究学习吗？ --- ## [Are Popular Websites Faster?](https://discuss.httparchive.org/t/are-popular-websites-faster/162)
**Author:** [@doug\_sillars](https://discuss.httparchive.org/u/doug_sillars)\ **Replies:** 1\ **Last updated:** [January 6, 2014, 5:47pm UTC](https://discuss.httparchive.org/t/are-popular-websites-faster/162 "2014-01-06T17:47:43Z")
--- ## [Translating JavaScript API names to feature names](https://discuss.httparchive.org/t/translating-javascript-api-names-to-feature-names/2712)
**Author:** [@kzar](https://discuss.httparchive.org/u/kzar)\ **Replies:** 2\ **Last updated:** [February 26, 2024, 12:24pm UTC](https://discuss.httparchive.org/t/translating-javascript-api-names-to-feature-names/2712 "2024-02-26T12:24:25Z")
I’m hoping to order a bunch of JavaScript APIs by usage, as a way to understand which of the APIs might be more/less important. Is there a recommended way to translate JavaScript API names (e.g. window.navigator.userAge… --- ## [Warning: $14,000 BigQuery Charge in 2 Hours](https://discuss.httparchive.org/t/warning-14-000-bigquery-charge-in-2-hours/2715)
**Author:** [@Tim](https://discuss.httparchive.org/u/Tim)\ **Replies:** 5\ **Last updated:** [February 22, 2024, 7:46pm UTC](https://discuss.httparchive.org/t/warning-14-000-bigquery-charge-in-2-hours/2715 "2024-02-22T19:46:45Z")
This website makes it seem like this “public” dataset is for the community to use, but it is instead a for-profit money maker for Google Cloud and you can lose tens of thousands of dollars. Last week I ran a script on B… [Next page](https://discuss.httparchive.org/latest.md?page=1)