# Latest **URL:** https://discuss.httparchive.org/latest.md?no_subcategories=false&page=1 [Latest](https://discuss.httparchive.org/latest.md) · [Categories](https://discuss.httparchive.org/categories.md) **Page:** 2 --- ## [Progressive Web Apps in the HTTP Archive](https://discuss.httparchive.org/t/progressive-web-apps-in-the-http-archive/1401)
**Author:** [@tomayac](https://discuss.httparchive.org/u/tomayac)\ **Replies:** 3\ **Last updated:** [February 20, 2024, 9:27pm UTC](https://discuss.httparchive.org/t/progressive-web-apps-in-the-http-archive/1401 "2024-02-20T21:27:33Z")
Progressive Web Apps in the HTTP Archive Thomas Steiner, Google Hamburg, Germany :e-mail: tomac@google.com • :bird: @tomayac • :smile\_cat: tomayac (Cross-posted to Medium: https://medium.com/dev-channel/progressive-web… --- ## [Web vitals score](https://discuss.httparchive.org/t/web-vitals-score/2706)
**Author:** [@vebrt99](https://discuss.httparchive.org/u/vebrt99)\ **Replies:** 0\ **Last updated:** [February 11, 2024, 8:53pm UTC](https://discuss.httparchive.org/t/web-vitals-score/2706 "2024-02-11T20:53:50Z")
Hello, I have question about how to get data for Web vitals score. I am using Google Lighthouse and i wanted to edit score values for the latest ones. Right in the source files there are links like this - https://bigque… --- ## [Pages and Requests later than Apr 2022 in gs://httparchive/downloads/](https://discuss.httparchive.org/t/pages-and-requests-later-than-apr-2022-in-gs-httparchive-downloads/2667)
**Author:** [@marty90](https://discuss.httparchive.org/u/marty90)\ **Replies:** 6\ **Last updated:** [November 27, 2023, 5:56pm UTC](https://discuss.httparchive.org/t/pages-and-requests-later-than-apr-2022-in-gs-httparchive-downloads/2667 "2023-11-27T17:56:16Z")
Hello, I used to download the list of pages and requests from gs://httparchive/downloads/ , where there are files like: httparchive\_Sep\_1\_2021\_requests.gz However, there is no data newer than April 2022. Is the data m… --- ## [Higher level stats for structured data](https://discuss.httparchive.org/t/higher-level-stats-for-structured-data/2670)
**Author:** [@leaverou](https://discuss.httparchive.org/u/leaverou)\ **Replies:** 14\ **Last updated:** [November 22, 2023, 6:12am UTC](https://discuss.httparchive.org/t/higher-level-stats-for-structured-data/2670 "2023-11-22T06:12:21Z")
I looked up the Structured Data chapter to cite data on what % of sites use structured data at all, and what % specify any type of metadata like description, image etc, but it’s currently far more granular than that, mis… --- ## [Understanding embeds in WordPress](https://discuss.httparchive.org/t/understanding-embeds-in-wordpress/2547)
**Author:** [@adamsilverstein](https://discuss.httparchive.org/u/adamsilverstein)\ **Replies:** 0\ **Last updated:** [March 21, 2023, 10:31pm UTC](https://discuss.httparchive.org/t/understanding-embeds-in-wordpress/2547 "2023-03-21T22:31:46Z")
I am researching lazy loading of embeds on WordPress sites. In particular, I want to look into the “Embed block” WordPress places into a post when a user pastes in a URL from a supported oEmbed provider. Currently suppor… --- ## [Downloading HAR-Datasets later than May 2022?](https://discuss.httparchive.org/t/downloading-har-datasets-later-than-may-2022/2588)
**Author:** [@researcher](https://discuss.httparchive.org/u/researcher)\ **Replies:** 4\ **Last updated:** [October 16, 2023, 7:09pm UTC](https://discuss.httparchive.org/t/downloading-har-datasets-later-than-may-2022/2588 "2023-10-16T19:09:57Z")
Hi everyone, for scientific research, we would like to download the HAR or summary data from the httparchive folder as stated in the tutorial 1. However, when checking the available datasets for download 2, it only sho… --- ## [Planning the Web Almanac 2019](https://discuss.httparchive.org/t/planning-the-web-almanac-2019/1553)
**Author:** [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Replies:** 14\ **Last updated:** [June 4, 2019, 5:10am UTC](https://discuss.httparchive.org/t/planning-the-web-almanac-2019/1553 "2019-06-04T05:10:44Z")
This year we’re setting a new goal to create an annual report of the state of the web, called the Web Almanac. The purpose of the Almanac is to take a snapshot of how the web is built and how it has changed over the year… --- ## [How many https websites are using Mixed Content images](https://discuss.httparchive.org/t/how-many-https-websites-are-using-mixed-content-images/2531)
**Author:** [@zcorpan](https://discuss.httparchive.org/u/zcorpan)\ **Replies:** 7\ **Last updated:** [February 28, 2023, 7:16pm UTC](https://discuss.httparchive.org/t/how-many-https-websites-are-using-mixed-content-images/2531 "2023-02-28T19:16:02Z")
We (Mozilla) wanted to find out how the landscape has changed since 2020 wrt to usage of mixed content images on https websites, and how many of those images are broken anyway (fail to fetch). Here’s my method to find ou… --- ## [Websites with cache-control: no-store, by CDN](https://discuss.httparchive.org/t/websites-with-cache-control-no-store-by-cdn/2619)
**Author:** [@aaronpeters](https://discuss.httparchive.org/u/aaronpeters)\ **Replies:** 7\ **Last updated:** [September 8, 2023, 7:36pm UTC](https://discuss.httparchive.org/t/websites-with-cache-control-no-store-by-cdn/2619 "2023-09-08T19:36:00Z")
I recently queried the HTTP Archive to get the number of websites (pages) that serve the HTML with response header cache-control contains no-store . My query: SELECT \_TABLE\_SUFFIX AS client, count(DISTINCT pageid) … --- ## [Page weight in 1995?](https://discuss.httparchive.org/t/page-weight-in-1995/2626)
**Author:** [@tedroc](https://discuss.httparchive.org/u/tedroc)\ **Replies:** 1\ **Last updated:** [September 18, 2023, 3:23pm UTC](https://discuss.httparchive.org/t/page-weight-in-1995/2626 "2023-09-18T15:23:43Z")
It’s very nice to see here the evolution of page weight (and other elements) over time. I’m interesting in having the same data before 2010. Here’s what wrote WebSiteOptimization in 2014 for the average page size : 19… --- ## [Accessing Web Almanac 2022's raw data?](https://discuss.httparchive.org/t/accessing-web-almanac-2022s-raw-data/2616)
**Author:** [@d33tah](https://discuss.httparchive.org/u/d33tah)\ **Replies:** 2\ **Last updated:** [August 30, 2023, 9:10am UTC](https://discuss.httparchive.org/t/accessing-web-almanac-2022s-raw-data/2616 "2023-08-30T09:10:40Z")
Hi! Is there a way to download all 42TB of Web Almanac’s data? --- ## [How can we explore the carbon impact of websites using the HTTP Archive / Web Almanac?](https://discuss.httparchive.org/t/how-can-we-explore-the-carbon-impact-of-websites-using-the-http-archive-web-almanac/2139)
**Author:** [@cqueern](https://discuss.httparchive.org/u/cqueern)\ **Replies:** 9\ **Last updated:** [August 22, 2023, 2:22pm UTC](https://discuss.httparchive.org/t/how-can-we-explore-the-carbon-impact-of-websites-using-the-http-archive-web-almanac/2139 "2023-08-22T14:22:34Z")
With the growing interest in ESG (Environmental, Social, and Corporate Governance) it was suggested that there could be ways the HTTP Archive could explore energy consumption features of the web. There may even be a poin… --- ## [Comparing Core Web Vital Performance across WordPress versions](https://discuss.httparchive.org/t/comparing-core-web-vital-performance-across-wordpress-versions/2256)
**Author:** [@adamsilverstein](https://discuss.httparchive.org/u/adamsilverstein)\ **Replies:** 2\ **Last updated:** [August 14, 2023, 9:32am UTC](https://discuss.httparchive.org/t/comparing-core-web-vital-performance-across-wordpress-versions/2256 "2023-08-14T09:32:52Z")
It is exciting to see the new Core Web Vitals technology report Rick Viscomi created, even though it shows an abysmal rate of 22% of WordPress powered origins pass the Core Web Vitals “Good” threshold . However, part of… --- ## [Missing websites in April 2022](https://discuss.httparchive.org/t/missing-websites-in-april-2022/2493)
**Author:** [@schoki](https://discuss.httparchive.org/u/schoki)\ **Replies:** 4\ **Last updated:** [December 19, 2022, 11:15am UTC](https://discuss.httparchive.org/t/missing-websites-in-april-2022/2493 "2022-12-19T11:15:45Z")
Dear Http Archive Comunity, We are researchers investigating trends in website request data using Http Archive and came across a strange issue we would like to have more clarity about. It has been observed that there a… --- ## [How Many Sites Are Still Using AppCache?](https://discuss.httparchive.org/t/how-many-sites-are-still-using-appcache/1443)
**Author:** [@paulcalvano](https://discuss.httparchive.org/u/paulcalvano)\ **Replies:** 3\ **Last updated:** [October 5, 2021, 4:20pm UTC](https://discuss.httparchive.org/t/how-many-sites-are-still-using-appcache/1443 "2021-10-05T16:20:37Z")
The Application Cache has been deprecated and removed from the web standards. While some browsers still support it - that support is going away. For example, starting with Firefox 44 a console warning advised developers… --- ## [Next Monthly Upload?](https://discuss.httparchive.org/t/next-monthly-upload/2581)
**Author:** [@maxjoles](https://discuss.httparchive.org/u/maxjoles)\ **Replies:** 1\ **Last updated:** [June 7, 2023, 3:18pm UTC](https://discuss.httparchive.org/t/next-monthly-upload/2581 "2023-06-07T15:18:01Z")
Apologies if this has been answered before, but I couldn’t find an answer. When is fresh monthly data typically added to Big Query? When should we expect the June '23 crawl data to be accessible? Thanks! --- ## [Help finding list of home pages with specific http response header](https://discuss.httparchive.org/t/help-finding-list-of-home-pages-with-specific-http-response-header/2567)
**Author:** [@maxjoles](https://discuss.httparchive.org/u/maxjoles)\ **Replies:** 7\ **Last updated:** [June 7, 2023, 2:17pm UTC](https://discuss.httparchive.org/t/help-finding-list-of-home-pages-with-specific-http-response-header/2567 "2023-06-07T14:17:17Z")
I’m new to the HTTP Archive dataset as well as Big Query, but have some very basic SQL knowledge. I’m hoping to get help with a certain query. I’m looking to generate a list of home page URLs where the http response hea… --- ## [What is the most popular feed format: rss, atom, or JSON?](https://discuss.httparchive.org/t/what-is-the-most-popular-feed-format-rss-atom-or-json/2577)
**Author:** [@pawelgrzybek](https://discuss.httparchive.org/u/pawelgrzybek)\ **Replies:** 3\ **Last updated:** [May 27, 2023, 1:01am UTC](https://discuss.httparchive.org/t/what-is-the-most-popular-feed-format-rss-atom-or-json/2577 "2023-05-27T01:01:16Z")
Hi all. I am new to HTTP Archive and BigQuery world. I am trying to determine the popularity of feed formats (rss/atom/json)? First idea that comes to my mind is to scan the body of httparchive.response\_bodies for appl… --- ## [What is the least common colour used on web pages?](https://discuss.httparchive.org/t/what-is-the-least-common-colour-used-on-web-pages/1085)
**Author:** [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\ **Replies:** 6\ **Last updated:** [May 3, 2023, 3:19pm UTC](https://discuss.httparchive.org/t/what-is-the-least-common-colour-used-on-web-pages/1085 "2023-05-03T15:19:40Z")
On Twitter, @v21 asks: Does anyone want to take a stab at researching this one? :cowboy\_hat\_face: --- ## [Querying the HTTP Archive with DuckDB](https://discuss.httparchive.org/t/querying-the-http-archive-with-duckdb/2568)
**Author:** [@acme](https://discuss.httparchive.org/u/acme)\ **Replies:** 0\ **Last updated:** [May 3, 2023, 10:51am UTC](https://discuss.httparchive.org/t/querying-the-http-archive-with-duckdb/2568 "2023-05-03T10:51:04Z")
I needed to explore ETag response headers locally and I’ve come up with a workflow for querying HTTP Archive data on my laptop in Parquet format using DuckDB. You may have to create Google Cloud project IDs, Google BigQ… --- ## [Why videos is not appearing on Median page weight by content type figure?](https://discuss.httparchive.org/t/why-videos-is-not-appearing-on-median-page-weight-by-content-type-figure/2565)
**Author:** [@bbarneoud](https://discuss.httparchive.org/u/bbarneoud)\ **Replies:** 3\ **Last updated:** [April 18, 2023, 11:57am UTC](https://discuss.httparchive.org/t/why-videos-is-not-appearing-on-median-page-weight-by-content-type-figure/2565 "2023-04-18T11:57:38Z")
Is it because videos are mainly tierce assets? How to compare videos weight regarding other content type in that case? --- ## [Interesting outliers](https://discuss.httparchive.org/t/interesting-outliers/2250)
**Author:** [@briankardell](https://discuss.httparchive.org/u/briankardell)\ **Replies:** 0\ **Last updated:** [November 2, 2021, 4:45pm UTC](https://discuss.httparchive.org/t/interesting-outliers/2250 "2021-11-02T16:45:32Z")
When I wrote the markup chapter for the almanac in 2019 we found a number of outliers - data that was sort of very “outside expectations”, and often same errors repeated across several sites. As we had some trouble gett… --- ## [Historical decline in WWW subdomain use?](https://discuss.httparchive.org/t/historical-decline-in-www-subdomain-use/2507)
**Author:** [@gwern](https://discuss.httparchive.org/u/gwern)\ **Replies:** 6\ **Last updated:** [February 9, 2023, 8:20pm UTC](https://discuss.httparchive.org/t/historical-decline-in-www-subdomain-use/2507 "2023-02-09T20:20:38Z")
It’s commonly said that the classic ‘www.’ subdomain is in steep decline, prompted by general lack of need and catering to mobile users. I agree that it does seem like you see more ‘foo.com’ rather than ‘www.foo.com’ eac… --- ## [Help with BigQuery to extract all datapoints for top 1,000 sites](https://discuss.httparchive.org/t/help-with-bigquery-to-extract-all-datapoints-for-top-1-000-sites/2544)
**Author:** [@matt](https://discuss.httparchive.org/u/matt)\ **Replies:** 1\ **Last updated:** [March 14, 2023, 9:36pm UTC](https://discuss.httparchive.org/t/help-with-bigquery-to-extract-all-datapoints-for-top-1-000-sites/2544 "2023-03-14T21:36:08Z")
Hi, would anyone be interested in helping me to extract the full data points for the top 1,000 domains on HTTP Archive for page size, and the worst 1,000 for size? Happy to pay for this, so please provide a rough quote. … --- ## [How to find websites that use Early Hints](https://discuss.httparchive.org/t/how-to-find-websites-that-use-early-hints/2528)
**Author:** [@manuel](https://discuss.httparchive.org/u/manuel)\ **Replies:** 1\ **Last updated:** [February 24, 2023, 10:48pm UTC](https://discuss.httparchive.org/t/how-to-find-websites-that-use-early-hints/2528 "2023-02-24T22:48:07Z")
For my master thesis on Early Hints I’d like to find websites that return Early Hints (HTTP | 2022 | The Web Almanac by HTTP Archive) to do performance experiments with them. How to find urls that return early hints wit… --- ## [Find all web sites which share the same Google Analytics ID](https://discuss.httparchive.org/t/find-all-web-sites-which-share-the-same-google-analytics-id/2514)
**Author:** [@dimov](https://discuss.httparchive.org/u/dimov)\ **Replies:** 0\ **Last updated:** [January 23, 2023, 1:11pm UTC](https://discuss.httparchive.org/t/find-all-web-sites-which-share-the-same-google-analytics-id/2514 "2023-01-23T13:11:57Z")
Hi, I have imported the httparchive dataset in BigQuery I have a question, Is it possible to retrieve all of the web pages which share the same google analitics ID? --- ## [Httparchive.technologies Nov 22 missing](https://discuss.httparchive.org/t/httparchive-technologies-nov-22-missing/2498)
**Author:** [@morw](https://discuss.httparchive.org/u/morw)\ **Replies:** 0\ **Last updated:** [December 15, 2022, 8:47am UTC](https://discuss.httparchive.org/t/httparchive-technologies-nov-22-missing/2498 "2022-12-15T08:47:21Z")
Hey, why \`httparchive.technologies.2022\_11\_01\_\*’ tabels are missing? Thanks, Mor Topaz (wix.com) --- ## [Balakvalue](https://discuss.httparchive.org/t/balakvalue/2487)
**Author:** [@Balak](https://discuss.httparchive.org/u/Balak)\ **Replies:** 0\ **Last updated:** [December 3, 2022, 9:55am UTC](https://discuss.httparchive.org/t/balakvalue/2487 "2022-12-03T09:55:57Z")
Continuing the discussion from Alexa Rank for each url: Tell me how to check alexa rank my site is balakvalue.in --- ## [BigQuery broken link](https://discuss.httparchive.org/t/bigquery-broken-link/2366)
**Author:** [@Code-Pang](https://discuss.httparchive.org/u/Code-Pang)\ **Replies:** 10\ **Last updated:** [December 3, 2022, 9:48am UTC](https://discuss.httparchive.org/t/bigquery-broken-link/2366 "2022-12-03T09:48:44Z")
Through this link Google Cloud Platform Adding a dataset is always in the loading state --- ## [Cookie paywall](https://discuss.httparchive.org/t/cookie-paywall/2484)
**Author:** [@mbatikas](https://discuss.httparchive.org/u/mbatikas)\ **Replies:** 0\ **Last updated:** [December 1, 2022, 10:53am UTC](https://discuss.httparchive.org/t/cookie-paywall/2484 "2022-12-01T10:53:37Z")
Dear all, in Europe lately some news sites have adopted the practice of cookie paywall (Users have either to accept all cookies/trackers or pay in order to access the content of the news site). For more information you c… [Previous page](https://discuss.httparchive.org/latest.md?no_subcategories=false) [Next page](https://discuss.httparchive.org/latest.md?no_subcategories=false&page=2)