# Big changes during the gap from April → June

**URL:** <https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003>\
**Category:** Analysis\
**Created:** [June 28, 2017, 10:13pm UTC](https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003 "2017-06-28T22:13:58Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![eeeps](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/eeeps/32/773_2.png) [@eeeps](https://discuss.httparchive.org/u/eeeps)\
**Post date:** [June 28, 2017, 10:13pm UTC](https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003/1 "2017-06-28T22:13:58Z")

</div>

[https://github.com/HTTPArchive/httparchive/issues/105#issuecomment-301913465](https://github.com/HTTPArchive/httparchive/issues/105#issuecomment-301913465) mentions “new agents,” but I can’t find info on what’s new/changed about them.

Lots of interesting drops — one guess I have is Brotli?

That doesn’t explain the drop in image weight on Mobile (but not Desktop) though. Perhaps that’s something to do with viewports and responsive images?

---

<div class="post-metadata">

**Author:** ![eustas](https://avatars.discourse-cdn.com/v4/letter/e/e9bcb4/32.png) [@eustas](https://discuss.httparchive.org/u/eustas)\
**Post date:** [June 29, 2017, 8:32am UTC](https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003/2 "2017-06-29T08:32:57Z")

</div>

I’m working on analysis of change of brotli usage for the last year.  
Currently the only anomaly I see is a sudden spike for 2017\_02\_01, but perhaps it is an echo of 2017\_01\_01/2017\_01\_15.  
There is a rapid growth of brotli usage in 2017\_06\_01 / 2017\_06\_15, but it is somewhat expected (yet to be analysed deeper).

---

<div class="post-metadata">

**Author:** ![patmeenan](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/patmeenan/32/605_2.png) [@patmeenan](https://discuss.httparchive.org/u/patmeenan)\
**Post date:** [June 29, 2017, 3:47pm UTC](https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003/3 "2017-06-29T15:47:45Z")

</div>

The “new agents” was a rewrite of the code that drives the testing and records the page results. Instead of running on Windows-only and intrusively intercepting the OS API calls it is now cross-platform and uses the supported dev tools interfaces, netlogs and traces. As part of the move we also switched to running on Linux VM’s instead of Windows which reduced the overhead and made it possible to get accurate performance stats out as well.

What kind of “drop” are you seeing with Brotli? There have been a few issues with the response headers reporting differently, specifically cases where the same header is repeated (ended up with a newline in the data) but we’d like to fix any cases that can be identified.

I still don’t understand the reported drop in HTML, JS and CSS bytes (while the top-level bytes remained consistent) which looks like it may have also hit images on mobile. Best guess right now is that the content type matching somewhere is missing some resources but I haven’t found where yet.

---

<div class="post-metadata">

**Author:** ![patmeenan](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/patmeenan/32/605_2.png) [@patmeenan](https://discuss.httparchive.org/u/patmeenan)\
**Post date:** [June 29, 2017, 3:50pm UTC](https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003/4 "2017-06-29T15:50:52Z")

</div>

As to the big jump in brotli usage in June, my guess is that it is related to [Google enabling Brotli for ads](https://developers.googleblog.com/2017/06/brotli-compression-in-google-display-ads.html) (the timing lines up pretty well).

---

<div class="post-metadata">

**Author:** ![eustas](https://avatars.discourse-cdn.com/v4/letter/e/e9bcb4/32.png) [@eustas](https://discuss.httparchive.org/u/eustas)\
**Post date:** [June 29, 2017, 7:09pm UTC](https://discuss.httparchive.org/t/big-changes-during-the-gap-from-april-june/1003/5 "2017-06-29T19:09:45Z")

</div>

I have found that not only google ads gave a huge boost to brotli, but cloudflare as well.  
And February anomaly is also caused by cloudflare. This is easy to track via resp\_server field.  
For google ads (doubleclick) it is “cafe”; for cloudflare it is “cloudflare-nginx”.
