# Data collection in HTTPArchive

**URL:** <https://discuss.httparchive.org/t/data-collection-in-httparchive/1549>\
**Category:** Analysis\
**Created:** [January 15, 2019, 2:15am UTC](https://discuss.httparchive.org/t/data-collection-in-httparchive/1549 "2019-01-15T02:15:50Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![rviscomi](https://yyz1.discourse-cdn.com/flex035/user_avatar/discuss.httparchive.org/rviscomi/32/835_2.png) [@rviscomi](https://discuss.httparchive.org/u/rviscomi)\
**Post date:** [January 15, 2019, 6:19pm UTC](https://discuss.httparchive.org/t/data-collection-in-httparchive/1549/2 "2019-01-15T18:19:58Z")

</div>

See [Changes to the HTTP Archive corpus](https://discuss.httparchive.org/t/changes-to-the-http-archive-corpus/1539) for more info on when and why the number of URLs changed.

There is a `firstHtml` boolean field in the `summary_requests` dataset that indicates whether the request returns the root document of the page, after redirects. You can use it like this:

```sql
SELECT
  respOtherHeaders
FROM
  `httparchive.latest.summary_requests_desktop`
WHERE
  firstHtml

```

Or if you need access to the raw JSON request object, you can join the tables together:

```sql
SELECT
  page,
  url,
  JSON_EXTRACT(payload, '$._headers.response') AS all_response_headers
FROM
  `httparchive.latest.summary_requests_desktop`
JOIN
  `httparchive.latest.requests_desktop`
USING
  (url)
WHERE
  firstHtml

```

---

_[View the full topic](https://discuss.httparchive.org/t/data-collection-in-httparchive/1549)._