Hi everyone,
I am new to the bigquery and httparchive. I follow Analysis of Cookie Size and try to extract the informaiton on third-party cookies. Everytime i run the code, it keeps pop up an error msg "Quota exceeded: Your project exceeded quota for free query bytes scanned. " I am not sure where I did it wrong. Anyone can help? Thanks.
(1) It shows that “this query will process 169.86 MB when run”.
(2) I create a brand-new google account and newly create a project, so it should be within the first 1 TiB of query data
Code is as following:
CREATE TEMPORARY FUNCTION getHeaders(payload STRING)
RETURNS ARRAY<STRING>
LANGUAGE js AS """
var $ = JSON.parse(payload);
var headers = $.response.headers;
var cookies=[];
var j=0;
for (i in headers) {
if (headers[i].name.toLowerCase().indexOf('set-cookie')!= -1) {
cookies[j] = headers[i].value;
j++;
}
}
try {
return cookies;
} catch (e) {
return [];
}
""";
SELECT
page,
url,
set_cookie
FROM (
SELECT
page,
url,
getHeaders(payload) AS set_cookies
FROM
`httparchive.requests.2020_06_01_desktop` TABLESAMPLE SYSTEM (0.001 PERCENT)
)
CROSS JOIN
UNNEST(set_cookies) AS set_cookie