Tuesday, February 21, 2023
At present, we’re asserting bulk
knowledge export, a brand new function that means that you can export knowledge from Search Console to
Google BigQuery on an ongoing foundation.
(Be aware that the rollout will take roughly one week, so you might not have entry immediately.)
You’ll be able to configure an export in Search Console to get a day by day knowledge dump into your BigQuery venture.
The information consists of all of your efficiency knowledge, aside from anonymized queries, that are filtered out
for privateness causes; in different phrases, the majority knowledge export will not be affected by the
day by day knowledge row restrict.
This implies you’ll be able to discover your knowledge to its most potential, becoming a member of it with different sources of knowledge
and utilizing superior evaluation and visualization strategies.
This knowledge export might be significantly useful for giant web sites with tens of 1000’s of pages, or these receiving
visitors from tens of 1000’s of queries a day (or each!). Small and medium websites have already got entry to all their
knowledge by way of the consumer interface, the Looker Studio connector
(previously often known as Information Studio) or the Search Analytics API.
Organising a brand new bulk knowledge export
To configure a brand new report, you may want to organize your BigQuery account to obtain the information and arrange
your particulars within the Search Console settings. Test the Assist Middle for a
step-by-step information,
however generally, the method is split into two phases:
- Put together your Cloud venture (inside Google Cloud Console):
this consists of enabling the BigQuery API on your venture and giving permission to your Search Console service account. - Set export vacation spot (inside Search Console):
this consists of offering your Google Cloud venture ID, and selecting a dataset location. Be aware that solely property homeowners can arrange a bulk knowledge export.
When you submit the knowledge to Search Console, it will simulate an export. If the export succeeds, we’ll inform all property homeowners by way of e mail and your
ongoing exports will begin inside 48 hours. If the export simulation fails, you may obtain a right away alert on the problem detected; here is a listing of
potential export errors.
Information obtainable on bulk knowledge exports
As soon as the majority knowledge export is ready up efficiently, you’ll be able to log in to your BigQuery account and begin querying the information.
Yow will discover detailed desk tips and references within the assist heart;
additionally test the reason on the distinction between aggregating
knowledge by property vs by web page, because it’ll allow you to perceive the information higher. Here’s a fast description of the three tables that might be obtainable to you:
searchdata_site_impression: This desk incorporates knowledge aggregated by property, together with question, nation, kind, and system.searchdata_url_impression: This desk incorporates knowledge aggregated by URL, which allows a extra detailed view of queries and wealthy outcomes.ExportLog: This desk is a report of what knowledge was saved for that day. Failed exports should not recorded right here.
For those who want slightly assist to begin querying the information, test the pattern queries
printed within the assist heart, they are often useful to stand up and working. Here is one instance, the place we pull the entire question by URL mixtures for pages with at the very least
100 FAQ wealthy end result impressions during the last two weeks.
SELECT url, question, sum(impressions) AS impressions, sum(clicks) AS clicks, sum(clicks) / sum(impressions) AS ctr, /* Added one beneath, as a result of place is zero-based */ ((sum(sum_position) / sum(impressions)) + 1.0) AS avg_position /* Bear in mind to replace the desk identify to your desk */ FROM searchconsole.searchdata_url_impression WHERE search_type="WEB" AND is_tpf_faq = true AND data_date BETWEEN DATE_SUB(CURRENT_DATE(), INTERVAL 14 day) AND CURRENT_DATE() AND clicks > 100 GROUP BY 1,2 ORDER BY clicks LIMIT 1000
We hope that by making extra Google Search knowledge obtainable, web site homeowners and SEOs will be capable to discover extra content material alternatives by analyzing lengthy tail queries.
It’s going to additionally make it simpler to affix page-level data from inside methods to Search ends in a simpler and complete approach.
And as all the time, you probably have any questions or considerations, please attain out to us by way of the Google
Search Central Group or on Twitter.