Use SQL to query logs via Log Analytics

SQL + BigQuery for real-time log data with 0 management is a reality

The traditional ways to query logs using SQL

A number of issues

  • have to set it up based on each log filter
  • have to manage schemas
  • duplicated data

It used to look like this

What is Log Analytics

(in preview)

Key Features

  • No more data duplication
  • Query in Log Analytics or BigQuery
  • One Single Google Managed Schema
  • Powerful search on JSON data type
  • And of course integrate to BI tools like Data Studio & Looker

let's have a look

Limitations

  • VPC SC doesn't work yet
  • Log Bucket only supports global region

Summary & Next Steps

Use SQL to query log data with 0 management

no need to manage schema or duplicate data

visualisation direct from the log

there are restrictions so if this applies to you maybe best to wait for GA

Read the blog

Use SQL to query logs via Log Analytics

By Richard He

Use SQL to query logs via Log Analytics

Using SQL with BigQuery for log data is now a reality

  • 147