Best Practices and Tips
GameAnalytics has structured Data Warehouse to support efficient and cost-effective querying. The setup includes:
-
Date-based partitioning
checkpointfor checkpoint tablesevent_datefor event tables
-
Clustering by game_id
-
Daily querying quotas are set to 6TB.
Query Optimization Best Practices
- Always filter by date (
checkpointorevent_date) and game_id in yourwhereclause. This takes advantage of the partitioning and clustering setup described above. - Avoid
select *. Only query the columns you need. BigQuery charges based on how much data is scanned, so unused columns increase cost. Note: You can use the dataset documentation to understand available columns for each table. - Beware of
limitbehavior. Limit reduces the output rows, but does not reduce the amount of data scanned. - Avoid connecting visualization tools to large data sets. Tools like Lookr or Tableau can trigger large, expensive queries, especially as your data sets grow. Instead, schedule queries to pre-process and store smaller, aggregated tables for visualizations.