BigQuery
Convert to partitioned table
Overview
This BLOCK copies data from multiple tables separated by date (date-sharded tables) into one partitioned table open_in_new
The date-sharded tables must have their names formatted as shown below:
tablename_YYYYMMDD
YYYY: 4-digit year. E.g. 2016MM: 2-digit month (01–12). E.g. 04DD: 2-digit date (01–31). E.g. 09
For example, file names like sharded_20160401 and mytable_20161231 are properly formatted with the required year, month, and date in their suffixes.
Properties
| Property | Explanation |
|---|---|
| BLOCK name | Configure the name displayed on this BLOCK. |
| GCP service account | Select the GCP service account to use with this BLOCK. |
| Source dataset |
Designate the dataset containing the tables to be converted into a partitioned table. |
| Source table prefix |
Designate the prefix of the source tables. Tables with this prefix followed by an 8-digit date ( For example, the prefix for tables named |
| Destination dataset |
Designate the ID of the dataset that will contain the partitioned table. |
| Destination table |
Designate an ID for the partitioned table. |
| Overwrite | Specify whether or not to erase pre-existing views and tables with identical names when saving newly added ones. |
| BLOCK memos | Make notes about this BLOCK. |
| Data storage period | Designate the number of days each partition of data will be saved. |