Our platform enables you to quickly and easily connect your data sources to Google BigQuery table.
This enables a one-way synchronization to occur - where any changes in the Google BigQuery table are downloaded into your data source on a regular basis.
Your data source will be automatically updated in this way until you remove the connector or an error occurs (such as losing authorization to access the database).
Before you add a Google BigQuery Connector, you must ensure that you have a valid Google Cloud Platform Connection set up on your organisation. You also need to setup a few basic things in the GCP console.
To Set up a Google BigQuery Connector to your Data Source by following these simple steps:
The page should refresh with your newly added connector.
Next, configure the following:
- Project Id: Specify the project id where your table and dataset is located.
- Dataset Name: Specify the dataset where your table can be located.
- Table Name: The Google BigQuery database table from which rows will be retrieved
- Ignore Internal Columns: If enabled, this connector will ignore all columns where the column name starts with an underscore e.g. _lastupdated
If your table has a column named _identity and internal columns are not ignored, this column will always be the first column of the data source. Other internal columns are added to the end.
- Refresh Frequency: The frequency that data is pulled by this connector.
When you save your changes, the connector will be fired for the first time and after that will run at the interval you specified in the connector settings.
Wait a minute or so and then check the Rows page for your data source.
If rows are not downloaded, then there may be an error with the connection to the Google BigQuery API.
You can check this by clicking on the View Logs button shown next to your connector on the Settings page.