Skip to content

Google BigQuery

Setup Requirements

  • A BigQuery Account
  • Rights to create users, datasets, and roles in BigQuery

Step 1: Create Service Account & Key for use in Continual

  1. In your GCP account, navigate to IAM & Admin > Service Accounts and click + Create Service Account at the top of the page to create a new account.
  2. Fill in an appropriate name and description for the service account (like continual-service-account) and click Create and continue.
  3. In the next field, Select Role and search for BigQuery User. Add this role to the service account and click Continue, then Done.
  4. You'll now be taken back to the list of service accounts. Click the name of the service account you just created and navigate to Keys. Click Add Key then Create new key.
  5. Accept the defaults of the pop up window and click Create. A json file containing the key should be downloaded to your computer.

Step 2: Create a dataset in BigQuery for Continual to use as the Feature Store

  1. In your GCP account navigate to Big Query and click the three dots next to the project you wish to store your Continual feature store in. Click Create dataset.
  2. Enter the name of your feature store in the Dataset ID field and click Create Dataset.
  3. Find the dataset in your BigQuery Explorer and open it.
  4. Click the Share Dataset icon in the dataset menu.
  5. Under Dataset Permissions add the service account you created above in the Add Members field. Click Select a role and select BigQuery Admin. Click Done.

Step 3: Grant Service Account Permissions on Desired BigQuery Datasets

For any other BigQuery datasets that you'll want this service account to be able to query, perform the following:

  1. In your GCP account navigate to Big Query and open the dataset that you wish to share.
  2. Click Share Dataset in the dataset menu.
  3. Under Dataset Permissions add the service account you created above in the Add Members field. Click Select a role and select BigQuery Viewer. Click Done.

Step 4: Configure Continual Project to use Big Query

During project creation, select Google BigQuery as your feature store. You'll need to provide the following information during configuration:

  1. Service Account Key (the json file downloaded in step 1)
  2. Dataset ID for the Continual feature store.
Back to top