Google BigQuery
Google BigQuery is a fully managed, serverless data warehouse that enables fast SQL-based analysis of large-scale datasets. It automatically handles infrastructure, scalability, and performance optimization, allowing users to focus on querying and analyzing data.
Prerequisites
The following prerequisites must be met for a user to create and test a successful connection.
- The BigQuery server must be accessible from the iceDQ server.
- Valid credentials to access the database.
- Google BigQuery JDBC version 23 or above.
Authentication Mechanism
The following authentication mechanism is supported.
- Service Account
Connection Properties
Use one or more properties from the table below to create a valid connection. Properties marked with an asterisk (*) are required.
| Name | Description | Example Values |
|---|---|---|
| Connection Name * | A unique name that identifies the connection. | BigQuery_Sales_Conn |
| Driver * | Driver used to establish the connection. By default, one driver is available. | Google BigQuery Custom JDBC |
| Type * | Service account authentication only supports System Connections. Refer Connections for more details. | System |
| Project ID * | The Google Cloud project that contains the BigQuery datasets. | sales-prod |
| Service Account Key * | The JSON key content for the service account used for authentication. Choose the key within the linked Secret. | { "type": "service_account", "project_id": "my-gcp-project", ... } |
Custom Properties
The following optional connection properties can be configured based on user requirements.
| Property | Default Value | Possible Values | Description |
|---|---|---|---|
| StorageTimeout | 60 | Integer | Storage API idle time in seconds. |
| MaxRows | -1 | Integer | Limits the number of rows returned. |
| Timeout operation | 300 | Integer | Connection timeout in seconds. |
Supported Datatypes
The following datatypes are supported.
- ARRAY
- BINARY
- BOOL
- DATE
- DATETIME
- DECIMAL (NUMERIC)
- DOUBLE
- INTERVAL
- LONG (INT64)
- STRING
- STRUCT
- TIME
Note: Complex datatypes like ARRAY, STRUCT, INTERVAL are read as TEXT datatype