pandas.DataFrame.to_gbq¶
- DataFrame.to_gbq(destination_table, project_id=None, chunksize=None, reauth=False, if_exists='fail', auth_local_webserver=False, table_schema=None, location=None, progress_bar=True, credentials=None)[source]¶
Write a DataFrame to a Google BigQuery table.
This function requires the pandas-gbq package.
See the How to authenticate with Google BigQuery guide for authentication instructions.
- Parameters
- destination_tablestr
Name of table to be written, in the form
dataset.tablename
.- project_idstr, optional
Google BigQuery Account project ID. Optional when available from the environment.
- chunksizeint, optional
Number of rows to be inserted in each chunk from the dataframe. Set to
None
to load the whole dataframe at once.- reauthbool, default False
Force Google BigQuery to re-authenticate the user. This is useful if multiple accounts are used.
- if_existsstr, default ‘fail’
Behavior when the destination table exists. Value can be one of:
'fail'
If table exists raise pandas_gbq.gbq.TableCreationError.
'replace'
If table exists, drop it, recreate it, and insert data.
'append'
If table exists, insert data. Create if does not exist.
- auth_local_webserverbool, default False
Use the local webserver flow instead of the console flow when getting user credentials.
New in version 0.2.0 of pandas-gbq.
- table_schemalist of dicts, optional
List of BigQuery table fields to which according DataFrame columns conform to, e.g.
[{'name': 'col1', 'type': 'STRING'},...]
. If schema is not provided, it will be generated according to dtypes of DataFrame columns. See BigQuery API documentation on available names of a field.New in version 0.3.1 of pandas-gbq.
- locationstr, optional
Location where the load job should run. See the BigQuery locations documentation for a list of available locations. The location must match that of the target dataset.
New in version 0.5.0 of pandas-gbq.
- progress_barbool, default True
Use the library tqdm to show the progress bar for the upload, chunk by chunk.
New in version 0.5.0 of pandas-gbq.
- credentialsgoogle.auth.credentials.Credentials, optional
Credentials for accessing Google APIs. Use this parameter to override default credentials, such as to use Compute Engine
google.auth.compute_engine.Credentials
or Service Accountgoogle.oauth2.service_account.Credentials
directly.New in version 0.8.0 of pandas-gbq.
New in version 0.24.0.
See also
pandas_gbq.to_gbq
This function in the pandas-gbq library.
read_gbq
Read a DataFrame from Google BigQuery.