9951 explained code solutions for 126 technologies


google-big-queryHow do I upload a CSV file to Google BigQuery?


  1. First, create a Google Cloud Storage bucket.
  2. Next, use the bq command line tool to upload the CSV file to the bucket.
    bq load --source_format=CSV <dataset>.<table> <csv file> <schema>
  3. Then, create a BigQuery table in the desired dataset.
  4. Finally, use the bq command line tool to load the CSV file into the table.
    bq load --source_format=CSV <dataset>.<table> gs://<bucket>/<csv file> <schema>

The bq command line tool can be used to upload a CSV file to Google BigQuery. The command consists of the following parts:

  • bq: the command line tool
  • load: the command to load data
  • --source_format=CSV: the source format of the data (in this case, CSV)
  • <dataset>.<table>: the destination dataset and table
  • <csv file>: the CSV file to be uploaded
  • <schema>: the schema of the table

If the CSV file is stored in a Google Cloud Storage bucket, the gs://<bucket>/<csv file> should be used instead of <csv file> in the command.

Helpful links

Edit this code on GitHub