Google Spreadsheets and Python

This post is inspired by Patrick McKenzie’s reminder that sometimes you don’t need a database:

So if you’re building out a quick CRUD app for e.g. internal use, Google Docs as a backend (consumed via JSON) is *surprisingly* powerful.

― Patrick McKenzie (@patio11) July 5, 2014

In this tutorial, we’ll use the gspread python package to read, write, and delete data from a Google Spreadsheet with just a few lines of code.

Google Drive API and Service Accounts

At the risk of being Captain Obvious, you’re going to need a spreadsheet if you want to follow along with this post. If you don’t have one on hand that’s full of juicy data, might I suggest you make a copy of this spreadsheet with contact information for all United States legislators ? (Side note: Ian Webster uses this data in conjunction with Twilio to make it easy for citizens to call congress ).

To programmatically access your spreadsheet, you’ll need to create a service account and OAuth2 credentials from the Google API Console . If you’ve been traumatized by OAuth2 development before, don’t worry; service accounts are way easier to use.

Follow along with the steps and GIF below. You’ll be in and out of the console in 60 seconds (muchlike Nic Cage in your favorite Nic Cage movie).

Go to the Google APIs Console . Create a new project. Click Enable API . Search for and enable the Google Drive API. Create credentials for a Web Server to access Application Data. Name the service account and grant it a Project Role of Editor. Download the JSON file. Copy the JSON file to your code directory and rename it to client_secret . json

There is one last required step to authorize your app, and it’s easy to miss!

Find the client_email inside client_secret . json . Back inyour spreadsheet, click the Share button in the top right, and paste the clientemail into the People field to give it edit rights. Hit Send.

If you skip this step, you’ll get a gspread . exceptions . SpreadsheetNotFound error when you try to access the spreadsheet from Python.

We’re done with the boring part! Now onto the code.

Read data from a Spreadsheet with Python

With credentials in place (you did copy them to your code directory, right?) accessing a Google Spreadsheet inPython requires just two packages:

oauth2client to authorize with the Google Drive API using OAuth 2.0 gspread to interact with Google Spreadsheets

Install these packages with:

pipinstallgspreadoauth2client

Then paste this code into a new file called spreadsheet . py :

import gspread from oauth2client.service_accountimport ServiceAccountCredentials # use creds to create a client to interact with the Google Drive API scope = ['https://spreadsheets.google.com/feeds'] creds = ServiceAccountCredentials.from_json_keyfile_name('client_secret.json', scope) client = gspread.authorize(creds) # Find a workbook by name and open the first sheet # Make sure you use the right name here. sheet = client.open("Copy of Legislators 2017").sheet1 # Extract and print all of the values list_of_hashes = sheet.get_all_records() print(list_of_hashes)

Run python spreadsheet . py and marvel at the glorious, well-formatted data.

More with gspread

We’ve just scratched the surface of gspreads’ well documented and comprehensive functionality.

For instance, we extracted the data into a list of hashes, but you can get a list of lists if you’d prefer:

sheet.get_all_values()

Or you could justpull the data from a single row, column, or cell:

sheet.row_values(1) sheet.col_values(1) sheet.cell(1, 1).value

You can write tothe spreadsheet by changinga specific cell:

sheet.update_cell(1, 1, "I just wrote to a spreadsheet using Python!")

Or you can insert a row in the spreadsheet:

row = ["I'm","inserting","a","row","into","a,","Spreadsheet","with","Python"] index = 1 sheet.insert_row(row, index)

You can also delete a row from the spreadsheet:

sheet.delete_row(1)

And find out the total number of rows:

sheet.row_count

Check the gspread API reference for the full details on these functions along with a fewdozen others.

Using Google Spreadsheets with Python opens possibilities like building Flask apps with a spreadsheet as the persistence layer, or importing a data from a Google spreadsheet into Jupyter Notebooks and doing analysis in Pandas. But, I’m sure you’ve got better ideas than that.

If you build something cool, please let me know. You can find me at gb@twilio.com or @greggyb . And if this post was helpful, please share it with someone else who might dig it.