django-gsheets
django-gsheets copied to clipboard
Django app for keeping models and google sheets synced
django-gsheets
Django app for keeping models and google sheets synced
Purpose
django-gsheets is a pluggable Django app that adds functionality (via mixins) to models allowing them to sync data to and from Google Sheets. The app errs on the side of caution in that deletions from your DB won't propagate to the sheet and visa versa.
Installation
Install django-gsheets
pip install django-gsheets
Add django-gsheets to INSTALLED_APPS
INSTALLED_APPS = [
...
'gsheets',
...
]
After adding, make sure to run migrate
Create a Google Cloud Project and Download OAuth Client Secrets
Google has a good guide for that here (you only need to do Step 1).
Update Project Settings
Update your project settings to tell django-gsheets where the downloaded credentials are. You should just need the following:
GSHEETS = {
'CLIENT_SECRETS': '<PATH TO DOWNLOADED CREDS>'
}
Add GSheets URLS to the Project
Update your project URLs to include django-gsheets paths.
urlpatterns = [
...
path('', include('gsheets.urls')),
]
Usage
Add the SheetSyncableMixin to a Model
In order to provide two-way sync capability to a models' data, all you need to do is add the SheetSyncableMixin
to it and tell the model what sheet to use. For example:
from django.db import models
from gsheets import mixins
from uuid import uuid4
class Person(mixins.SheetSyncableMixin, models.Model):
spreadsheet_id = '18F_HLftNtaouHgA3fmfT2M1Va9oO-YWTBw2EDsuz8V4'
model_id_field = 'guid'
guid = models.CharField(primary_key=True, max_length=255, default=uuid4)
first_name = models.CharField(max_length=127)
last_name = models.CharField(max_length=127)
email = models.CharField(max_length=127, null=True, blank=True, default=None)
phone = models.CharField(max_length=127, null=True, blank=True, default=None)
def __str__(self):
return f'{self.first_name} {self.last_name} // {self.email} ({self.guid})'
To two-way sync sheet data, simply run Person.sync_sheet()
.
If you want to be more fine-grained and have models that either just push to Google Sheets or just pull, you can swap SheetSyncableMixin
for SheetPushableMixin
or SheetPullableMixin
(respectively).
Authorize Google Sheets
Before your first usage, you'll need to authorize the app to perform operations on your Google Sheets. To do so, access /gsheets/authorize/
on your application and go through the standard oauth flow.
Further Configuration
You can further configure the functionality of sheet sync by specifying any of the following fields on the model.
Field | Default | Description |
---|---|---|
spreadsheet_id | None | designates the Google Sheet to sync |
sheet_name | Sheet1 | the name of the sheet in the Google Sheet |
data_range | A1:Z | the range of data in the sheet to keep synced. First row must contain field names that match model fields. |
model_id_field | id | the name of the model field storing a unique ID for each row |
sheet_id_field | Django GUID | the name of the field in the synced sheet that will store model instance IDs |
batch_size | 500 | (internal) the batch size to use when updating sheets with progress |
max_rows | 30000 | (internal) used for internal calculations, don't change unless you know what you're doing |
max_col | Z | (internal) used for internal calculations, don't change unless you know what you're doing |
Postprocessing
You can hook into the postprocessing step of row pulling to perform operations like tying the model instance to a related object. For example, the following demonstrates using the sheet_row_processed
signal to update a Car with it's owner information based on a field called owner_last_name
in the spreadsheet
from django.dispatch import receiver
from django.core.exceptions import ObjectDoesNotExist
from gsheets.signals import sheet_row_processed
from .models import Car, Person
@receiver(sheet_row_processed, sender=Car)
def tie_car_to_owner(instance=None, created=None, row_data=None, **kwargs):
try:
instance.owner = Person.objects.get(last_name__iexact=row_data['owner_last_name'])
instance.save()
except (ObjectDoesNotExist, KeyError):
pass
Management Commands
If you don't want to manually sync data to and from models to gsheets, django-gsheets
ships with a handy management command that automatically discovers all models mixing in one of SheetPullableMixin
, SheetPushableMixin
, or SheetSyncableMixin
and runs the appropriate sync command. To execute, simply run python manage.py syncgsheets
.
Known Limitations
- No support for Related fields
Development
Any and all contributions welcome. To get started with a development environment, simply pull down a copy of this repo and bring up the environment with docker-compose up -d
. Before doing so, however, you should have the following in place:
- A google project setup (notes on that in the
Installation
section above). After setting up, download the client credentials JSON file to thecreds
folder in this repo. This folder is volume mounted into the running application container at/creds
. - An ngrok (or similar) server set up to proxy an https connection to your local dev environment. You'll need this because Google OAuth2 only supports https redirect URIs.