mongoengine Serialization / deserialization

Create a serializer and deserializer for mongodb documents...

Useful for testing / small data exporting..

Refs: #181

Jun 27 '11 13:06 rozza

from #230

example:

#serializing Person.objects.serialize('xml') Person.objects.serialize('yaml')

a = open('output.xml', 'wb') Person.objects.serialize('xml', fields=('data.name', 'endr'), out=a)

#deserialize data = open('input.xml', 'rb').read() objs = Person.objects.deserialize('xml', data)

for obj in objs; obj.save()

Jul 12 '11 13:07 rozza

IMO it'd be cool to have serialization/deserialization helper classes instead hooking it with queryset. My examples are inspired from django project.

data = serializers.serialize("xml", SomeModel.objects.all())
data = serializers.serialize("json", SomeModel.objects.all(), excludes=('password',))

def get_absolute_url(self): #document class method
    return "/user/%d" % self.pk

data = serializers.serialize("json", SomeModel.objects.all(), excludes=('password',),
                                                     extras=[('url', 'get_absolute_url'),])

for deserialized_object in serializers.deserialize("xml", data):
    if object_should_be_saved(deserialized_object):
        deserialized_object.save()

If someone try to load partial data into deserializer, it should work until it's valid but may not able to save it if constraint fails.

Jul 12 '11 20:07 iapain

@rozza. I shall work on that feature in the next days. is a very important feature for various projects.

Sep 26 '11 18:09 wpjunior

I am starting work in this branch: https://github.com/wpjunior/mongoengine/tree/serializers

Sep 26 '11 19:09 wpjunior

Example Encoder - https://gist.github.com/1372780

Nov 17 '11 09:11 rozza

Great, thanks for the pointer. Updated version to use json over simplejson, and dbref over pymongo:

https://gist.github.com/2726279

May 18 '12 16:05 benjiec

I had to make a serializer for the app i'm working on. It surely requires some improvements, but it seems to work. It serializes querysets / lists of querysets. I wouldn't use it to serialize huge datasets however.

https://gist.github.com/3009143

Jun 28 '12 04:06 benwah

Good stuff! I after europython I will have time look into this.

Ross

On Thu, Jun 28, 2012 at 5:31 AM, benwah < [email protected]

wrote:

FYI.. the reason it's kinda long, is that I wanted to serialize things like lists of querysets, for json views, like so:

[AdCategory.objects.all(), Region.objects.all()]

I could do it with a simple serializer and string formatting, but I though building json using string formatting wasn't especially pretty.

Reply to this email directly or view it on GitHub: https://github.com/hmarr/mongoengine/issues/210#issuecomment-6621706

Jun 28 '12 08:06 rozza

Any progress on this?