Josh Rosen

There's probably some horrible hack to call into the Java version of the API through Py4J then to wrap the result back into a Python schema or DataFrame.

There are two separate issues here: - When writing to Redshift (i.e. when using `COPY`), this library is not properly respecting encryption settings when writing the manifest. This is a...

Do the missing Avro files contain rows or are they empty files? Redshift's Avro reader has a bug where it crashes on Avro files which contain now rows, so our...

@danielnuriyev, in the example that you attached to this GitHub issue there are six Avro files, numbered part-r-00000 through part-r-00005, but the manifest only lists one of them (part-r-00003). Thus...

The Avro spec actually _does_ say something about this (emphasis mine to make things clearer): > Record, enums and fixed are named types. Each has a _fullname_ that is composed...

The type `NullType` usually occurs as the type of `null` literals; if you have a column of some other type which happens to contain nulls then you'll have a nullable...

Which version of Spark are you using? If you're using 2.1.x then I suspect that changes to internal APIs may have broke `spark-redshift`, in which case we'll need to make...

Actually, looking a little more closely since this problem relates to `prepareRead` I don't think it's a 2.1.x issue since that method had been completely removed from Spark by that...

I think the current test only exercises one of the branches in ``` scala val taken = if (leftToDrop > 0) it.take(0) else it.take(left) ``` To cover more cases, I'd...

About a year ago I ran into a related issue with reStructuredText and excerpt template tags, although I didn't get around to fixing it: http://groups.google.com/group/hyde-dev/browse_thread/thread/2dfecfe3fab29896