flambo
flambo copied to clipboard
sorenmacbeth
A Clojure DSL for Apache Spark
I've a [test project](https://github.com/xiongtx/sparktest) I'm trying to get working, but I can't figure out what's wrong. After building an uberjar, I submit it to a local standalone Spark cluster: ```sh...
I'm working with Spark 1.6 and it would be much easier for me to have the `session` namespace in version 0.7.2 as well. Would it be possible to simply add...
This pull request includes: * Scala -> Clojure recursive data type conversion * SQL array type support for `StructType` creation * Various other small utility functions * Context creation/caching. The...
Hello, I have written a code like - `(def c (-> (conf/spark-conf)` ` (conf/master "spark://abhi:7077")` ` (conf/app-name "test")))` `(def sc (f/spark-context c))` `(let [rdd (f/parallelize sc [[1 2][3 4]])]` `...
Hi I asked this [question](https://groups.google.com/forum/#!topic/flambo-user/qKcgkKbM4oE) over on the Flambo google group a few days ago however I'm not sure how active it is. Sorry if I'm just being impatient, I...
```clojure (defn -main [outpath] (let [conf (-> (conf/spark-conf) (conf/master "local[*]") (conf/app-name "broadcast-test"))] (f/with-context sc conf (let [bc (fb/broadcast sc [1 2 3])] (-> (f/parallelize sc [1 2 3 4 5])...
It would be great to have some equivalent of `bin/spark-shell` / `bin/pyspark` with predefined `SparkSession` and `SparkContext`.
