cascalog

cascalog copied to clipboard

Why use out of date hadoop-core instead of replacement hadoop-common?

5

Shouldn't `hadoop-common` be used in place of `hadoop-core` in the dependencies of the various Cascalog projects, per this [stackoverflow question](http://stackoverflow.com/questions/28856096/differences-between-hadoop-common-hadoop-core-and-hadoop-client) or is there something else keeping it from being updated/changed...

thoughtmanifest

Is this project still maintained?

2

I've been tasked to begin learning Hadoop and I'd like to do it in Clojure. This is one of the projects I've found, but most projects, including this one, haven't...

keithharper

The sample file 'project.clj' still shows old Hadoop dependencies. The new and working ones (replace 2.7.3 version with your Hadoop version): ``` :profiles { :provided {:dependencies [[org.apache.hadoop/hadoop-common "2.7.3"] [org.apache.hadoop/hadoop-hdfs "2.7.3"]...

ikarius

This used to fail since ClojureFlow did not support ISelectFields protocol.

ipostelnik

Problem in directly querying data in pail structure

1

I am having a problem in Lambda Architecture, Our data stored in HDFS is in fact based pail format using Thrift Serialization schemes and vertical partitioning. Is there any direct...

pankug

midje-cascalog produces wrong output from basic queries

7

using [cascalog/midje-cascalog "2.1.1"] ``` clj (fact ( ?n ?n)) => (produces [[0] [1] [4]]])) ;; false, produces [[4] [4] [4]] (? ?n ?n)) ;; prints 0 1 4 ``` Also,...

timothypratley

??- returns only the last tuple of a sequence

19

The following input on cascalog.playground: ``` clojure (??- (

ghost

Clojure 1.7.0 Warnings due to new core functions

7

When using Clojure 1.7.0 warnings are emitted: ``` WARNING: some? already refers to: #'clojure.core/some? in namespace: jackknife.seq, being replaced by: #'jackknife.seq/some? Warning: protocol #'cascalog.cascading.flow/IRunnable is overwriting function run! WARNING: run!...

timothypratley

fix for ops that return nil

9

In memory platform was blowing up for an op that returned a single nil value, due to (jackknife.seq/collectify nil) => []

bfabry

Add option to force Cascading to cache a subquery result

1

Cascading won't cache a subquery result if the subquery was a map-only job. Might be able to use the isSafe method on an operation to do this. See http://groups.google.com/group/cascalog-user/browse_thread/thread/40326ead37a09b23 for...

nathanmarz