Geoff Duniam

Afternoon, We're running Jupyterhub on the gateway server of a Hadoop Spark cluster. The worker nodes are all GPU enabled, but the gateway server isn't. Pyspark is working fine. What...

Spark settings

37

We're wanting to use SparkFlow for source detection on radio astronomy images, but even on the MNINST example jobs with larger iteration counts are failing. Given the 60,000 images in...

Relationship between SparkFits dataframe and source fits file?

13

Just started looking at SparkFits for a large scale data modelling and analysis project for radio astronomy - we'll be dealing with very large image cubes - (currently testing on...