argopy icon indicating copy to clipboard operation
argopy copied to clipboard

Issues with DataSet fetched from Argopy for Indian Ocean region

Open mayursapkal opened this issue 4 years ago • 4 comments

Hello, Argopy! I began working on a classification problem in the beginning of this year, using Argo data as input. Since the project is based on the Indian Ocean, I used Argopy's Parallel data fetching method to obtain data from 2010 to 2019, ranging from 0 to 1000 dbar. Data was fetched every two years, and then I used Xarray to merge all of the files. I had a lot of problems using that data because the data was not handled/stored correctly within in the array. The Issues are;

  1. Variables values not in sorted manner. Eg. variables values (Pressure, Temp, Salinity) in most of the arrays started with from 500 dbar values and respective to those Temperature and salinity values also stored in arrays. Screenshot (92)_LI

  2. Pressure values starting with negative values. Screenshot (96)_LI

  3. Only single value in whole DataArray. Screenshot (97)

  4. Unsuited Values Screenshot (98)

  5. Partial values for work, when fetched up to 1000 dbar level Screenshot (99)_LI

mayursapkal avatar May 07 '21 18:05 mayursapkal

Hi @mayursapkal , can you give me some examples of float and cycle numbers so I can check on my side ? Also, which data source do you use ? erddap ? local_ftp ? Cheerz

quai20 avatar May 10 '21 06:05 quai20

Hi @quai20, Sorry for late reply. I've attached a screenshot of some of the Floats that have the above issue, and I tried to fix the problem on my own because I was short on time at the time of my project (link) .

  1. WMO float identifier : A9IIIII- image image

Data source I used was erddap. Please don't forgot to convert 1D array data to 2D array.

mayursapkal avatar May 11 '21 09:05 mayursapkal

Hi @mayursapkal Could you please show us the command used to fetch and process the data used in notebook linked to your previous message ?

1- I suspect this is due to the point2profile transformation 2- Using vertical-index averaging throughout all profiles in the notebooks will mix a lot of very different pressures and could explain the weird figures

gmaze avatar Sep 01 '21 07:09 gmaze

This issue was marked as staled automatically because it has not seen any activity in 90 days

github-actions[bot] avatar Dec 07 '21 10:12 github-actions[bot]

Closing because of a lack of information

gmaze avatar Sep 23 '22 09:09 gmaze