weird problem

[lijiawenl]

The data i used is [183497*600] , i set the k = 4590 and i get the error : 'internal bug inside kmeans_init_centroids: dis_num is NaN ' '/src/kmeans.cu:814->'an illegal memory encounted' 'cudaMempy failed' . but i set the k equal other number, like k = 4591, the kmeans works. - -! i thought this might occur randomly I have no idea where the problem is.

[vmarkovtsev]

Check your input for NaNs. If there are too many - they creep into centroids.

[vmarkovtsev]

Otherwise I need your data to reproduce the problem.

[lijiawenl]

Thanks for your reply. you mean the data i used have NaNs, but it does not make sense that when i set k=4591, it works. Could you send me a email-address that i can send the data to you.

[lijiawenl]

Many thanks.

[vmarkovtsev]

There is a certain tolerance of NaNs during the centroids initialization but it is not bulletproof.

My email is written on my profile page.

[georgandreasjaksch]

I seem to have a similar problem: the centroids randomly contain NaNs although my data doesn't. Repeating the clustering over and over again until no NaNs are in the centroids anymore kind of solves the issue. (350K, 15 dim, around k=100 clusters)

Is there any progress on this issue?