SidWeng

Results 12 comments of SidWeng

approximateElementCount() is wrong after intersect or union

@alexandrnikitin I send a PR #40 to fix this issue, please review it.

Fix bitCount is 0 after intersect or union

@alexandrnikitin I cannot figure out why "java.lang.NoClassDefFoundError: sbt/inc/Analysis" happens, any advice?

Fix bitCount is 0 after intersect or union

@alexandrnikitin Could you post the JVM crash log or reproduce step?

Fix bitCount is 0 after intersect or union

I try to reproduce it and looks like something wrong with unsafe.getLong() in UnsafeBitArray.set() but still cannot find out the root cause(I guess the index is too big and cause...

Fix bitCount is 0 after intersect or union

I add some [debug log in UnsafeBitArray.scala](https://gist.github.com/SidWeng/0512793ba6e77df420a401a9f18945ad) then run `sbt "project tests" "testOnly *UnsafeBitArraysSpec"` following is the debug log just before crash(unsafe.getLong(offset) in UnsafeBitArray.set()): numberOfBits: 2147483647 indices: 33554432 ptr: 4805672960...

Having trouble adding rule model mixin. -- TypeError: 'class Meta' got invalid attribute(s): rules_permissions

I solve it by: ``` class RulesPolyModelBase(RulesModelBaseMixin, PolymorphicModelBase): pass class MyModel(RulesModelMixin, PolymorphicModel, metaclass=RulesPolyModelBase): ```

[FEA] Research Spike to come up with a plan for DataSet support

@revans2 Of course and thanks for your explanation. > In order to support these we would have to do a lot of JVM byte code analysis at the plan level...

[FEA] Research Spike to come up with a plan for DataSet support

@revans2 Sorry for late reply and here's an example in our scenario: We have a DataFrame of Record, what we want to do is group Record by region, then do...

Django polymorphic + drf writable nested. The `.update()` method does not support writable nested fields by default.

same issue, but it complains about .create()

The columns of A don't match the number of elements of x. A: 768, x: 1536

@maziyarpanahi I found the root cause but I'm guessing it is not a bug, please take a look https://github.com/JohnSnowLabs/spark-nlp/discussions/14362#discussioncomment-10344195