advancedxy

Results 67 comments of advancedxy

> Since the implementation will be in the library itself, we can handle some complexity there, and we want to make sure we have the flexibility to handle all use-cases...

Any updates? I also ran into this problem...

Hi, @hanks, I found I can disable internal keyboard on air using this tool https://pqrs.org/osx/karabiner/. It's open sourced on Github. Maybe you should check out to see how karabiner do...

@pralabhkumar thanks for your work. I noticed similar issue when running spark application on K8S, it's helpful feature However, this pr might have some inefficiency to download files/jars twice when...

> cc @jerqi @advancedxy I think it's nice to have this feature. It might also be related with stage resubmission.

1.24 is already end of life[^1]. I think the master code should target the latest K8S version instead. However there might be some pretty old k8s clusters runnings in the...

Sorry, @zuston I missed your comment. > I have a question that I remember spark will sort the data using the sortExec in dataframe api. That means the sort will...

> > For this particular feature, I think MR/Tez would benefit from that substantially(to be frankly, I had developed a similar shuffle system back ~6-7 years ago). The spark integration...

> And I think the extra strategy rule also could be delegated by uniffle if this is valuable. WDYT? If it's possible by simply inject a strategy rule, then I'm...

> You're paying too much attention to sort. In fact, merge may contain sort or combine. For spark, I think combine is more genernal. Remote merge also solves the problem...