kpe

ok, I found this https://groups.google.com/g/delta-users/c/x2xnHkysIZw - CREATE and INSERT SQL syntax is not supported

Thanks @vkorukanti, I don't see a reference to Spark 3.4 in the above link. Building the current spark master branch (3.4.0-SNAPSHOT) doesn't seem to help either. I guess for the...

just as a side note - it is interesting to note, that Apache Iceberg has a similar/related feature "partitioning transform" which uses syntax like: ```sql ... PARTITIONED BY (months(ts), ...)...

@tdas Thank you for the explanation! It all make sense, and I'm looking forward to use the GENERATED syntax in delta open source soon. (without being an iceberg advocate or...

can we expect the SQL syntax for GENERATED columns to become available in Delta 2.0? (now that delta is to be fully open sourced)

@DUTANGx - thank you for your contribution. Have you made any comparison of how much improvement could be obtained by using CRF on top of (AL)BERT as compared to using...

@atreyasha - I have not done gradient accumulation yet. I think if you do one, it would best fit https://github.com/kpe/params-flow as it is not model specific, but feel free to...

this could be quite of a task (although there is a lot of information on the net), depending on how you represent your data. What should be easily accessible is...

@vinnytwice - yes, sure. I guess, the 3 ``"\n"`` are how the ``run_squad.py`` script chooses to represent the data - text file with the context text and a question (separated...

I haven't look at the WebQA yet (do you have a download link for the dataset?), but I'm planning to commit a notebook on how to use bert-for-tf2 on SQuAD...