byzer-lang
byzer-lang copied to clipboard
byzer-org
Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.
Currently, the mlsql plugin defines the scope of compatibility by enumerating the supported versions. But, once a new version is generated, the plugin will not adapt and occur errors like...
## Description When saving over 10001 rows into MySQL, 10K rows were saved, but an exception is thrown. java.sql.SQLException: Can't call commit when autocommit=true ## Environment - Ubuntu 20.04 -...
Suppose we have 100 columns in A table. If the user wanna excludes 1 column, it's inconvenient in SQL. It looks like this: ```sql select col1, col2, .... col99 from...
## EXAMPLE: load jdbc.`jdbc_connect.job_info` as jobinfo1; -- size of job_info is about 600M -- can not get effective result ## ROOT CAUSE: The engine only catches exceptions, but not errors.
1. 执行命令如下： set mockData=''' {"title":"第一","body":"内容1"} {"title":"第二","body":"内容2"} {"title":"第三","body":"内容3"} '''; load jsonStr.`mockData` as data; !python env "PYTHON_ENV=source /root/miniconda3/bin/activate dev"; !python conf "runIn=driver"; !python conf "schema=st(field(title,string),field(body,string))"; !python conf "dataMode=data"; !ray on data '''...
执行以下语句，提交任务skipAuth默认为false，报错 ``` connect jdbc where url="jdbc:mysql://127.0.0.1:3306/db" and driver="com.mysql.jdbc.Driver" and user="root" and password="root" as db_1; ``` ``` run command as JDBC.`db_1._` where `driver-statement-query`="show tables" and sqlMode="query" as db1_show_tables; ``` 堆栈信息： ```...
mlsql engine版本： mlsql-engine_2.4-2.0.1 spark版本：spark-2.4.3-bin-hadoop2.7 yarn：cdh6.2.0-hadoop3.0 控制台执行脚本： set abc=''' { "x": 100, "y": 200, "z": 200 ,"dataType":"A group"} { "x": 120, "y": 100, "z": 260 ,"dataType":"B group"} { "x": 100, "y":...
一个包含python代码脚本文件，执行过程中groupId发生变化，执行多次变化的都是同一个值，以下跟踪代码图片及定位到的问题     ------->>>定位到的问题：pythonWorkers.getOrElseUpdate(key, new PythonWorkerFactory(pythonExec, envVars, conf)) ------->>>getOrElseUpdate函数非更新，一直获取第一次放入的值，导致groupId最终都是一个值
### Story 1. 目前上传压缩文件后引擎不会将其解压，文件没办法直接使用； 2. 用户可能会有批量生成的压缩后数据文件，如果手动解压后再上传可能比较麻烦。 ### Design 暂时只支持对 `tar, tar.gz, gz, zip` 类型文件自动解压，而且默认以不带类型后缀的文件名作为解压目录。 为此，实现工具类 `DecompressUtil`，在读取到文件名时，判定文件是否是支持解压缩的文件类型，如是，对InputStream加一层解压处理 
mlsql can add config in `start-local.sh`, but it not easy for users to understand or use this configuration. we can add all configurations to a properties file. For each configuration,...