dataframe
dataframe copied to clipboard
Structured data processing in Kotlin
It's odd that after a ```kt if (myCol.isColumnGroup()) ``` check you still need an explicit cast to `ColumnGroup` to be able to call `columnsCount()` on `myCol`. The check should tell...
I'd argue that KType nullability should always check actual column values. https://github.com/Kotlin/dataframe/blob/master/dataframe-jdbc/src/main/kotlin/org/jetbrains/kotlinx/dataframe/io/readJdbc.kt#L597 Which is done by `infer = Infer.Nulls` My reasoning is mostly related to notebooks Pros: you won't have...
From @Jolanrensen > DataFrame.readResultSet(resultSet, PostgreSql) > cannot be called more than once! This is not expected behavior for me as dataframe calls are always functional. They do not modify the...
- [ ] common link with in the GET with parameters style is not supported correctly (add a test for this) - [ ] common url with login and password
Currently, the SampleNotebooksTests have all tests as disabled because of deprecated code and dependencies there Need to revisit all these examples, remove `@Ignore` annotations and make them actual and fresh.
Add to debug logging in the jdbc integration module the information about the data loading process
- [ ] number of loaded rows - [ ] total number of rows in the table/query - [ ] number of data/size of data calculated by footprint in memory,...
The existing solution supports only presenting JSON type as a String We need to convert correct JSON strings to the hierarchical structure after reading from the Result Set
The proposed idea adds data/time auto-discovering in the spirit of the CSV integration [the link](https://github.com/Kotlin/dataframe/blob/913d6a0fe0fe2f30573b1f0c7696146457392f39/core/src/main/kotlin/org/jetbrains/kotlinx/dataframe/impl/api/parse.kt#L218) All approaches should be aligned and unified Now we have java.sql.time* types instead of Kotlin
- [ ] tables - [ ] columns and its types - [ ] number of rows and columns in the table - [ ] number of nulls in columns...
Arrow Struct type is read as a `Map` object : https://github.com/Kotlin/dataframe/blob/86b80e0c9cd372334e8eff05115a7c50b6ea61bc/dataframe-arrow/src/main/kotlin/org/jetbrains/kotlinx/dataframe/io/arrowReadingImpl.kt#L171-L173 But write does not support Map Object and by defaut value is serialized as a `String` : https://github.com/Kotlin/dataframe/blob/86b80e0c9cd372334e8eff05115a7c50b6ea61bc/dataframe-arrow/src/main/kotlin/org/jetbrains/kotlinx/dataframe/io/arrowTypesMatching.kt#L93-L95 The...