Dan Hansen

Results 97 comments of Dan Hansen

Great. I will tag you in the PR that achieves the performance improvements. I'm still piecing out the prerequisite PRs in `go-zetasqlite`. From my observed benchmarks, we were able to...

@totem3 It will be a little while until the PR dependencies are merged into their respective @goccy repositories, but you should be able to build an emulator binary using this...

@totem3 @goccy This is ready for your review if you'd like to take a look for more context on how the other PRs I opened up fit into the puzzle....

I finally got the chance to compare runtimes now that all my PRs had been sorted out. A single request to the emulator takes ~18 seconds when the project has...

That's great to hear! The impact you are seeing is likely mostly due to the API data access refactor. Our fork has only slightly diverged from the upstream repositories, some...

It looks like the jobs insert handler currently only handles query jobs, import from GCS, and extract to GCS jobs: https://github.com/goccy/bigquery-emulator/blob/main/server/handler.go#L1372-L1391 `to_gbq` uses the `BigQueryClient.load_table_from_dataframe` method which POSTs a CSV...

I had tried using `mitmproxy` and `tinyproxy` but couldn't figure out an easy solution. I'll take a look at the crypto usage sometime soon.

@szymon-blaszczyk-db @goccy I've identified the root cause of this to #140 and opened a fix in #141

I'll need to cherry-pick https://github.com/Recidiviz/go-zetasqlite/pull/33 into this branch before we merge. It looks like the `go-sqlite3` PR is getting close to being merged.