Bashir Sadjad

This is a placeholder for a bunch of documentation tasks that are overdue: - [ ] Document SQL-on-FHIR-v2 support, and materialized views in RDBMS. - [ ] Review current documentation...

Steps to reproduce (this is the how I found about this issue; it probably can be reproduced directly by `FhirEtl` and for any other resource type that has a missing...

Multiple partners have told us that they want to query Parquet files with DuckDB. Using different query engines that understand Parquet was one of the original design principles of our...

This is a follow-up to #995 and the idea is to add an option to fetch real resources from the FHIR server, then apply the provided ViewDefinition on them. The...

Compare Spark+Parquet with PostgreSQL/Alloy DB view based approaches

2

Now that our support for SQL-on-FHIR-v2 ViewDefinition is complete (#821 and #916) we should do some large scale comparisons of the Spark+Parquet based approach with relational DB based ones using...

Create a realistic test env to show scaling capabilities of the pipeline

1

The main reason that our pipelines are implemented using Apache Beam is to make sure they are horizontally scalable and able to process large input FHIR data in a short...

The [streaming pipeline](https://github.com/google/fhir-data-pipes/tree/master/pipelines/streaming) was originally implemented for OpenMRS but no one is currently using it. It has been in the maintenance mode for at least two years and it is...

Increase OpenMRS test docker image pull limit.

1

When running multiple e2e tests, we soon get an error like the following when starting OpenMRS [here](https://github.com/GoogleCloudPlatform/openmrs-fhir-analytics/blob/ad662de11aa7d71bca4ef135452b290e2a3c68f8/e2e-tests/batch-mode-tests.sh#L24): ``` 16358E2E: BATCH MODE TEST: STARTING SERVERs 16359Creating network "docker_default" with the default...

Add automatic python style checks

2

As our Python code base is getting larger, we need an automatic way of checking style issues in our continuous build to avoid "style nit" comments in reviews. We should...

Evaluate Presto/Trino as a query engine on the generated Parquet files

4

[Presto](https://prestodb.io/) is a query engine to run interactive SQL queries in a distributed environment. It is open-source and seems to resemble some of the features of BigQuery (I have not...