Skip to content

Improve reindex throughput by using batch-based processing #3739

@punktilious

Description

@punktilious

Is your feature request related to a problem? Please describe.
Currently the reindex process involves a number of per-resource interactions with the database. Throughput could be improved by performing a number of these interactions using a list of resources instead of individual ones.

Describe the solution you'd like
The parameter values should be collected and submitted to the database using the fhir-remote-index implementation. Requires a refactor of the fhir-remote-index parameter logic so that it can be shared by both the fhir-remote-index and fhir-persistence-jdbc projects.

Describe alternatives you've considered
Keep as-is and accept current performance.

Acceptance Criteria

  1. GIVEN a database loaded with a lot of data
    WHEN reindexing is performed
    THEN throughput using the new reindex implementation has improved

Additional context
A new project is warranted here because we want to keep fhir-remote-index small and not have it need to depend on fhir-persistence-jdbc, which pulls in a lot of dependencies.

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions