Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support backpressure for index sync #785

Closed
philippguertler opened this issue Jul 2, 2019 · 1 comment · Fixed by #791
Closed

Support backpressure for index sync #785

philippguertler opened this issue Jul 2, 2019 · 1 comment · Fixed by #791

Comments

@philippguertler
Copy link
Contributor

The index sync process currently creates requests for every element in Mesh while sending requests to Elasticsearch. This can cause a lot of buffered documents with high memory usage when elastic search is not fast enough to process the requests.

The generation of the requests already uses Flowables, but this is converted to an observable which does not support backpressure. This should be fixed to only use flowables.

@Jotschi
Copy link
Contributor

Jotschi commented Jul 3, 2019

Implemented in #791

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants