Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

should there be something to suppress posts when files are created... #112

Open
petersilva opened this issue May 14, 2023 · 0 comments
Open
Labels
enhancement New feature or request wishlist not a priority, but a long term wish... work-around available the report includes a means of avoiding the problem. worries needs work to clarify status

Comments

@petersilva
Copy link
Contributor

on systems that are more heavily loaded, or running slower, there seems to be a tendency for INOTIFY
to produce CREAT events for the file being created, and then separate modify events...

possibilities:

  • we are periodically processing and event queue. should we read the queue once, looking for duplicates, and remove the first op?
  • there is already a flag for create events, perhaps just set that off in flow tests, and perhaps elsewhere. problem is... what if someone actually is creating an empty file? then it just will not be propagated.

It would be an enhancement if we can reduce the number of posts needed to duplicate the same tree by omitting CREAT events that are overridden by modifies...

We could go further in the batching... say for empty files, hold onto them for a few seconds in a queue, and only create them if no other event comes later to squash them...

not sure. currently this is taken care of by putting plugins in shovels/winnows, so no effect on HPC mirror client, but it complicates deployment a bit.

@petersilva petersilva added enhancement New feature or request worries needs work to clarify status work-around available the report includes a means of avoiding the problem. wishlist not a priority, but a long term wish... labels May 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request wishlist not a priority, but a long term wish... work-around available the report includes a means of avoiding the problem. worries needs work to clarify status
Projects
None yet
Development

No branches or pull requests

1 participant