unix – Wisdombox

Monitoring a Filesystem – Part 3

Monitoring a filesystem, as it turns out, is not that simple afterall. Given the plethora of considerations, like infinite data volume, less performance overhead, fast, light-weight etc. that we have already seen in the preceding posts of this series. By this time it was very clear that scanning through directories at regular intervals would not scale whenContinueContinue reading “Monitoring a Filesystem – Part 3”

Monitoring a Filesystem – Part 2

So, in my previous post of this series, I shared my experience where we were continuously polling the filesystem for any updates. We have also seen what were the disadvantages of such systems. We started exploring other tools, that were similar in nature and were thus, discarded. One such option that we tried was the ApacheContinueContinue reading “Monitoring a Filesystem – Part 2”

Monitoring a Filesystem – Part 1

So, one fine day at work, I got bumped into this simple task of detecting any changes on a specific folder on the filesystem, and sync any new/modified files to an S3 bucket in AWS. In common terms, a file watcher. Not a big deal at all… Here was my approach.I wrote a simple shellContinueContinue reading “Monitoring a Filesystem – Part 1”