2005-07-15 18:56:33 +08:00
|
|
|
inotify
|
|
|
|
a powerful yet simple file change notification system
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Document started 15 Mar 2005 by Robert Love <rml@novell.com>
|
2015-02-11 06:08:30 +08:00
|
|
|
Document updated 4 Jan 2015 by Zhang Zhen <zhenzhang.zhang@huawei.com>
|
|
|
|
--Deleted obsoleted interface, just refer to manpages for user interface.
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
|
2015-02-11 06:08:30 +08:00
|
|
|
(i) Rationale
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
|
|
|
|
Q: What is the design decision behind not tying the watch to the open fd of
|
|
|
|
the watched object?
|
|
|
|
|
|
|
|
A: Watches are associated with an open inotify device, not an open file.
|
|
|
|
This solves the primary problem with dnotify: keeping the file open pins
|
|
|
|
the file and thus, worse, pins the mount. Dnotify is therefore infeasible
|
|
|
|
for use on a desktop system with removable media as the media cannot be
|
2005-07-15 18:56:33 +08:00
|
|
|
unmounted. Watching a file should not require that it be open.
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
|
2005-07-15 18:56:33 +08:00
|
|
|
Q: What is the design decision behind using an-fd-per-instance as opposed to
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
an fd-per-watch?
|
|
|
|
|
|
|
|
A: An fd-per-watch quickly consumes more file descriptors than are allowed,
|
|
|
|
more fd's than are feasible to manage, and more fd's than are optimally
|
|
|
|
select()-able. Yes, root can bump the per-process fd limit and yes, users
|
|
|
|
can use epoll, but requiring both is a silly and extraneous requirement.
|
|
|
|
A watch consumes less memory than an open file, separating the number
|
|
|
|
spaces is thus sensible. The current design is what user-space developers
|
2005-07-15 18:56:33 +08:00
|
|
|
want: Users initialize inotify, once, and add n watches, requiring but one
|
|
|
|
fd and no twiddling with fd limits. Initializing an inotify instance two
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
thousand times is silly. If we can implement user-space's preferences
|
|
|
|
cleanly--and we can, the idr layer makes stuff like this trivial--then we
|
|
|
|
should.
|
|
|
|
|
|
|
|
There are other good arguments. With a single fd, there is a single
|
|
|
|
item to block on, which is mapped to a single queue of events. The single
|
|
|
|
fd returns all watch events and also any potential out-of-band data. If
|
|
|
|
every fd was a separate watch,
|
|
|
|
|
|
|
|
- There would be no way to get event ordering. Events on file foo and
|
|
|
|
file bar would pop poll() on both fd's, but there would be no way to tell
|
|
|
|
which happened first. A single queue trivially gives you ordering. Such
|
|
|
|
ordering is crucial to existing applications such as Beagle. Imagine
|
|
|
|
"mv a b ; mv b a" events without ordering.
|
|
|
|
|
|
|
|
- We'd have to maintain n fd's and n internal queues with state,
|
|
|
|
versus just one. It is a lot messier in the kernel. A single, linear
|
|
|
|
queue is the data structure that makes sense.
|
|
|
|
|
|
|
|
- User-space developers prefer the current API. The Beagle guys, for
|
|
|
|
example, love it. Trust me, I asked. It is not a surprise: Who'd want
|
|
|
|
to manage and block on 1000 fd's via select?
|
|
|
|
|
|
|
|
- No way to get out of band data.
|
|
|
|
|
|
|
|
- 1024 is still too low. ;-)
|
|
|
|
|
|
|
|
When you talk about designing a file change notification system that
|
|
|
|
scales to 1000s of directories, juggling 1000s of fd's just does not seem
|
|
|
|
the right interface. It is too heavy.
|
|
|
|
|
2005-07-15 18:56:33 +08:00
|
|
|
Additionally, it _is_ possible to more than one instance and
|
|
|
|
juggle more than one queue and thus more than one associated fd. There
|
|
|
|
need not be a one-fd-per-process mapping; it is one-fd-per-queue and a
|
|
|
|
process can easily want more than one queue.
|
|
|
|
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
Q: Why the system call approach?
|
|
|
|
|
|
|
|
A: The poor user-space interface is the second biggest problem with dnotify.
|
|
|
|
Signals are a terrible, terrible interface for file notification. Or for
|
|
|
|
anything, for that matter. The ideal solution, from all perspectives, is a
|
|
|
|
file descriptor-based one that allows basic file I/O and poll/select.
|
|
|
|
Obtaining the fd and managing the watches could have been done either via a
|
|
|
|
device file or a family of new system calls. We decided to implement a
|
2006-06-02 04:11:07 +08:00
|
|
|
family of system calls because that is the preferred approach for new kernel
|
2005-07-15 18:56:33 +08:00
|
|
|
interfaces. The only real difference was whether we wanted to use open(2)
|
|
|
|
and ioctl(2) or a couple of new system calls. System calls beat ioctls.
|
[PATCH] inotify
inotify is intended to correct the deficiencies of dnotify, particularly
its inability to scale and its terrible user interface:
* dnotify requires the opening of one fd per each directory
that you intend to watch. This quickly results in too many
open files and pins removable media, preventing unmount.
* dnotify is directory-based. You only learn about changes to
directories. Sure, a change to a file in a directory affects
the directory, but you are then forced to keep a cache of
stat structures.
* dnotify's interface to user-space is awful. Signals?
inotify provides a more usable, simple, powerful solution to file change
notification:
* inotify's interface is a system call that returns a fd, not SIGIO.
You get a single fd, which is select()-able.
* inotify has an event that says "the filesystem that the item
you were watching is on was unmounted."
* inotify can watch directories or files.
Inotify is currently used by Beagle (a desktop search infrastructure),
Gamin (a FAM replacement), and other projects.
See Documentation/filesystems/inotify.txt.
Signed-off-by: Robert Love <rml@novell.com>
Cc: John McCutchan <ttb@tentacle.dhs.org>
Cc: Christoph Hellwig <hch@lst.de>
Signed-off-by: Andrew Morton <akpm@osdl.org>
Signed-off-by: Linus Torvalds <torvalds@osdl.org>
2005-07-13 05:06:03 +08:00
|
|
|
|