Oops, yeah, denise pointed me the the page you meant, and also confirmed that, indeed, it's a bit inefficient. Because there's no method for looking up the filters any given user is in, it looks at each of your filters' lists of users to see if the user you're adding/modifying is in any of them.