It seems that we can't ignore premium members, even if they aren't currently and never have been a moderator. This sucks because the ignore list is one of the things we're paying for and if we can only ignore non-moderating non-premium members, it's hardly worth it.