Channel owners can choose, at anytime, to ban users that don't follow the rules, or that they just don't like. This is their right as the channel owners.