NEW YORK (Reuters) - Advent Software Inc, an accounting software company, is exploring a sale and has hired Frank Quattrone's investment bank Qatalyst Partners to lead the effort, several people familiar with the matter said on Tuesday.