Simply put, the Sugar Act only affected New England Merchants on one good.
The stamp act however was a broad internal(direct) tax on virtually every colonist on purchases a typical colonist would make often...newspapers, pamphlets, insurance policies etc.
The stamp act was a barrage of taxes on the people who were trying to engage in transactions that involved an unavoidable bureacracy and struck near to feelings of property rights(an important colonial value)