You know who was against political parties of any kind: George Washington. And John Adams. And Thomas Jefferson (until he threw in the towel prior to his own Presidency).
The Constitution was carefully designed to balance interests and loyalties. There is no provision for the "extra layer of loyalties" afforded to political parties. Indeed, getting away from political parties was one of the driving forces for choosing a Republic-style of democracy over a Parliamentarian one.
Although it won't happen, what I'd like to see is the leadership of the Republicans and Democrats get together and agree to, at the stroke of midnight, simultaneously disavow their respective looney-toon fringe elements. Drive the nutcases out of both parties. This way, both parties would be equally disadvantaged by the votes they'd lose, and hence the balance of power maintained.
We've got to get back to normal political discourse between the Center-Right and Center-Left ... sane Republicans and sane Democrats respectively.