it's already happening across many industries (except for those plagued by government-imposed barriers such as healthcare). As Milton Friedman once said, "If you put the federal government in charge of the Sahara Desert, in 5 years there'd be a shortage of sand."
But you're right in that saying "removing all" is way too idealistic a goal, so perhaps we can settle on attempting to weed out and "minimize the unnecessary middle-men".