The impact agenda has been kind to me, but its obsession with science and growth are huge flaws. Time to get out, says Rupert Read