J. Robert Latham, Libertarian