Former GOP Rep. Billy Long has been removed as IRS commissioner by President Trump, a White House official said Friday.