The former deputy prime minister says changing visa rules for migrants already living in the UK would be "un-British".