Refugee changes will make lives ‘more difficult’, warns Garneau