Pressure grows to scrap refugee loan repayments