Visa refused as passport was not refused

hello ,

I had an approved work visa and I had to send the passport for stamping.Due to change of plans , I did not send the passport and my lawyers had opened a request to withdraw the application. few weeks back I recieved a refusal letter stating my visa was refused because I did not submit my passport. Does anyone have any experience with this?All inputs appreciated