If you are leaving, then why don't you submit your visa application once you are in Bangladesh?
Or else, get the visa before you leave.
I have no idea if it's possible to start the application here and get the visa in a different country. I imagine it will delay the process at the very least.