As long as you have valid visa you should be able to travel. Work permit candidates just need few things as part of Covid restrictions which mentioned in the link I sent . This authorization letter you mentioned may be your company specific.
Im looking at Canada travel advisory website and I don’t see this information
https://travel.gc.ca/destinations/india
Could you please advise where are you referring? So I can keep myself educated