Ok I did some further research into this.Losing points would mean that you no longer meet the minimum requirements.
Def with work permit, lmia and a new job offer letter will help as you would still meet the requirement of that program and the draw that occurred when you received ITA
https://www.canada.ca/en/immigration-refugees-citizenship/corporate/mandate/policies-operational-instructions-agreements/ministerial-instructions/express-entry-application-management-system/current.html
Section "Eligibility criteria"
it looks like
"In order to be eligible to be issued an invitation, a foreign national must, if the expression of interest were to be considered an application for a permanent resident visa as a member of one of the classes referred to in paragraphs 2(a) to (c), be able to meet the requirements to be a member of that class as well as the selection criteria and other requirements for receiving a permanent resident visa as a member of that class."
Still not concrete, but what are you thoughts on this?
2(a) to (c) is FSW/CEC/FST.
My understanding from this is that eligibility criteria means the barebones basic requirements of any of those programs, not seeing where the impact of points changing would come in.