They might show up on the address your provided on the ArriveCan app - but it is unlikely because they usually just call to see if everything is ok. You are not 'tracked' via the ArriveCan app since it doesn't use the GPS in your phone, they rely on the address provided to know where you are.