Does your POA or Healthcare Power of Attorney contain a HIPAA authorization for your agent?
At Danyi Law, we put this language in our estate planning documents so your agent won't run into any roadblocks.
You can also put a HIPAA authorization in a regular power of attorney document to help your agent to help you when you are in need.