Business Loan question – for a residentially secured loan, do I have to move my home loan over to new lender?

I’m looking to take out a business loan against some property equity I have. I was told by a lender that I had to re-finance my home loan and go with them if I was to take out a business loan with them.

Am I able to keep my home loan where it is? I don’t want to move it across because of the exit fees, legals, etc.
Info about Australian lenders

Quick House Sale