The former Acting Minister-in-charge of Muslim Affairs said there was no physical relationship, but acknowledged that he had failed to “establish clearer boundaries”.