Because the GB potential is anisotropic, differences should be expected
for ordered phases (or transition to these phases) depending on whether
aniso or xyz is used. Although I cannot comment with help for your
specific simulation, there are many published papers describing phase
diagrams for liquid crystal simulations that you can use as guidance for
your simulation parameters. - Mike