I think my favorite dungeon, when it comes to appearance, is Ulta Hall. It's really difficult for me to explain (probably because it's got a rather atypical design, you don't see a beach in a cave every day), but I find it very beautiful.
For actual gameplay though, I really like Federal Armory Trial. I've only gotten to play in it once, but that one time was actually pretty fun, especially the last boss.