Lover buffs, questing together, acquiring fame and being on the same map/in a party frequently and every day helps raise the relationship. The relationship lowers the longer you're apart, inactive, etc.
We did notice the relationship seems to fall rather quickly and this has already been reported for further testing. So if anyone tests this further and notices anything else in regards to the marriage relationship status, please go ahead and reply to this thread - we will be reading it.