lead a double life

1. Live as if one were two persons, usually one good and one bad. For example, They learned that his frequent travels were actually fictitious, and he was leading a double life, with a second home on the other side of town. This phrase is frequently used for a married person who establishes a second household with a lover. [Late 1800s] Also see Jekyll and Hyde.