on the side
In addition to the main portion of something; also, in addition to one's regular job. For example, He ordered some French fries on the side, or She often prepared tax returns on the side. [Second half of 1800s]
See on someone's side; on the side of the angels.