heart in the right place, have one's

1. Be well-intentioned, Her plan to reconcile them didn't succeed, but she had her heart in the right place. [Early 1800s]