Dictionary.com
Thesaurus.com

heart in the right place, have one's

Idioms  
  1. Be well-intentioned, Her plan to reconcile them didn't succeed, but she had her heart in the right place. [Early 1800s]