Dictionary.com
Thesaurus.com

have been riling

  • present perfect progressive
    of rile.
    rile
    verb (used with object)
    to irritate or vex.