Understanding the 11 benefits of practicing Metta along with mindfulness of the loveability of the difficult person and all beings can lead to happiness and freedom of the mind from annoyance.
Continuing practicing to bring up someone who inspires us genuine uninterested love, so we can move on to wish metta for ourselves for the benefit of transforming our hearts