Hakeem al-Umma Hadhrat Mawlana Ashraf ‘Ali Thanawi (may Allah have mercy on him) said,

“Pious elders have stated that as doing some thing (primarily) to please others is ostentation (riya), similarly abandoning an action for same reasons is also ostentation.”

Tarbiyet us Salik, volume 1, page 349

Allah save us from it! Ameen.