Can this be used to patch small chunks that came out from taking my old backsplash out?

Thank you for your question. We recommend using setting type joint compound such as Durabond or Easy Sand for deeper fills or areas where there is higher humidity. Hope this helps.