Can't send email when replying to ticket

Can't send email when replying to ticket

I have email fetching set up, and it grabs the emails. 
If I make a ticket internally then I can reply but if the email comes from the outside of our organization, it will create a ticket and when I go to reply to the ticket by clicking reply, and putting in the customers email into the "to" field it says the notification send failed . 
 what do i need to do to get the email sending fixed 
Thank You 
                New to ADManager Plus?

                  New to ADSelfService Plus?