consulting with a client who is also a friend

question: i have a close friend who is also a client. he went through a rough time with his wife threatening a divorce and we spent a lot of time talking about it (out of office settings).  i sent him a bill and he returned it with a notation that “we spoke as friends and not as a professional consultation, and the bill should be cancelled.”  what should i do?