I tell you for sure , and please trust me. I was doing a more bad mistake to say like this, than you and even that, he back to me !
So, first of all, you keep text him lovely messages like " I miss you my sweet love " etc.. Libra men are irresitible to this kind of words and they love them, they always need love. If he reply to you not lovely and just normal, it means he may feel likes you too much . After a Libra feel this , their intention is to be selfish and cold or to disappear ! They are afraid if they feel there things got to fast for them . They have your heart and they don't know what to do with it ! So , they need TIME ! Time to think how to do ! In this time, you keep contact with him in lovely way ! He will back to you soon as he was before , I can tell you sure this.
If he would not likes you, he would not reply anymore or he would tell you something directly.
About sex, no, you was not wrong ! Do not blame yourself for this because Libra man have the intention to have sex even from first date ! And they appreciate if you offer to them what they like. So, not this is the problem for sure. Libra men are crazy about sex and damn good also in sex.
Do not ask him questions as : what are you doing now ? why not reply to me ? why that, why that ??.... If you ask this, they will feel pressed and they will disappear without a word ! They no like jealousy ! Never show him that you are jealous .Tell him you can offer to him the freedoom he likes , tell him that he can see his friends also, never press him . If you make him feel you offer to him the freedoom , he will keep you forever for himself !
Try and you will see evcerything will be ok. I was in your situation the same and now I am with him and he loves me more than before !
Good luck !