Leave it or take it? Thank you!?

I met him last Oct and it seems that we started very well. I put him on pedestal and show him my fidelity. though we have disputes every now and then and we fought and cried almost every weekend. he told me that he will never look for someone else. but he was doing it behind my back. I was blindfolded by his honeyed words to always believe what he was doing until i smelt a rat when i called him the line was always busy but when I asked him who he is talking to he always lied. One day after three months I checked his phone records and found that he has a sturdy relationship with another guy which gave me a shock and i want to revenge. He treated me like rubbish he went out with that guy,blocked my calls, screened my #. he made love with him the first night they met. he texted him very very long messeges to show his love to him.He even let him unon and touch his private part in a public place(he is kind timid when he is open to the public) . He bought him very expensive things. Now he realised that guy is only a kind of parasite he just needs his money but will never gave him true love. Now he confessed everything and wanted me back. What am i suppose to do. Leave him or ask him back. I still love him but i really cannot bear all these betrayals and infidelity. Anyone here can help me? thank you so much.