Ask yourself this.
Do you believe in Unicorns?
Do you believe in Fairies?
Do you believe in Trolls?
Do you believe in Thor?
Do you believe in Zeus?
Do you believe there is a Tea Cup in orbit around Saturn?
Do you believe in God?
These are all things that we cannot disprove the existence of, however the inability to disprove their existence does not provide any reason to believe that they exist.
That's one of the most boring and immature "arguments" over this [cabbage] there is. A real theologian debate would consider this the work of a child. Every 16 year old that wants to feel rebellious asks these questions. And none of them question anything. One could easily ask if you believe in history. Did you experience it all yourself? No, you're basing your ideas on what others have written and told you.
A good book on this matter that I'm reading now, nay, a fantastic book: The Thinker's Guide to God.
Essentially, one large essay compiling the thoughts of the greatest thinkers of the West on God, who has generally remained the same basic idea for two millenia - although, as with the Reformation, the idea of God was split. St. Thomas Aquinas was very responsible for that, as he turned Catholic ideas about God into what they are now (well, technically what the Church condones as the Catholic idea. Everyone has their own ideas) - the beliefs of Aristotle as the Philosopher's God, existing outside of the universe wholly simply (not the definition we use now) and as 100% Good (yet again, different than typical denotation).
That book has two good metaphors. One involves goldfish in a pond in a yard. Most swim around happily in their pond. One is a philosophical goldfish. He bemuses over what lies outside the pond, but cannot comprehend it because his mind is not built to understand anything but the pond. Human logic is built out of space and time. Quantum mechanics, which many believe to be the plans that have built the universe, are not built in space/time. Neither is religion.
Another regarding this childish hatred of religion by people who just wish to feel superior, also regarding the language of religion which, out of necessity, contradicts itself: Your friend gets up at 4 am every morning to go fishing. You ask him why. He says he enjoys fishing. You don't love fishing, not enough to dedicate so much time to it, but you understand and respect his love of fishing. One time, curious, you ask him just what appeals to him so much about fishing - what makes it so great. He ponders awhile, until he replies: "Fishing is fishing." This statement makes absolutely no damn sense, and yet you can probably understand what he means.
Study up, guys.