Someone close to me was in a similar situation. He chose to keep the formal advisor but work informally with another person in his department. This might be an option for you to consider. (In addition to the obvious option already described, of switching advisors.)
Start with getting to know the people in your department. Try to talk to people about their work, about your interests. (Save the complaining for a later stage in the relationship.)
If you don't strike gold in your department, read an article that you are interested in, contact the author, strike up a conversation -- it might lead to a collaboration!
In short, pretend that you are a post-doc.
Edit to take comment into account ("Why I have chosen this one? He's the only true scientist in the whole University... Unfortunately"):
If I were in your shoes, I would be careful to arrange for a new advisor and a transfer institution before quitting. Thus, the advice in the comments ("walk, don't run") shouldn't be followed too literally. If there were someone good you could switch to in your own university, it would be different.
This is kind of like when you are in a bad job. It's usually best to find a different job before quitting the present job.
Note, if the university you are enrolled in is as bad as you say, then they may be rather lax in their requirements for graduation from the PhD program. Read some published theses in your field to find out.
Your strange advisor may sort of boot you out with a PhD after a certain period of time. That might leave you with a strange taste in your mouth. If that happens, no worries, just grab that piece of paper and run with it, to a two-year postdoc with someone who can give you plenty of guidance (almost as though you were his or her PhD student).