I was thinking about submitting one of my papers in arXiv or www.optimization-online.org and hence I was just wondering if mentioning the same in my CV would be appropriate. Is it done usually? If yes, how should I actually mention something like this in my CV? Kindly guide me (I have no previous experience in publishing papers and I'm an undergraduate student).
Putting non-peer reviewed publications on your CV is perfectly fine, but you should be aware that for research-oriented jobs and admission to academic programs you will be primarily judged by your peer reviewed publications. I have seen CVs that separately list peer-reviewed works and non-peer reviewed works, and sometimes the non-peer reviewed works are simply listed as "technical reports."
If you believe that the papers you write are worthy of being mentioned on your CV, then list them. But don't think that by putting a bunch of low-quality non-peer reviewed works will do you any favors when looking for work or when applying for academic positions (whether graduate school or employment). Obviously, you should avoid putting them on your CV if you are doing so simply to demonstrate that you can write a paper.
This only pertains to mathematics since that's the only field I can speak for, but there it's normal for people to list preprints on the arXiv in their publication list or CV making it clear that it is listed as a preprint. I think people understand perfectly well that there are long lead times one getting things published.
That said, I would say that you should think carefully and get advice from more experienced people in your field before submitting to a preprint archive. At least in the case of the arXiv, once something is posted, it can never be taken down.
Depends on your field. If in it arXiv is not popular, make a separate list named "Preprints".
If it is popular (i.e. people are expected to post on arXiv along with sending to the journal), then it is common to have a single list (where, naturally, papers from last months or a year are only on arXiv, other - both have the journal reference and arXiv ID). If older papers are peer-reviewed then it is somehow implied that the new ones are likely to get into journals/conferences as well.
However, if you have only arXiv preprints (e.g. as you are only starting your career) it is not implied that they will get accepted. Anyway, listing them is way better than listing nothing - just make a list of "Preprints".
In any case putting preprints may give you an edge - especially if your preprints are related to research they are interested in (for me, quite a few times, they were a starting point of a specialistic discussion).