163

A colleague and I recently submitted a paper to a journal with an impressive-sounding name, the "International Journal of Artificial Intelligence and Computational Research". According to their website,

IJAICR is a referred [sic] journal in the field of computer science, artificial intelligence and soft computing methods.

It was accepted two days after we submitted it. That's too fast. We were suspicious. Although the journal said that all papers are peer-reviewed, we could not see how that was done in two days. Plus, we received no comments from the reviewers. Also, the submission guidelines didn't ask for a "blind" copy (without our names or any references to who we were).

But wait, there's more.

The acceptance letter asked us to send them US$300 to publish it. We did not. We've withdrawn our submission and will submit a new version of the paper to a more reputable journal in the coming months.

How might we make a better choice of respectable journals before we submit next time?

Improve this question
7
  • 58
    I think this question is really about how to recognize "vanity press". Judging quality among respectable journals is a completely different question.
    – David Ketcheson
    Commented Feb 15, 2012 at 17:06
  • 8
    It can be difficult especially if the journal's call for papers is circulated by your faculty secretary. This happenned to me and I only found out after I had been asked to pay a publication fee of $200. The review was also suspicously glowing and took only two weeks. The paper was accepted without modification. Very suspicious but very deflating after the intial excitement.
    – user8184
    Commented Aug 14, 2013 at 15:50
  • 2
    The link you have provided in your question does not work.
    – enthu
    Commented Jul 26, 2014 at 11:00
  • 4
    Being asked to pay for publication is not the best indicator of a bad journal, there are just as many open-source journals that are questionable in their conduct and quality. The overall quality of the articles and the 'street cred' of people that publish in that journal should be the measure of its credibility. So you should probably at least dig a little bit deeper before coming to this conclusion (although in this case your assumption is likely to be correct).
    – Michael Lai
    Commented May 19, 2016 at 23:16
  • 3
    The link in the question now points to a website that sells sex toys in India
    – robertspierre
    Commented Sep 5, 2021 at 22:11

20 Answers 20

Reset to default
144

The way I usually choose journals is by looking at where people I trust/follow publish, and where previous work was published. It is usually not too hard to compare the quality your work to the quality of the work you are citing, and chose a target based on that. Unless your field is highly mutli-disciplinary, you will see the same journals/conferences popping up again and again in your references; submit to one of those.

Before submitting, however, it is always important to look at a few articles from previous issues. This will give you a second gauge of quality for the journal and also let you pick up on any formatting and presentations quirks that might be present in the publication.

Improve this answer
4
  • 125
    Shorter version: Submit papers to the journals you cite most often. Don't submit papers to journals you never cite.
    – JeffE
    Commented Feb 17, 2012 at 12:21
  • @JeffE Doesn't that just push the question back to "which papers should you cite?"
    – user23776
    Commented Apr 10, 2018 at 16:06
  • 1
    Doesn't this create a feedback loop, if everyone just does what everyone does? Won't this at least occasionally inflate bad journals that overshadow good ones? Let's suppose one of the people you trust and imitate answers this question; what do they do?
    – user23776
    Commented Apr 10, 2018 at 16:09
  • 8
    @fredsbend Doesn't that just push the question back to "which papers should you cite?" — No, of course not! Whether or not to cite a paper has absolutely nothing to do with where that paper is published. — what do they do? — They read a lot of papers and chase a lot of references (both forward and backward).
    – JeffE
    Commented Apr 10, 2018 at 22:34
111

You may want to check that the publisher is not on Beall's List of Predatory, Open-Access Publishers.

Surprisingly, the publisher in question is not. I've found Beall's list to be fairly comprehensive, but the vanity press industry seems to be booming.

Caveat: that list is just one guy's opinion. But it resonates with my own experience.

Update: As of late January 2017, Beall's list has been taken down.

Improve this answer
3
  • 5
    A very good and useful link!
    – JRN
    Commented Feb 15, 2012 at 23:19
  • 4
    Beall's list does more good than bad, but it is based on subjective intuition, not data or transparent criteria. It lists Frontiers, and I know of many reputable academic editors and reviewers who provide high-quality reviews for their journals. The controversy [nature.com/news/…. A better procedure: check if it's on Beal's list, if listed, check if it is on the open access whitelist [nature.com/news/open-access-website-gets-tough-1.15674]. If on both further investigation may be needed.
    – WetlabStudent
    Commented Nov 1, 2016 at 16:40
  • 1
    "As of late January 2017, Beall's list has been taken down." If it's not yet available again, over a year later, you should delete this answer. And if it is back, let's suppose Beall answers this question; what do they do?
    – user23776
    Commented Apr 10, 2018 at 16:15
44

The best way is by word-of-mouth: ask around the department, ask your PhD advisor, ask people you've worked with.

If it is a specialist journal, and you are a specialist, then the next best way is to look at the previously published issues of the journal and see what kinds of articles they accept.

Failing that, the Australian Government's Research Council puts out a ranking of journals and conferences every now and then. It is not perfect, but should give a rough idea of where a journal places in the eyes of the bureaucrats :-). Note that "new" journals (journals that have not been active for more than X years) are not ranked, so omission from the list does not necessarily mean that the journal itself is not worthwhile.

Improve this answer
2
  • 1
    Notice that it has been announced that the Australian ranking will ne replaced by a score indicating "journal quality profile"
    – Sylvain Peyronnet
    Commented Feb 15, 2012 at 14:47
  • 2
    you can also recur to journal's impact factor from ISI Web of Science
    – Open the way
    Commented Feb 26, 2012 at 8:20
43

"How do you judge the quality of a journal?"

One answer is already known to you: Submit a paper to it and see how it responds. I once submitted a few papers to an online journal (no print equivalent) and the referee reports that I got clearly showed that they read and understood the paper and that they knew the subject well. They even suggested ways how the paper could be improved. The quality of the referees reflect the quality of the journal.

Improve this answer
6
  • 8
    IMHO, this is the best answer here, even though you don't really have time to go through the process of testing every journal you might be interested of. However, if the peer-review process is good, then the journal is good. End of story.
    – Speldosa
    Commented Jun 24, 2012 at 9:21
  • 18
    I disagree with @Speldosa. All you know on the basis of one submission is that the journal has at least one editor who picked good referees for at least one paper. Another half of editors could be accepting junk for all you know. Multiple submissions increase the odds that your conclusion is correct, but is not this an extremely expensive experiment to undertake, given that you are paying with your research output? Especially when you have a lot of observational data already available: other papers published in the journal.
    – LVK
    Commented Aug 14, 2012 at 21:35
  • @LVK That's a fair point.
    – Speldosa
    Commented Aug 19, 2012 at 8:46
  • Somehow, @LVK's reasoning (though correct), reminds me of the old black sheep joke about generalizing from a small amount of data. :)
    – 299792458
    Commented Jul 5, 2015 at 4:13
  • 1
    This is like if you want to find out if that is a poison, test it out!
    – Alireza
    Commented Sep 4, 2017 at 9:17
23

For some hard data I like eigenfactor, because I think there methodology makes a lot of sense. The default settings are a bit odd, you want the AI score not EF score. I also like the "eigenfactor category" under advanced search better than the "ISI category" that you can get on the main page. Certainly it's better to have a more in-depth understanding, but also sometimes you just want a quick ballpark guesstimate of how good the journal is, and eigenfactor does that.

Improve this answer
21

I'm surprised nobody mentioned this yet, so I'm adding it as a separate answer:

Read some articles from the journal (in your subfield), and see how they feel like

When you look at a journal and check that the 5 or 6 latest articles in your domain are of the meh type, you probably don't want to publish there. If they make you feel “oh, I never quite thought of that, it's clever… I see how I may use it”, go for it!

Improve this answer
19

I think that "quality" is a bit overrated, and that you should think most deeply about "fit" (i.e., how well your content matches the interests of a journal's reviewers and readership). With that said, when I'm looking for the best journal to put an article, I have three methods:

  1. Look at my cites for similar work to my manuscript, then look at where they published (similar to Artem's comment). If your paper isn't citing related work, well... it probably has a pretty terrible lit review. If you're citing sources out of your league for that paper (i.e., Science, Nature), find the publication list for that lab to find their fallback journals.

  2. Ask greybeards I collaborate with where they would publish such a paper. Good senior academics have a huge amount of expertise about the social networks and publishing networks in their fields.

  3. Use journal rankings. I find Scimago to be the most convenient. That also charts things like cites/paper over time, so you can see if a newer journal is growing or stagnant. The Austrialian Research Counsel (mentioned by Willy Wong) is probably my #2 resource. Thompson's ISI stuff is also useful, but I've found it sometimes has glaring omissions and has been less convenient to me (annoying to log in). Conferences are harder to rank using indices. Google and Microsoft have ranking systems that catch those pretty well, at least for comparing citations within a topic. However, given the choice, I'd still go with option #1 or #2. I mainly use this approach for interdisciplinary research that doesn't have an obvious, natural target journal.

Improve this answer
16

First of all, I look at the publisher. If you don' find a lot of references to the publisher on the web, it is suspicious.

Then, I look at the editor in chief, and at the board of editors. If you don't find many big names here, this is again very suspicious.

Finally, google the journal name and look who is publishing in the journal. Most of the time it becomes clear if the journal is serious or not.

Improve this answer
1
  • Highly specialized journals may not get mentioned a great deal on the open web, and googling is a very crude and time-consuming way to answer this question. This has the same issue as justin's answer in that predatory publishers lie. You're better off working from good authors (the ones you read and cite) to discover unknown journals than starting from an unknown journal and trying to then assess the quality of their authors.
    – sondra.kinsey
    Commented Oct 17, 2017 at 13:46
16

"How do you judge the quality of a journal?"

Look at the editorial / advisory board. They've gotta be from the top schools or they've gotta be top researchers.

Improve this answer
2
  • 17
    I agree. However, please note that some journals include well-regarded people on their editorial boards without their permission. See, for example, people.cs.uchicago.edu/~razborov
    – JRN
    Commented Apr 7, 2012 at 5:21
  • 7
    Just in case the contents of the website I linked to earlier changes, let me note that it involves the inclusion of Alexander Razborov's name on the editorial board of the South Asian Journal of Mathematics without his knowledge or permission.
    – JRN
    Commented Apr 7, 2012 at 5:23
14

You can test them yourself. This procedure will speed up by your experience. There are signs during submission and during review which shows which journal is really good and which is not. But there is another way too: look at the objective information below. It is possible to judge a journal based on the COLLECTIVE information you obtain from these factors:

  1. Their editorial. You don't know them? Ok pass to the next ones.
  2. Their publishing country (India? no thanks unless the paper is not good or the journal is an exception).
  3. Their publisher (yes good publishers usually select good journals, although some weak journals with a lot of money can again hire a good publisher)
  4. The time passes since you submit and they respond
  5. The above factor SHOULD be considered along with the amount of manuscript they receive. Good journals receive thousands of manuscript a year, but still do not waste authors' time by keeping them waiting for too long before a rejection decision. Bad journals receive sporadic manuscripts and keep the authors wait for months until they tell the author their decision. It is a pain when you see some of them have "lost" you paper, or some of them reject your paper with a couple of lines of comment, after 6 months. Good journals do the same in less than 24 hours.
  6. Indexing databases. Look where the journal is indexed in. ISI Web of Science? Medline? or what? The scam journals usually are not indexed in any accredited databases (not Google Scholar or Scopus). If a journal is accepted to be indexed in ISI or to a lesser degree, Medline, it is unlikely to be able to have low quality. Otherwise, ISI would have booted them out.

There are other factors too. But these will give you 90% insight already.

Improve this answer
1
  • 2
    The indexing. I would've thought that would be the top answer actually.
    – Joris Meys
    Commented Jun 14, 2017 at 16:12
13

Ask your institution's scientific librarian.

It's part of their job to know about journal reputation and quality.

Improve this answer
12

Look at the journals responsible for the references you cite in your own manuscript. Upside, these are the journals publishing relevant and credible work in your area. Downside, there are plenty perfectly good journals that are newer, or less specialized, and so might be missed.

BTW, a very fast review time with no reviews is suspicious. But charging an article processing charge (APC) is not, in itself, a reason for worry. That said, do look to see that you are getting the full open access you pay for if there is an APC (i.e. no transfer of copyright to the publisher and the article is released under a CC-BY license). You can search for copyright policies by journal or publisher here: http://www.sherpa.ac.uk/romeo/

Improve this answer
9

The Journal Ranking site (www.journal-ranking.com) aims to rank many (11K) journals, according to their measure of impact (mainly number of citation, but weighted according to the ranking of the citing journal), number of articles, etc. It also let you sort by field.

But again, this is only their point of view, and their way of measuring quality.

(and it only ranks journals listed in the ISI's SCI)

Improve this answer
2
  • 2
    The latest “breaking news” from that site is dated 20 May 2008 ;-)
    – F'x
    Commented Nov 12, 2012 at 10:04
  • yet, their data is updated to 2010.. Not that bad.
    – Ran G.
    Commented Nov 12, 2012 at 18:36
8

Generally, the scientific specialists' communities have traditionally identified journals having high editorial standards. That is the key: who are the editors and what are the standards. Are the breakthrough discoveries sent to that journal? From that, reputations are built and filtered down to preference and use by the community.

Improve this answer
6

You can search for conferences/journals on Google scholar: https://scholar.google.com/citations?view_op=top_venues&hl=en

Search by the full name (not the abbreviation), and you'll see its h5-index, which is the h-index in the last 5 years. Although it is hard to judge a conference using its h-index, you can at least compare them to one another.

There is also a list on the left from which you can get the conferences/journals with highest h5-index.

Improve this answer
5

The Impact Factor is usually a good independent means of establishing a journal's quality. Essentially it is the average number of citations of its articles. The higher, the better. The logic is that good quality articles are cited more, so a journal that only lets in better quality articles will have a higher impact factor than one which lets in practically anything.

The quality of the journal you submit to will reflect on the quality of your paper, so you should try to submit to the better ranked journals within your field. You should be able to readily establish a short-list of suitable journals just by listing the journals of the papers you cite.

There are a few things to be aware of when comparing the impact factors of journals:

  • Impact factors also reflect the size of a field, so you cannot use it to compare the quality of journals from two separate and unrelated fields. A group of papers in a large popular field are naturally going to get cited more than those from a very small field.
  • Almost all journals have impact factors, unless they have been excluded as a result of being in some way nefarious (such as predatory journals), or if they are newly established and therefore haven't been around long enough to get one.

I could not find an impact factor for the journal you mentioned, even though it seems to have been around for at least 5 years. You are right to be cautious of it. I would not recommend submitting to a journal which does not have an impact factor, even if the reason for this turns out to be quite innocent.

Improve this answer
3

To make a better choice for submitting I would google and use Wikidata.

Googling might lead you to lists like Jeffrey Beall's https://scholarlyoa.com/individual-journals/ and provide you with context about the journal, such as editorial board, blog posts, etc.

Wikidata will provide you with pointers to indexing services and journal rankings. Consider Journal of Machine Learning Research at https://www.wikidata.org/wiki/Q1660383 . It indicates a BFI level of 2 which is the high category of the Danish journal ranking system. It shows that Scopus is indexing the journal. (Strangely the Australian ERA link does not seem to work). I do not find "International Journal of Artificial Intelligence and Computational Research" in Wikidata, which should call for suspicion

Improve this answer
3

You could use a combination of some simple rules and common sense. Among the simple rules once could list:

  • Presence in major databases, e.g. Web of Science, PubMed, etc
  • Does anyone in your field cite papers in this journal?
  • The quality of other papers in this journal
  • Do your colleagues publish in this journal?
  • Do they have typos in their webpage?

And common sense could help in a variety of ways. For example, today, I got the following letter, a rather nice one, seems like someone would have written it specially to me:

I hope this email finds you well. I wanted to get in touch with you about a paper you authored entitled "Using principal component scores reduces the effect of socially desirable responding". Firstly, thank you for taking the time to publish this, it was an interesting read. Have you continued working in this area? If you have any other articles or ongoing research I would love to know more.

I am hoping to discuss with you having a short follow-up article or perhaps a review article published in one of the next issues of the journal I serve as an editor for, the Medical Research Archives. I think our readers would be interested in a paper with information from any continued research or new data since this was published. It would be especially helpful if the article could be written for more of a general medicine audience so that many sub specialties could gain from it. The article would not have to be long, and any of your co-authors or colleagues would be welcome to contribute to it. I am happy to assist in any way I can, and there is no hard deadline.

Ok. First of all, they refer to a paper on psychometrics and ask me to publish something on the same topic in "Medical Research Archives". Makes no sense. Second, they tell me "thank you for taking time to publish this" (gracias de nada! this is my job!) and "it was interesting to read" (how on earth would you know - having not read it? and what is the point of calling it "interesting" if you have nothing specific to say about it?). At this point, it it quite clear that they have a script sending these letters, using a database with e-mails and titles of research papers. It is not written the way an actual editor of a bona fide journal would write, so I just delete the e-mail. (It was better written than most such e-mails, that is the reason why I even checked their webpage, - not that I would for a second consider sending a paper to their journal - but just for curiosity about the new tricks of predatory publishers.)

Improve this answer
1

Quality of the journal is reflected in your own experience.

When you've reached the level when you start thinking about publishing in your field of expertise,

and you find out about a journal you've never heard before through several years of undergraduate and postgraduate studies,

it is a good enough reason to be suspicious and cautious.

Improve this answer
1

Many good answers are provided here. Along with the editorial board, publisher, and impact factor, one should check http://www.scimagojr.com/. This site provides ranking for journals, and country. The ranking of journals based on Q1 through Q4 in the specified subjects ensures of the quality of journals in that issue. Q1 journals are the best in that subject and Q2, Q3, and Q4 are decreasing impact of the journals.

Improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .