7

I am not sure about the incentive effects of websites such as ratemyprof.com, as Professors with tenure may or may not care about undergrad students. However, they may be more serious about graduate students (supervision, co-authorship etc).

Does a ratemyadvisor type website exist?

This is important (I think) because relationships between supervisor-supervisee are probably more profound (given the time investment) and have arguably more ramifications on the future (reference letters bear more weight).

Any thoughts are welcome!

  • 40
    There would be no anonymity; the number of advisees is sufficiently small in most cases that it would be obvious who the author of the review is. – ff524 Aug 31 '16 at 14:38
  • 15
    @ ChinG There is not really an ex post in academia, unless you leave it forever. – henning -- reinstate Monica Aug 31 '16 at 14:40
  • 14
    If you are applying for grad school, and will work with a professor, simply ask his/hers current graduate students what they think. – Per Alexandersson Aug 31 '16 at 14:42
  • 3
    It takes a lot of work, but have a look at the department site (if without former members also the Internet Archive) and find out what happened to the former PhDs. Some PhDs genuinely do not want to work in science anymore, but if it happens to (almost) all, it paints a pretty ugly picture for some department heads. – Daniel Wessel Aug 31 '16 at 15:18
  • 23
    Having seen RateMyProfessors, I think a RateMyAdvisor site would be a terrible way of achieving the intended aim. – Yemon Choi Sep 1 '16 at 12:59
12

I spoke recently with someone who is building such a website/community, and I doubt they will mind me giving a brief overview of how they intend it to work.

Basically there are 2 issues that are difficult to overcome - assuming all the technological issues are minor:

  1. Skepticism
  2. Slander

Skepticism in the sense of 'Oh, I see this PI has a bad review from 2001, but who's to say that will happen to me. Maybe this one student is an odd-ball'. It also has parallels with the TornadoGuard problem.

And we see this a lot on academia.stackexchange too. We only ever hear 1 side of the story, and that story is rarely impartial. You know, occasionally people like to rant. People often omit the times they made mistakes. It's human nature. And so any website of this nature has to somehow overcome this issue of he-said-she-said, and theres simply no technological device we can implement to get around this. Particularly if you allow anonymous submissions.

The second, slander, is what I believe most people in the pubpeer.com debate are worried about. A deliberate attempt to hurt someone's reputation under the flag of mob-justice. Nitpicking and emotive words, but no real substance, etc. I actually only found out about pubpeer a week or so ago when a colleague at a party showed it to me, and I was shocked to see people I respect being picked apart on there for silly little things. Still, those anonymous criticisms do have some validity, and the concept of post-publication peer review is something I deeply agree with. I think only time will tell what impact sites like pubpeer will have on science. For a PI-review site, it could have disastrous consequences. Potentially legal consequences.

The website/community I referred to up top seemed to have spent a considerable amount of time fleshing out all the technological methods that could help here, and in the end i'm told they settled on the fairly low-tech idea for Skype-based interviews, potentially on a weekly release schedule. The idea is to mainly cater for people who hate their PhD and feel relief knowing they're not the only ones going through hell. So these Skype interviews generally are with post-docs or no-docs who had a bad experience, and they talk about what the end result was, what they'd do differently, if they still feel they were treated unfairly many years down the line (I watched 3 interviews and they were all totally different, so i'm finding it difficult to generalise here). But the big issue for the team putting all this together is finding PhD/post-docs/no-docs who are OK with talking about their experiences. They offered to interview me but I turned them down because, frankly, i'm not that brave. They offered to pixilate my face, but even so... as disappointed as I am with my treatment during my PhD, there's no one specific person that really let me down. It was a system of failures, I think, and one that is unlikely to happen again. So that particular PI-review project wouldn't really help me or people like me.

  • 1
    Since the question's been bumped to the top: +1 for several considered points, in particular: "as disappointed as I am with my treatment during my PhD, there's no one specific person that really let me down. It was a system of failures, I think" – Yemon Choi Aug 25 '18 at 14:39
6

To add to the issues mentioned in Wetlab Walter's answer: one of the common reasons why advisors and student relationships break down is a mismatch between their personalities. It causes unrealistic and often unsatisfied mutual expectations.

Therefore one's perfect advisor can be another person's nightmare, and vice versa. Even a good track record with several past students does not reliably predict unqualified success with the next one - partially because typically the sample size is very small, but mostly, I think, because of the high degree of subjectivity about what a "good advisor" really means.

  • The only feasible situation of 'nightmare' vs 'perfect' match is when the advisor clearly pushes a protégée to the top while shoving other(s) off the lane. Which is clearly an unprofessional relationship which I am afraid might be more common than many believe. Otherwise, any reasonable advisor should feature as 'just OK' and 'so and so' to almost everyone outside of their perfect match. – Scientist Aug 20 '18 at 20:09
3

Such a website will never work. Most professors have fewer PhD students in their entire career than they have undergraduate students in a single semester. They will never accumulate enough reviews to be useful.

However, you can get the information. Simply email the professor's former students asking them for advice. Often a list of these students is on the professor's website. If it is not, ask the professor for the list.

  • In my experience ex-students typically remain fearful or dependent of abusive supervisors. Particularly in small towns and social circles, or societies relying heavily on social relationships (e.g. 'guaxi' in China). In addition a bunch of abusive supervisors I've had seem to avoid informative professional websites and public CVs. I will avoid listing names here, but I find it remarkably hard just getting a full list of publications from some PIs in China, where names may look similar and ORCID registration isn't common practice. Plus, I find 1-3 reviews already better than naught. – Scientist Aug 21 '18 at 13:07
2

Yes, there are such websites.

I know of the following two:

(i) http://www.qcist.com; (ii) https://www.ratemypi.com

However, at least at this moment, these websites remain useless and mostly abandoned. Note (i) is free and (ii) is paid. This is because to, in addition to a number of issues related by other respondents, academics are remarkably overreactive to criticism. This works directly against open criticism, as public relations play a central role in defining academics careers, and petty individuals are frequently empowered enough to take revenge on others. I am sure a number of PIs would exploit (public) institutional resources just to try and tear such websites down should they take root.

  • 3
    What are you talking about? Academics receive and emit criticism all the time, in the form of peer reviews, research evaluations, teaching evaluations, etc. – user9646 Aug 20 '18 at 20:07
  • @NajibIdrissi I am sticking with the question topic, i.e. PI-specific relationship public evaluations. Again: In my view this is completely unrelated to technical peer-review, institutional evaluations, up/down-voting. Surely not about anyone specific (e.g. I or you). I am rephrasing to make it clearly, thanks. – Scientist Aug 21 '18 at 12:54
1
+100

As I knew such website doesn't exist yet. It would be a nice idea for creating an app for this work:) Anyway about getting to know the professors in a given department is not a difficult task and you can do the following,

  1. See the website of a given advisor to learn about recent publications, grants, and number of current students

  2. If you can visit the depatment, go to it and speak with the current students and also his(her) students taken a course with the advisor

  3. If you cannot go to the department, find the email addresses of the current students of that advisor and ask important questions about its course works, research process, active topics in their lab

  4. If you are decided to work with a advisor based on your findings and interest to his works, contact with him and just ask some formal questions to see its rules on admissions (if a busy supervisor reply your email, you are luckyman!)

-1

While more than suggesting the "ideal advisor" such platforms must aim at rating advisors on simple metrics such as academic integrity, professional behaviour, and time management. There are far more than known examples of simply degenerated human beings pretending to be academic advisors, when they should really be sitting on a shrink's couch trying to resolve their problems of racism and lack of empathy.

However, such platforms can not work until universities which feed off such bad blood come together or start to show any initiative. Arguments pertaining to "ombuds services" shall be met with extensive rebuttals on this one :)

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.