Questions tagged [methodology]

A system of methods used in a particular area of study or activity so as to achieve results.

Filter by
Sorted by
Tagged with
114
votes
8answers
9k views

How to argue against questionable research practices such as P-hacking and Harking?

I have come into conflict with co-authors when being asked to do things that I consider to be questionable. Once I was told to try every possible specification of a dependent variable (count, ...
69
votes
14answers
8k views

How should a social scientist deal with envy of disciplines that are more quantitatively rigorous?

I am a student in social science who got into quantitative research at the start of my graduate school. Since then, I have had the valuable opportunity to take many Statistics classes and become aware ...
58
votes
11answers
7k views

Should unreadability or sloppiness of students' work be reflected in their evaluation?

When evaluating and grading students' work in technical fields (like computer science or mathematics), I often face ones that are really messy, sometimes even unreadable (I mean structure, not - ...
37
votes
6answers
8k views

Is it reasonable to not study previous research to avoid bias?

I am currently a student at a tech school and otherwise unemployed. I’ve never been a scientist or published a paper. So I am a little skeptical of some results I have been hearing about experiments ...
31
votes
1answer
869 views

What is the h-index exactly and how does it work?

What is the h-index, and how does it work ?
31
votes
5answers
1k views

How to overcome preconceived ideas about social scientists?

I have the opposite problem to this question. Often when I talk to someone from a 'hard' scientific field I am 'taught' how statistics work or how programming works. It is a bit like being mansplained ...
24
votes
1answer
1k views

Someone else's PhD student is not getting proper advising on methods. Should I interfere? How?

As in the title, someone else's PhD student is doing things that are clearly wrong in terms of statistical methodology. Because it is a field of social sciences where statistical methodology is not so ...
18
votes
1answer
2k views

Is there any research on applying Agile/Extreme/Lean methods in academic research?

I've been enjoying quite a lot of literature, all published within the last ten years, on how to handle projects, ideas, development, thinking, and so in with processes like Extreme, Agile, or Lean. ...
17
votes
3answers
3k views

Is the development of an original/novel method a contribution to knowledge worthy of a PhD?

A PhD is supposed to be an "original contribution to knowledge". In my own PhD (in an area of Earth Science) I have so far focused on developing a particular method of computer modeling that will ...
16
votes
2answers
4k views

What does “principled approach” mean in papers?

I encounter this term "principled approach" in some papers of computer science. Since I' m not a native speaker, I don' t quite understand what this means. And I didn' t find any results online. I' m ...
15
votes
5answers
2k views

Are P-hacking and hypothesising after results are known considered misconduct in academia?

This question is inspired by a comment to another question where I asked for help on how to argue against P-hacking and hypothesising after results are known (Harking). Someone questioned the ...
15
votes
3answers
4k views

How to use competitions to encourage students to work harder and study more

In order to encourage and motivate students to work harder and study more, it seems the teacher can use various competitions in class or after class. But on the other hand, competitions could cause ...
14
votes
4answers
2k views

How does a PhD student go about doing a meta analysis of a research question?

I just thought that I would put this question out here because I am currently working on a meta analysis of a particular research question in my field (HCI/information science). Moreover, this ...
13
votes
5answers
2k views

Are there actually students who learn by watching?

I'm a PhD student in physics, and I sometimes tutor undergrads in introductory physics classes on the side. Now, there's widespread agreement among people who teach or tutor physics that the only way ...
12
votes
2answers
309 views

Is there research on the extent to which complexity of the proposed method(s) impacts the acceptance rate?

I heard this speaker at IJCAI complained that his paper got rejected because the methods he used were too simple despite the results being highly competitive (twice the state of the art, at least ...
11
votes
2answers
170 views

Ref. request : book or survey about conducting experimental studies

I am currently conducting researches that are almost mainly theoretical (I am a TCS researcher gone rogue = I also work on applying theory stuff to real life problems). In the future I plan to conduct ...
10
votes
3answers
427 views

Is it appropriate to describe our methodological mistakes in manuscript?

I work outside academia, but am working on a project with a master's student. During data collection, we had some skip-logic errors pop up while administering the survey online and it resulted in some ...
9
votes
4answers
825 views

Does all computer science research involve heavy usage of mathematics?

I am starting my graduate studies in computer science this year and am confused as to what quality research (some new innovation or discovery) domain I would choose specifically amongst virtualization,...
9
votes
1answer
7k views

What should I include as “evidence of effective teaching methods?”

I'm in literature and applying for a tenure-track position. One of my job applications is asking for "evidence of effective teaching methods" as one of the documents I am to submit. Does anyone ...
8
votes
2answers
427 views

How to tackle the bibliographic work as an entering PhD student?

I'll be starting my PhD in the next fall. I already looked over the internet for advice for a beginner, even read two books on the subjects. Still, there is one point I haven't seen discussed as I ...
8
votes
1answer
1k views

Should I describe failed iterations in methodology?

I'm currently writing my Master's thesis in machine learning. My understanding of academic papers are that you describe what you did in methodology section and what the outcome was in the results ...
8
votes
3answers
1k views

Difference between criterion validity and reliability equivalence

In the book Doing research in the real world by David E. Gray, there is a section on experiment design. When discussing validity and reliability, the author defines “criterion validity” as This is ...
7
votes
1answer
133 views

Method/tactic to extracting information from articles

I am generally curious to hear what sort of technique/method people have to extract information from scientific articles, in order to write e.g. introductions. I for instance, normally read an ...
6
votes
3answers
1k views

How do I talk about methodology mistakes In a scientific project report?

I'm writing up my 3rd year engineering project (The equivalent of a dissertation in other subjects), and I'm struggling to write the chapter in which my method failed I couldn't get any results. My ...
6
votes
2answers
2k views

Can invention of UI/UX or a programming syntax become a publication? [closed]

In my opinion, UI/UX (user interface / user experience) or programming syntax are just like a piece of art. Some people will like your work, some won’t – it depends on a number of factors varying ...
6
votes
3answers
646 views

How to do evaluation when the methodology is unique?

When it comes to the evaluation of a methodology (or an algorithm (CS)) we usually see how well the methodology actually is by comparing it with other similar methods that achieve the same thing. ...
6
votes
1answer
2k views

Is it possible not to have a hypothesis in your thesis? [closed]

I have been working on a research report in which forecasting is done on the basis of data, followed by an interpretation of the forecasted results. Is it possible to have that kind of research ...
6
votes
2answers
296 views

Do I have to be concerned about self-plagiarism in a short accessible methods description?

I published a methods paper about a data analysis method (in cognitive neuroscience), and I'm now working as a co-author with colleagues on two experimental papers using that method. Since the main ...
6
votes
2answers
1k views

Should limitations of a methodology with proposed solutions be discussed in the Limitations Section?

My methodology is online ethnography. This methodology has certain limitations such as identity play, falsification, and artificiality of data. However, its proponents have suggested some strategies ...
6
votes
1answer
738 views

How does one learn research methodology?

I am a multidisciplinary person. I have a bachelor's degree in computer science and now I'm working on my master's thesis on strategic intelligence studies. The experience I have in writing both of my ...
6
votes
1answer
4k views

How to write a methodology chapter in a masters thesis

Is there a standard way to set up a methodology chapter, other than just listing equipment and explaining the execution of method and analysis? I find this type of set up to look childish and too ...
6
votes
1answer
121 views

How to cite and publish unpublished governmental statistics correctly?

Conducting a research which needs governmental statistics, I have encountered a problem. The problem is I need to have precise data on farming in an area, but the data are not published. I had to go ...
6
votes
2answers
1k views

Research Methodology Books for beginners in Computer Science research

I am looking for Research Methodology textbooks in the field of Computer Science. Most books I came across are useful to social science, economics etc. In our part of the world a person who wants to ...
6
votes
1answer
371 views

How often do techniques/methods that are considered old or obsolete become relevant again?

In many, if not most, disciplines methods age, get old and eventually become more or less obsolete, in the sense that some other method perhaps using a different technology becomes common-practice for ...
5
votes
2answers
1k views

When replicating results, what should I do when the author didn't use the method the paper said they did?

I am replicating a model to report on how well it does on a new evaluation metric I am proposing. The method/hyperparameters of the model are given in a paper about it, where it breaks all benchmarks ...
5
votes
4answers
631 views

I like my supervisor but not how he does things; What do I do?

I've already got a little experience doing self-led research but not in doing setup for the domain in which I work. I really enjoy talking with my supervisor about actual research topics, but I don't ...
5
votes
4answers
168 views

Literature search methodology for non-academics?

I moved straight into the professional world after my bachelor's degree, and have no experience with formal research of any sort. Recently, however, my university has granted alumni access to a large ...
5
votes
1answer
108 views

Researcher anonymity in fieldwork

Numerous posts on this site address anonymous or pseudonymous publication, but not anonymous or pseudonymous fieldwork. There plausibly exist situations in which a researcher undertaking fieldwork ...
4
votes
1answer
603 views

Is Scientometrics a scientific discipline?

This question is not about the politics of scientometrics, nor is it on the role of scientometrics in governmental research programs, nor is it about the use of scientometric indices: these questions ...
4
votes
6answers
809 views

Resources for students designing surveys?

Somewhat similar to this question, but looking for resources (books/articles, etc) for undergrad students who are not very familiar with designing effective surveys, (for example, one student is ...
4
votes
4answers
3k views

Methodology as a Body of Methods?

I'm currently having a hard time understanding if authors are using the word methodology correctly, or if their papers should be classified as BS. Hence, I set out to get a better feeling for the ...
4
votes
2answers
183 views

Should I change my proposed solution for paper rejected because of lack of novelty or originality?

From my understanding of the reviewers' comments, it means our proposed solution adds nothing new to the body of knowledge even if we get better results than the state-of-the-art work. The reviewers ...
4
votes
2answers
921 views

How to Stop Making Stupid Mistakes [closed]

This has been a plague upon my performance for what seems like all my life (or all my graded life). No, it's not an 100, it's a 98 because of calling bromine a gas carelessly. No, it's not a 6/6, it'...
4
votes
1answer
1k views

What's the best way to justify your choice of baseline methods for academic paper?

As the title states I'm curious how to justify the choice of baseline methods for academic paper when proposing a novel algorithm/method. For example, when proposing an algorithm, there is a suite of ...
4
votes
1answer
292 views

Do all the co-authors of a publication own the content and may use RAW DATA, text, figure or table for their own publication?

A third co-author C of a study in 2016 available on-line (under subscription) want to re-use the data (included in the figures or tables) of this paper with for others co-authors (A, B, D, E). Co-...
4
votes
4answers
446 views

Hypotheses that cannot be sufficiently tested

My understanding is that a hypothesis is not scientific unless there is a way to sufficiently test it. Is it ever acceptable to present a hypothesis that cannot be sufficiently tested? I can ...
4
votes
1answer
251 views

Method and content in selecting a social science dissertation project

General question: When working in an area of social science where method matters just as much as content (i.e., theory, question), how does one choose which should be the starting point for a ...
4
votes
1answer
80 views

In which section of a research paper is it best to justify the choice of methods?

I'm currently writing the methodology section of my thesis and wondered if I was including too much. In the methodology section I have currently included: Alternative approaches I considered The ...
4
votes
1answer
138 views

What are cautions to take with second hand data in an interview?

When analyzing second hand information in a data set (participant is recounting someone else's experience), if you cannot access that person to confirm their experience, what are some cautions to take ...
4
votes
2answers
387 views

Are there standard example research papers for teaching methodology and experiments?

Are there recommended or standard published papers (not books) that show great research methodology/ scientific methods? I am trying to help out a friend who is in business and they are trying to ...