Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [experiment-design]

Technical aspects, ethics, and accepted norms or standards related to designing, conducting, or reporting research. Also, questions on teaching research design.

2
votes
0answers
49 views

Is it usually allowed to use lie detecting technique (maybe using neural activities) during post-experimental inquiry?

When an experimenter want to find out about e.g. what is the hypothesis perceived by the subjects via post-experimental inquiry, if the subjects answered that they did not perceive any hypothesis, it ...
2
votes
4answers
120 views

Can Research Hypotheses be Contratictory Among Them?

I want to know how to proceed in an experimental research, where there is a conflict between different theories with different predictions. I.e. the theory A predicts X > Y, while the theory B ...
1
vote
0answers
108 views

Is apprenticeship/reading the only way to learn experimental design? Are there books/papers about the theory of designing a sound experiment?

I am slogging away at grad school and I have a nagging feeling I can be more efficient. I feel like a person who cannot see more than a foot in front of them so I hit a lot of walls. My planning and ...
0
votes
5answers
121 views

Sampling question for telephone survey. [closed]

Health sciences researcher out of my area of expertise. I have an assistant calling businesses at random, using a publicly available registry, to ask about their automated external defibrillator (AED)....
0
votes
1answer
40 views

Is it necessary to add experiment to my designed framework for a journal

I'm working a framework X and trying to publish it in IEEE Communication Magazine. But, due to its limitation on the number of text and figures, I wonder it is necessary to add any experiment or proof-...
5
votes
1answer
234 views

What computer specs should be included in numerical results section, when, and why?

Generally in the numerical section for papers I read, they include (if at all) computer specs like how much RAM, CPU speed, or type of processor. What kinds of computers specs should I include? When ...
38
votes
6answers
7k views

Is it reasonable to not study previous research to avoid bias?

I am currently a student at a tech school and otherwise unemployed. I’ve never been a scientist or published a paper. So I am a little skeptical of some results I have been hearing about experiments ...
2
votes
0answers
104 views

Is it possible to request a scientific experiment from a laboratory?

I have a scientific experiment that I need done to prove a theory of mine. Unfortunately I don't have the resources to perform said experiment like a fully functional laboratory such as Los Alamos ...
2
votes
3answers
162 views

Is using a similar experimental procedure and analysis structure to test something different considered plagiarism?

Here is the situation: I am currently writing a thesis which uses a behavioral experiment to answer the main research question. Its main aim is to test how a certain welfare scheme would affect ...
-1
votes
2answers
66 views

Experimental results summarized in a single large table OR smaller tables with subset of results?

In my experiment, I have obtained a large chunk of results for many different problems being effectively solved by my implemented hypothesis. If I keep my results as subsets for each problem, then I ...
0
votes
1answer
172 views

Thesis experiment done by others

I started my masters with semi finished experiment by my supervisor, and h suggested to do more experiments to include them in my thesis. However, after year and a half, the other methods we were ...
4
votes
2answers
204 views

Reproducible and exact calculations vs. approximate and slightly random results in experiment

When experiments are performed and reported in an academic article, I learned that reproducibility is important. I am implementing a system where I stand between the choices to use GPU acceleration to ...
6
votes
3answers
353 views

Is is ethical to not compensate experiment participants who withdraw from the study?

I do experiments on learning and instruction for my dissertation. They are almost no risks in participating in our studies--except maybe boredom since they tend to run for 30 minutes to 1 hour. We get ...
5
votes
3answers
132 views

Changing an experiment due to preliminary data

I'm writing a paper comparing the performance of 2 algorithms (lets call them A and B). A performs better than B, however preliminary data suggested a way to significantly improve the performance of B....
1
vote
1answer
128 views

When a STEM research topic can be studied experimentally, computationally, and theoretically, do PhD programs typically focus on only one approach?

In American universities, when a STEM research topic can be studied experimentally, computationally, and theoretically, do PhD programs in this research topic only focus on one of the three approaches ...
0
votes
1answer
138 views

Tips for Conducting an Experiment without Stress

I have been working independently on a research project for the past few months and I am almost ready to actually conduct the experiment. The experiment itself should only take two hours. However, I ...
4
votes
2answers
335 views

Disorganized and overworked professor causing disappoinment and headache

About two years ago I finished my master thesis. At our university we can only choose the topic to work on and mostly it is part of a Phd program. My topic was a mess because the faulty study design ...
1
vote
0answers
62 views

First time being in an applied math lab - what are some tips to overcome shyness?

This will be my first semester in an applied math lab. After spending a couple of years taking all theoretical math courses, essentially working in isolation the entire time, and finishing a thesis, ...
8
votes
1answer
282 views

How to deal with an unhygienic human subject?

The human subject that I really depend on is extremely unhygienic. Not simply sweaty way, but full-on stench, black teeth and dirty clothes. I feel responsible for the lab equipment and space that I ...
1
vote
0answers
43 views

Help me define the experiment design - what type of experiment is the right one? [closed]

I already asked this on reddit, with almost no responses. I hope here is the right place to be asking these kind of questions. So, here we go. I have developed a technique in some diagrammatic ...
29
votes
6answers
5k views

How to tune algorithm performances in computer science papers

In computer science field is common to produce papers that present algorithms that estimate something with a certain accuracy and a certain speed. Many algorithms can clearly be tuned to have high ...
1
vote
1answer
125 views

design student assignments

In a recent interview, I have been asked how to design assignments for an undergraduate course on computer science. Based on my previous TA experience, I did help my supervisor to design students ...
0
votes
1answer
128 views

“Fake” Things that are used in Experiments [closed]

What do you call the "things" that you used in experiment, but not in real life? Things that are made for experiment/simulation purpose. For example, phantom for human body.
4
votes
1answer
343 views

Research paper with experimental results from a small amount of data

I have written a research paper in image processing that I will be submitting to an IEEE conference. I have proposed a new method to detect 'X' in images. However, due to hardware failure I could ...
7
votes
1answer
345 views

Good first-time study pre-registration website/service

For my PhD thesis in artificial intelligence, I am designing a human study where subjects interact with multiple versions of an algorithm and rate their experience. I like the idea of pre-registering ...
2
votes
0answers
130 views

What tradeoffs are there between internal and external validity? [closed]

I was reading through an article about research design. The authors gave an example on the relation between internal and external validity which I thought might be an important area of consideration ...
1
vote
1answer
134 views

How to recruit participants for online experiments?

We are currently doing a study where we thought it might be smart to try out the possibilities of recruiting participants from the Internet. I was thinking it might be best to ask more experienced ...
2
votes
2answers
1k views

How to mention an implementation tool in thesis?

In my MSc thesis implementation section, I have used two tools: Matlab and Python scripting. How should I introduce and mention them in my implementation chapter? Thank you,
-1
votes
2answers
240 views

How many people does it take to establish a theory? [closed]

There are often theories published by scientists in both the hard sciences and social sciences based on new understanding of fundamental science and better data collecting mechanisms that runs in ...
6
votes
2answers
179 views

How can I do better research when the experimental design is lacking?

I would like to do first-class research. However, how do I actually accomplish that when my supervisors design not-so-great experiments and I don't have the resources to do more independent work? In ...
1
vote
1answer
78 views

Correct name for experiment aimed at confirming an alternative Hypothesis?

I am running a series of surveys with single variant A/B tests aimed at gathering information about how different groups of users perceive a series of website designs with different distortions ...
5
votes
2answers
152 views

Large distributed research network

I remember having heard of a large distributed computer network being operated by several universities. As far as I remember, it would be possible to get several (hundreds) of virtual machines to ...
5
votes
1answer
423 views

What is the strategy to identify natural experiment as a PhD student?

As social scientists become more concerned with causal inference, a good thesis these days needs some sort of quasi-experimental strategy. For example, an economist wants to know the effect of ...
2
votes
1answer
60 views

Impact of parameters in experimental results of paper

I am writing a paper in computer science literature. I have a method that has two main parameters. It turns out that one of these parameters does not have a significant impact on the quality of the ...
1
vote
3answers
1k views

Does getting pay to be a subject in an experiment violate an F1 visa in the US?

I am in a university in the US. I need 10 subjects for a 2-hour experiment. The compensation is 100 USD. If a subject is an international grad student on an F1 visa in my university, will it go ...
4
votes
2answers
198 views

How to develop experiment to justify construction of a prototype system?

I have worked hard for my master thesis project to build a system that uses an already existing algorithm, just in a mobile setting, which hasn't been done before. Because the algorithm is complex, it ...
1
vote
3answers
619 views

Should I repeat experiment affected by external factors until achieving consistent result

I am doing an experiment assumed to be performed in ideal environment although it is not, e.g. resource is fully allocated from a resource pool shared between different organisations. As my experiment ...
4
votes
2answers
381 views

Do researchers reuse benchmark results for existing algorithm when comparing with their algorithm?

Unfortunately I do not have any prior research experience, therefore I had a few questions while I was studying papers on cluster analysis. Can a researcher legally and with permission use the ...
4
votes
2answers
375 views

Are there standard example research papers for teaching methodology and experiments?

Are there recommended or standard published papers (not books) that show great research methodology/ scientific methods? I am trying to help out a friend who is in business and they are trying to ...
8
votes
3answers
1k views

Difference between criterion validity and reliability equivalence

In the book Doing research in the real world by David E. Gray, there is a section on experiment design. When discussing validity and reliability, the author defines “criterion validity” as This is ...
11
votes
3answers
1k views

How to choose participants for a study?

I want to know how can I get some participants for an empirical research study I would be conducting. Does universities have systems in place to call/recruit participants or do I have to find them ...
11
votes
2answers
158 views

Ref. request : book or survey about conducting experimental studies

I am currently conducting researches that are almost mainly theoretical (I am a TCS researcher gone rogue = I also work on applying theory stuff to real life problems). In the future I plan to conduct ...