Questions concerning acquisition, handling, presentation, publication, and other practices related to use of data in academic research.

learn more… | top users | synonyms

0
votes
0answers
55 views

How do I deal with inconsistent annotations in my data? [on hold]

I've prepared a dataset for a Natural Language Processing problem. The whole dataset consisting of 15,000 sentences has been annotated by two annotators, where their task was to label each sentence ...
2
votes
0answers
34 views

Should I use schema.org/CreativeWork to publish my list of talks/papers/publications?

What's the best practice on publishing your list of talks/papers/publications on the web? Is there any benefit with annotating it with http://schema.org/CreativeWork properties? Are there any ...
4
votes
1answer
159 views

Is there a tool like the Open Science Framework that can be run on a private server?

I am very impressed by the Open Science Framework. Unfortunately, for some projects I cannot put any data in a cloud especially if it is not encrypted. Are there similar tools which allow me to keep ...
2
votes
1answer
50 views

Can publicly available datasets which are hosted in Github be used in research papers?

I am in a dilemma. I have used an old publicly available dataset for some of my analysis and want to publish it. But the problem is that it was publicly available and hosted in a website ...
1
vote
1answer
165 views

Do professors from different fields use the same data set in different ways?

I have no experience with data analysis but a data analysis project was offered to me in the past by one of my math professors. It would have been a PCA project, where PCA means "Principle Component ...
12
votes
7answers
1k views

What data analysis software should a supervisor recommend to their research students? [closed]

Often I have found that research students who have learned to do experiments have not learned to use software to handle their data effectively. It's not within my power to insert the appropriate ...
11
votes
1answer
164 views

Appropriate to mention using a lab's dataset when seeking grad student position in that lab?

I'm in the scenario where I'm approaching my final year of undergrad and am looking for a potential advisor for grad school; I've done my research on their research, including reading through several ...
6
votes
2answers
205 views

Where to upload/publish gigabytes of experiment data [closed]

I have conducted experiment that had unexpected result which goes against consensus in my community and I worry whether it will be accepted by other researchers. For that reason I would like to make ...
0
votes
0answers
60 views

Ethics and legality of scraping (and ultimately publishing about) publicly available information from journal websites

I'm interested in scraping publicly available information from journal websites (such as article titles, authors, abstracts, and keywords). After scraping the data, I'm interested in analyzing the ...
9
votes
1answer
310 views

Is there any obligation for authors of a paper to provide the dataset used in their research, upon request?

I've recently read a curious article on machine learning where the author used a very interesting dataset, which would normally take thousands of man-hours to recreate. Now, assuming I would like to ...
3
votes
1answer
81 views

Are there any data repositories commonly used in conjunction with arXiv? [duplicate]

I will soon be posting an article to arXiv, and I have supplementary data that is approximately 800MB in size, which I would like to make available somewhere. Are there any data repositories that are ...
8
votes
2answers
169 views

How should I share (cite) my datasets and R analysis/code files in my thesis?

I'm trying to follow some of the best practices of the "open science" movement. In my thesis, I've performed all of the analyses in R (a non-proprietary, open-source program for analyzing data), and ...
5
votes
0answers
351 views

Bulk download Sci-Hub papers [closed]

I wonder whether it is possible to bulk download all papers stored in Sci-Hub. I am aware of the questions: Is there a more user-friendly way to download multiple articles from arXiv? Bulk ...
2
votes
2answers
87 views

Public dataset without license: what is allowed?

Many public scientific datasets are accompanied by a license, for example variations of Creative Commons are used quite often. However, in many cases public academic datasets lack any licensing ...
2
votes
3answers
183 views

Is it ok to share a a client's dataset on github, along with my code?

EDIT: I originally tried to make the context as brief as possible, but I may have overdone it. Context I'm starting to put some data analysis I'm asked to do on Github, and licensing all my work ...
8
votes
2answers
1k views

Whether to exclude standard deviation in plot of outcomes of a series of experiments?

I have performed 21 different experiments, which I have repeated 3 times in total (63 samples gathered). I plan to compare data using a bar plot. For bar plotting, I initially decided that I will ...
3
votes
2answers
597 views

What solutions exist to store data in text files and future-proof against tampering? [closed]

A recent question in Information and Security Stack Exchange, How to know whether a textfile has been edited or tampered with raises a very good point: if one wants to archive experimental data ...
0
votes
0answers
27 views

How to Start Biomedical Engineering Coadvisement

I am a BME PhD student at a top-tier university with interests in data science applied to medicine (specifically neuroscience). I am currently not able to work with one of the faculty (call him Bob) ...
3
votes
2answers
77 views

Sharing data (not a data set) with a research paper

How to share data accompanying a research paper? I know there exist some places to share datasets, but sometimes I would like to share data that are not data set (e.g. experiment parameters, results, ...
7
votes
2answers
304 views

Is it valid to pad an axis slightly in order to enhance point visibility?

My apologies in advance if this questions is better suited to be migrated elsewhere. In a standard (X,Y) Cartesian line/dot plot the axis should be placed in a contextually logical place. In a graph ...
5
votes
2answers
170 views

Is providing an unpublished dataset worthy of coauthorship?

I’m working on a paper and I realized I do not have an adequate dataset (for reference, this is in a subfield of machine learning), nor do I have the time to personally go and create one. A colleague ...
14
votes
3answers
253 views

How to share a scientific dataset with the research community

Background: I am a PhD student and am one step away from graduating. I have created a dataset in 3D microscopy vision, particularly 3D surface reconstruction from scanning electron microscope images, ...
0
votes
1answer
83 views

Data sets of academic conference budgets

I am looking for data sets of academic conference budgets. I am mostly interested in the expenditure/revenue breakdown. Ideally, other information such as as number of attendees and location would be ...
3
votes
1answer
350 views

Bulk download of arXiv (or other publication data set) with metadata AND citations

This is to extend the question: Getting a dump of arXiv metadata I would like to download arXiv in bulk, and found a useful answer above for using this syntax: ...
0
votes
1answer
75 views

Data sets of questions asked in conferences

I am looking for data sets of questions asked in academic conferences. Ideally, it should contain a timestamped transcript as well as some reference to the talk (e.g. the paper it was presenting), but ...
5
votes
3answers
617 views

Fail to reproduce results in a published paper. Is this an academic misconduct? [duplicate]

I've downloaded the source code and data published in a paper. I've followed their methods, in particularly, copied and pasted their sample code. Unfortunately, I've failed to reproduce the figures in ...
4
votes
2answers
130 views

Uploading online all Data used in thesis? [closed]

For my Ph.D work I used large volume of data which can not be put into my thesis. So, I am planning to put all this data online, so that other could download freely and cross check my work. It would ...
3
votes
2answers
80 views

Sharing MOOC forum data

I have the forum data for several MOOCs. Can I legally share it with someone else without going through IRBs or some other administrative process? The data contain timestamp, post title, post body, ...
2
votes
1answer
88 views

Data exchange between academic institutions

Is there any publicly available statistics on the amount of exchange of data that transit through Internet between academic institutions? (e.g. X TB yearly from institution A to institution B)
1
vote
1answer
124 views

How to convince and/or ask researchers to share data? [duplicate]

I'm currently working on gathering data for my MSc thesis. The problem is, for my type of research, there is VERY limited data that is freely available. Specifically, I'm looking to acquire baseline ...
5
votes
1answer
94 views

Citation - Collection of images for machine learning

I posted this question yesterday which leads to my current question. When I use a collection of images, which are not my own creation, to generate classifiers that an object-detection algorithm uses, ...
4
votes
2answers
235 views

Do I need IRB approval to study myeslf? [closed]

I am attempting to do my PhD "in the open", to treat the entire project of getting my degree (whose research is unrelatedly Computer Science), as a study. That is, I am going to collect my thought ...
7
votes
1answer
209 views

Copyright – use of images to train algorithm

I am working on a university project about computer vision. Part of my work requires object recognition, for which I would use cascade classifiers. These cascade classifiers need to be “taught” what ...
1
vote
1answer
41 views

Patent trial data set

I am looking for a data set that would list patent trials that involve an academic institution, if possible with the date, the parties involved and the outcome. I am aware of this list of number of ...
4
votes
2answers
157 views

Can I use data and images found online in my project report, under the fair use clause in copyright law?

I am a mechanical engineering graduate student, and am working on my final project. I am doing a finite element analysis of a particular phenomenon. I was hoping to find test data of that particular ...
4
votes
1answer
182 views

What is the difference between DBLP and Microsoft Academic Search Graph Dataset?

Recently Microsoft has released a dataset, Microsoft Academic Graph. I have used DBLP dataset before. I want to know what is the difference between these two datasets.
7
votes
2answers
585 views

Can you present data on non-participants?

Are you allowed to present data on those who declined to participate in your study? The following is an excerpt from a study on whiplash-traumas where the authors clearly publish some basic ...
5
votes
4answers
168 views

Are there open-access, free, non-topical academic data and research archives?

I am looking for an archive where anyone can deposit both data and research papers, which does not require creators or users to pay, does not require registration for users to access materials (hence ...
6
votes
1answer
141 views

Revisiting a paper?

I am researching the field of micro (and some macro) economics. I wrote an article that is forthcoming. One key limitation I had, was some missing data. Now, some quite time later, I was able to get ...
6
votes
3answers
152 views

Organizing data and files

Over the last four years I did a bunch of experiments (biotechnology, protein purification). Some of them are more valuable, some of them were just poorly designed (e.g. temperature not controlled, ...
53
votes
8answers
8k views

Is it unethical/unscientific to omit outlier data in a publication when they are in FAVOR of your argument?

I have a scatter(log-)plot with some 10,000 data points that plots the running time of some algorithm against the input on random instances of some problem. I have a lot of these plots, and due to ...
0
votes
1answer
88 views

Experiment by using a Matlab's demo data set and publish to journal/conference

I hope my question is within the topic of this forum. I would like to test an algorithm to a real application data and publish in a journal/conference. However, I cannot acquired my own data set ...
7
votes
1answer
37 views

Why don't grants from publicly-funded organizations systematically demand code and data to be released?

I wonder why publicly-funded grants do not systematically demand from the recipients that code and data to be released, and results/papers to be publicly accessible. (put aside data that raise privacy ...
19
votes
2answers
69 views

How to deal with sensitive individual data in open science?

I work with governmental register data, which includes sensitive information about individuals, and therefore cannot make datasets available to the public lest I risk violating the privacy of my ...
18
votes
4answers
190 views

How do I get a DOI for a dataset?

A DOI is a commonly used digital object identifier to refer to an electronic document. How do I secure a DOI for a research dataset, to help share and identify it?
17
votes
2answers
93 views

How can I protect open research from being plagiarised?

Since open research is about publishing data which are accessible to all, what kind of actions should I take to prevent open research from unauthorised copying or its data being plagiarised without ...
5
votes
2answers
503 views

How to highlight a novel dataset creation in a research paper?

I'm currently working on a minor problem in information extraction. The idea behind the system is relatively simple and contains small modifications of existing algorithms. However in the process, I ...
4
votes
1answer
158 views

Is it ethically defensible to attain consent on an opt-out basis in a newspaper?

I frequently find notices in my local newspaper from researchers who are in the process of doing follow-up research on some study that they conducted a few years back. There, they provide an overview ...
5
votes
4answers
272 views

Ethical considerations in publishing raw data

Apart from taking measures to maintain confidentiality, do I need my ethical approval to specify permission to publish raw data along with my study? I'm trying to facilitate reproducibility in my ...
7
votes
1answer
255 views

When did it become commonplace for data set providers to ask users to cite their paper(s)?

Nowadays data set providers typically ask data set users to cite their paper(s) introducing the data set. When did this practice become commonplace? (Given what I read on this page, I feel the ...