Skip to main content
18 events
when toggle format what by license comment
Aug 3, 2022 at 9:11 comment added Karl Tens of gigabytes is not large. The ship is sailed now, but you should definitely have put the data on an external hard drive. Now you have irreproducible results, which basically means no result at all. Not having the computing power any more to do a re-run is a very valid excuse to decline reviewer requests, but the data being gone will be seen as inexcuseable by many..
Aug 1, 2022 at 17:38 comment added Amadou Kone @Karl the dataset was very large (10s of GB). Additionally, as part of our access to the data, I had to affirm that I wouldn't share it (it contains potentially sensitive information). So I did not take measures to preserve it after the expiration of the grant.
Jul 31, 2022 at 10:25 comment added Karl @Barmar Institutions that have no money (or funding body, government) to keep the raw data cannot be considered "academic".
Jul 29, 2022 at 12:05 comment added Federico Poloni @JeopardyTempest if the numerical experiments can be re-run without further inputs, then those aren't data, they are intermediate values. In my view, at least, but maybe that's just a matter of terminology.
Jul 29, 2022 at 8:47 comment added JeopardyTempest I'm surprised at the widespread shock at data being gone. If you're running simulations on massive servers/the cloud, and each simulation is very large, but only has minor contribution, basically a resulting data point or small contribution to images... and you know they can be rerun, I'd think it's quite logical to delete and move on for each step if you have limited resources. The feasibility of backing up every bit of intermediate data if there's limited further use seems impractical in some situations. For example when doing massive ensembling meteorologically or monte carlo simulations?
Jul 28, 2022 at 23:11 comment added Scott Seidman @Barmar most retention policies are between 3 and 7 years, not perpetuity.
Jul 28, 2022 at 21:17 comment added Barmar @ScottSeidman If all the grant money has been used, who is supposed to pay for that storage in perpetuity?
Jul 28, 2022 at 20:45 comment added tbrookside @Karl Since this is a big data project, OP might have been using a copy of a public big data source, copied to a cloud instance of some database for analysis. Once his cloud host shuts his account down, that copy of the data is gone.
Jul 28, 2022 at 13:27 comment added Neinstein "all of the data has been deleted" - are you sure about this? At least the final raw data that has been used for the ppublication definetly should've been preserved some way. Loss of such expensive data should never happen, it seems it was was very expensive to obtain it. It could be reused for further research; your grand may even require you to keep it accessible. Your problem might be bigger than a simple refusal.
Jul 28, 2022 at 12:00 comment added Scott Seidman Your sponsor may have such a policy as well
Jul 28, 2022 at 11:58 comment added Scott Seidman Many journals will insist upon a data retention policy. Not having the data might remove the paper from consideration.
Jul 28, 2022 at 10:55 answer added Ilmari Karonen timeline score: 22
Jul 27, 2022 at 22:18 comment added Karl "all of the data has been deleted" can you explain that a bit more? Very often experiments cannot easily be repeated, but loosing all the raw data is, well, really bad if you want to write a paper.
Jul 27, 2022 at 20:07 history became hot network question
Jul 27, 2022 at 18:00 history tweeted twitter.com/StackAcademia/status/1552353121879343106
Jul 27, 2022 at 13:28 answer added AppliedAcademic timeline score: 56
Jul 27, 2022 at 13:18 answer added atom44 timeline score: 16
Jul 27, 2022 at 12:06 history asked Amadou Kone CC BY-SA 4.0