Why say source code is available with an ArXiv paper when it is not?

Question

I sometimes come across ArXiv papers where the authors claim the source code for the project discussed can be obtained, but on checking the link provided the source code comprises no more than a place holder. So the code is not available, and on subsequent checking months later (in case the authors were in a rush to publish the paper before the code was quite ready to release) the code is still unavailable.

Now I understand there is no obligation to provide source code with commercial potential, unless maybe the project was subsidized with public funds. But what do authors have to gain by claiming it is available when it is not actually available?

Answer 1

There is no advantage to claiming the source code is available and then not doing that. All it will achieve is irritating the really interested readers.

The most likely reason is it’s a simple mistake. Something like they wanted to do that but forgot. Or other reasons, maybe department policies came up that prevented the author from doing that. Or maybe the author found another more suitable place to publish the code and forgot to update the link in the paper. Or...

The simplest solution is to contact the author directly.

Answer 2

I don't know about arXiv, but on bioarXiv, people will often upload their manuscripts at the same time as they submit them for peer review. People will put in links for data and code that they intend to make available when the peer-reviewed form of the manuscript is published.

Some times this is because they want to protect their data/code until the last possible minute. Other times they tell themselves they'll get round to sorting it out before the peer reviewed form is published, but then forget.

Note: I am saying what happens. I'm definitely not saying this is good or acceptable practice.

Answer 3

Papers which claim availability of source code are more likely to make it into a collection of references that are not actively required for a particular paper. Also some publication guidelines may demand the availability of source code when it is actually necessary for making the paper's claims open to verification.

And that's just for assuming that the dead links are intentional. There is a multitude of reasons of why such information may not end up there essentially. One of the most boring real-life reasons is "the code still needs cleaning up and documentation" since papers are often done under time pressure, and there just are no resources after publicatoin to actually do the actually intended clean-up and documentation.

In that case, contacting the author is your best bet. It may end you with some not-well-usable code. It may end you with some dissatisfactory or no reply at all. But it certainly is the best way to get behind something that you think may be relevant for your further work. And it may be what is needed to make the author invest the effort of making stuff publishable after all: if one feels "nobody is interested anyway", cleaning up stuff for publication will easily end up on the eternal backburner.

Answer 4

I think what they should have written is that "it will be available upon publication". Many people will provide the source code only after the paper is published. It is possible they intended to release the code upon publication, and they may need to get approval from their funding source etc. They should use proper language though.