I'm comparing my method against existing methods by doing some experiments on one dataset. The existing methods do not provide results on the considered dataset. My question is: Can I use default parameters from the existing methods? The fact is that there are plenty of existing methods and it will take a lot of time to fine-tune for each existing method. Thank you.
In my view this depends on a number of things:
a) Are the default parameters of the competing methods advertised as being widely applicable?
b) Have authors of competing methods provided appropriate guidance for how to tune?
c) Does what you are proposing require a lot of tuning, and did you tune yours in order to beat the others?
Answers a) yes b) no c) no point in the direction that you can use other methods with default tuning. If the resulting score is 3:0 or 0:3, my advice is clear. If it's 1:2 or 2:1, well, one needs to look at details, for example, is provided guidance by others so weak that chances are 95% of the users will use the default tuning anyway etc.?