4
$\begingroup$

I am working on a novel object recognition algorithm with BoF implementation for my MSc project and it performs fairly well. I am using it on Caltech101 dataset. I want to compare the results with other techniques, like SIFT, SURF, PHOW and so on. The problem I'm facing is that none of the papers that list out their performance in terms of accuracy mention the number of categories taken into consideration.

E.g. for the Vl_feat PHOW, the script says in the comment section that it should give you about 64% accuracy. But when I run it without any changes, I'm getting 92%. When I changed it to test on all 102 categories, it's giving me an accuracy in the 30's range.

I am fairly new to this, so if I'm missing something that's obvious, please accept my apologies.

$\endgroup$
  • $\begingroup$ The problem seems to be that the authors of the other papers did not include enough information for you (or anyone) to be able to reproduce their work. This could have been oversight, or the editor (or reviewers) may have removed it prior to publication. I'd suggest contacting the authors of the problematic paper and see if they'll answer your question. Be polite (it's always nice to know someone read your paper, so let them know that you have!). $\endgroup$ – Peter K. Aug 20 '15 at 18:38
  • $\begingroup$ @PeterK Thank you for the suggestion. I'll do just that. $\endgroup$ – SidMMXI Aug 20 '15 at 18:40
2
$\begingroup$

The problem seems to be that the authors of the other papers did not include enough information for you (or anyone) to be able to reproduce their work. This could have been oversight, or the editor (or reviewers) may have removed it prior to publication. I'd suggest contacting the authors of the problematic paper and see if they'll answer your question. Be polite (it's always nice to know someone read your paper, so let them know that you have!)

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.