Wednesday, April 26, 2006

Automated bogus research paper detection

By now, is there a person in the world who isn't familiar with the annual WMCSCI spamference and the bogus paper submitted and accepted by them in 2005? Well, technology has caught up, and now Nagib Callaos and the other folks who run this and similar conferences can click on the link from the title above to get information on automatic detection of bogus papers without all that messy and bothersome reviewing.

1 comment:

  1. (The trouble is that I've got a nice work-around against their detector: plagiarism. Sure, they could fill this hole too, but "only begun the arm race has".)

    I very seriously think that many people, though it is not conscious, have basically industrialized the paper production process. And why not? If you are rewarded by the number of papers published, then your goal should be to publish as many papers as possible, irrespective of their significance.

    What's going to happen soon, though, is that it is becoming so easy to measure the "impact" of your publications (type someone's name in google scholar), that other metrics than just the sheer number of papers will get used. And then, some of these people will be really hurt.

    All we have to do is to start using alternative metrics in our activity reports. Once enough people start doing it, the infamous "publish or perish" will grow obselete.

    I'm sorry, but someone who publishes 10 or 20 papers a year, and none of them ever get cited, even after 10 years, is probably very close to automated paper production, and such a person should be rated below someone who produces 10 times fewer papers, but papers of genuine value.

    Our trouble is that several of the very good people are also very prolific, but prolific doesn't imply good. We should be ashamed that we can't differentiate causality from correlation.