Is it ethical to upload a automatically generated paper to a non peer-reviewed site as part of a larger...
Geography at the pixel level
Is bread bad for ducks?
What is this sharp, curved notch on my knife for?
Correct punctuation for showing a character's confusion
How to support a colleague who finds meetings extremely tiring?
For what reasons would an animal species NOT cross a *horizontal* land bridge?
A word that means fill it to the required quantity
How do you keep chess fun when your opponent constantly beats you?
How do I free up internal storage if I don't have any apps downloaded?
If I score a critical hit on an 18 or higher, what are my chances of getting a critical hit if I roll 3d20?
What is the most efficient way to store a numeric range?
Does adding complexity mean a more secure cipher?
Will it cause any balance problems to have PCs level up and gain the benefits of a long rest mid-fight?
Why isn't the circumferential light around the M87 black hole's event horizon symmetric?
What information about me do stores get via my credit card?
Can I have a signal generator on while it's not connected?
What do hard-Brexiteers want with respect to the Irish border?
How to notate time signature switching consistently every measure
Why does the nucleus not repel itself?
What is the motivation for a law requiring 2 parties to consent for recording a conversation
Why couldn't they take pictures of a closer black hole?
How to charge AirPods to keep battery healthy?
Is it ethical to upload a automatically generated paper to a non peer-reviewed site as part of a larger research?
Worn-tile Scrabble
Is it ethical to upload a automatically generated paper to a non peer-reviewed site as part of a larger research?
The 2019 Stack Overflow Developer Survey Results Are InPublishing an 'ok paper' to arxivImmature papers on arXivShould I share my course notes with my co-students?Can I submit/ArXiv without my advisor? I am being blocked from publishing my workIs it possible to submit paper to peer-reviewed journal without affiliation?Uploading a preprint with wrong proofsHow to distribute credit in this situation?What degree of borrowing from a Stack Exchange answer and submitting to a peer reviewed journal, without citation, is ethical?Publishing working paper before submission to peer-reviewed journalWhen should researchers who take part in the composition and editing of a manuscript be co-authors
I'm doing some research on my own as a side-project. In fact, I want no one from my research center to be involved in this research as I feel that they will take credit for my idea, like in past times. Nevertheless, if their involvement is completely necessary, I would consider it.
Anyways, this project requires to upload completely nonsense papers to Arxiv or similars. They are completely nonsense as they are artificially generated. The idea is to see if this is possible or how easy it is.
On one hand, I don't want to polute the scientific community with rubbish but in the other hand, I see that this step is necessary to continue further with this research.
My question is, how should I proceed? Should I do it and once I finish my research tell Arxiv that they can delete the files? Should I ask for permission first? Should I not do it at all?
EDIT: Just to make sure that everyone understands, this is not something that I have done yet. In fact, after seeing the responses, it is more than likely that I try to avoid publishing in arXiv. The objective is not to upload a paper to arXiv, is something else, but I was considering uploading it to arXiv as a medium for reaching another goal. Nevertheless, it is not my objectivo to pollute arXiv or the community.
ethics paper-submission arxiv
|
show 5 more comments
I'm doing some research on my own as a side-project. In fact, I want no one from my research center to be involved in this research as I feel that they will take credit for my idea, like in past times. Nevertheless, if their involvement is completely necessary, I would consider it.
Anyways, this project requires to upload completely nonsense papers to Arxiv or similars. They are completely nonsense as they are artificially generated. The idea is to see if this is possible or how easy it is.
On one hand, I don't want to polute the scientific community with rubbish but in the other hand, I see that this step is necessary to continue further with this research.
My question is, how should I proceed? Should I do it and once I finish my research tell Arxiv that they can delete the files? Should I ask for permission first? Should I not do it at all?
EDIT: Just to make sure that everyone understands, this is not something that I have done yet. In fact, after seeing the responses, it is more than likely that I try to avoid publishing in arXiv. The objective is not to upload a paper to arXiv, is something else, but I was considering uploading it to arXiv as a medium for reaching another goal. Nevertheless, it is not my objectivo to pollute arXiv or the community.
ethics paper-submission arxiv
18
Here's a short note from Ginsparg about how arXiv screens (well, screened back in 2014) for fake papers. If you're interested in seeing "how easy it is" to get a paper past the filter (as opposed to more social aspects) arXiv might be interested in collaborating, in order to strengthen their filters.
– Anyon
16 hours ago
9
What are you hoping to learn from this research? What is your hypothesis?
– Buffy
15 hours ago
8
This paper might be of interest. It was reviewed and rated as excellent by this journal.
– Eric Duminil
12 hours ago
4
.... Why spending time on generating automatic rubbish instead of generating automatic valuable content...? As you seem to be a clever person, use it for the good rather than for the bad.
– YYY
12 hours ago
6
@EricDuminil It is an excellent paper. It has a clear abstract and message, crisp and compact, it really manages to get the story across. Its graphics is pertinent, and it makes also clear what the way forward in the future is and it spawned insights beyond its own initial scope. It is a paradigmatic example of clear and unambiguous communication. It is also not significantly compressible by gzip, which means that there is little redundancy. Every line has something new to say. I am sure this is one of the best papers that this journal has ever published.
– Captain Emacs
12 hours ago
|
show 5 more comments
I'm doing some research on my own as a side-project. In fact, I want no one from my research center to be involved in this research as I feel that they will take credit for my idea, like in past times. Nevertheless, if their involvement is completely necessary, I would consider it.
Anyways, this project requires to upload completely nonsense papers to Arxiv or similars. They are completely nonsense as they are artificially generated. The idea is to see if this is possible or how easy it is.
On one hand, I don't want to polute the scientific community with rubbish but in the other hand, I see that this step is necessary to continue further with this research.
My question is, how should I proceed? Should I do it and once I finish my research tell Arxiv that they can delete the files? Should I ask for permission first? Should I not do it at all?
EDIT: Just to make sure that everyone understands, this is not something that I have done yet. In fact, after seeing the responses, it is more than likely that I try to avoid publishing in arXiv. The objective is not to upload a paper to arXiv, is something else, but I was considering uploading it to arXiv as a medium for reaching another goal. Nevertheless, it is not my objectivo to pollute arXiv or the community.
ethics paper-submission arxiv
I'm doing some research on my own as a side-project. In fact, I want no one from my research center to be involved in this research as I feel that they will take credit for my idea, like in past times. Nevertheless, if their involvement is completely necessary, I would consider it.
Anyways, this project requires to upload completely nonsense papers to Arxiv or similars. They are completely nonsense as they are artificially generated. The idea is to see if this is possible or how easy it is.
On one hand, I don't want to polute the scientific community with rubbish but in the other hand, I see that this step is necessary to continue further with this research.
My question is, how should I proceed? Should I do it and once I finish my research tell Arxiv that they can delete the files? Should I ask for permission first? Should I not do it at all?
EDIT: Just to make sure that everyone understands, this is not something that I have done yet. In fact, after seeing the responses, it is more than likely that I try to avoid publishing in arXiv. The objective is not to upload a paper to arXiv, is something else, but I was considering uploading it to arXiv as a medium for reaching another goal. Nevertheless, it is not my objectivo to pollute arXiv or the community.
ethics paper-submission arxiv
ethics paper-submission arxiv
edited 11 hours ago
AnonimousPhD
asked 18 hours ago
AnonimousPhDAnonimousPhD
365136
365136
18
Here's a short note from Ginsparg about how arXiv screens (well, screened back in 2014) for fake papers. If you're interested in seeing "how easy it is" to get a paper past the filter (as opposed to more social aspects) arXiv might be interested in collaborating, in order to strengthen their filters.
– Anyon
16 hours ago
9
What are you hoping to learn from this research? What is your hypothesis?
– Buffy
15 hours ago
8
This paper might be of interest. It was reviewed and rated as excellent by this journal.
– Eric Duminil
12 hours ago
4
.... Why spending time on generating automatic rubbish instead of generating automatic valuable content...? As you seem to be a clever person, use it for the good rather than for the bad.
– YYY
12 hours ago
6
@EricDuminil It is an excellent paper. It has a clear abstract and message, crisp and compact, it really manages to get the story across. Its graphics is pertinent, and it makes also clear what the way forward in the future is and it spawned insights beyond its own initial scope. It is a paradigmatic example of clear and unambiguous communication. It is also not significantly compressible by gzip, which means that there is little redundancy. Every line has something new to say. I am sure this is one of the best papers that this journal has ever published.
– Captain Emacs
12 hours ago
|
show 5 more comments
18
Here's a short note from Ginsparg about how arXiv screens (well, screened back in 2014) for fake papers. If you're interested in seeing "how easy it is" to get a paper past the filter (as opposed to more social aspects) arXiv might be interested in collaborating, in order to strengthen their filters.
– Anyon
16 hours ago
9
What are you hoping to learn from this research? What is your hypothesis?
– Buffy
15 hours ago
8
This paper might be of interest. It was reviewed and rated as excellent by this journal.
– Eric Duminil
12 hours ago
4
.... Why spending time on generating automatic rubbish instead of generating automatic valuable content...? As you seem to be a clever person, use it for the good rather than for the bad.
– YYY
12 hours ago
6
@EricDuminil It is an excellent paper. It has a clear abstract and message, crisp and compact, it really manages to get the story across. Its graphics is pertinent, and it makes also clear what the way forward in the future is and it spawned insights beyond its own initial scope. It is a paradigmatic example of clear and unambiguous communication. It is also not significantly compressible by gzip, which means that there is little redundancy. Every line has something new to say. I am sure this is one of the best papers that this journal has ever published.
– Captain Emacs
12 hours ago
18
18
Here's a short note from Ginsparg about how arXiv screens (well, screened back in 2014) for fake papers. If you're interested in seeing "how easy it is" to get a paper past the filter (as opposed to more social aspects) arXiv might be interested in collaborating, in order to strengthen their filters.
– Anyon
16 hours ago
Here's a short note from Ginsparg about how arXiv screens (well, screened back in 2014) for fake papers. If you're interested in seeing "how easy it is" to get a paper past the filter (as opposed to more social aspects) arXiv might be interested in collaborating, in order to strengthen their filters.
– Anyon
16 hours ago
9
9
What are you hoping to learn from this research? What is your hypothesis?
– Buffy
15 hours ago
What are you hoping to learn from this research? What is your hypothesis?
– Buffy
15 hours ago
8
8
This paper might be of interest. It was reviewed and rated as excellent by this journal.
– Eric Duminil
12 hours ago
This paper might be of interest. It was reviewed and rated as excellent by this journal.
– Eric Duminil
12 hours ago
4
4
.... Why spending time on generating automatic rubbish instead of generating automatic valuable content...? As you seem to be a clever person, use it for the good rather than for the bad.
– YYY
12 hours ago
.... Why spending time on generating automatic rubbish instead of generating automatic valuable content...? As you seem to be a clever person, use it for the good rather than for the bad.
– YYY
12 hours ago
6
6
@EricDuminil It is an excellent paper. It has a clear abstract and message, crisp and compact, it really manages to get the story across. Its graphics is pertinent, and it makes also clear what the way forward in the future is and it spawned insights beyond its own initial scope. It is a paradigmatic example of clear and unambiguous communication. It is also not significantly compressible by gzip, which means that there is little redundancy. Every line has something new to say. I am sure this is one of the best papers that this journal has ever published.
– Captain Emacs
12 hours ago
@EricDuminil It is an excellent paper. It has a clear abstract and message, crisp and compact, it really manages to get the story across. Its graphics is pertinent, and it makes also clear what the way forward in the future is and it spawned insights beyond its own initial scope. It is a paradigmatic example of clear and unambiguous communication. It is also not significantly compressible by gzip, which means that there is little redundancy. Every line has something new to say. I am sure this is one of the best papers that this journal has ever published.
– Captain Emacs
12 hours ago
|
show 5 more comments
3 Answers
3
active
oldest
votes
"Shall I poison a well to see how many drink out of it?"
Frankly, the idea of debunking review processes is not that new, and the latest wave started with the Sokal hoax. There were a couple of follow-ups, with computer-generated papers.
The result was a scandal, a journalistic anecdote. It created attention. Been there, done that. It's no longer an original idea. We got it. You can fool badly screened journals and predatory conferences.
But ok, now, you talk about actual "research" with fake paper dissemination. That may or may not be a legitimate research question, but the fact that you talk about "poisoning" arXiv, which is a serious and expressly not peer-reviewed site makes it already very questionable what you are trying to achieve.
It is one thing to embarrass badly screened journals or conferences (possibly even suspected predatory ones - namely the conferences in question) which Sokal and the SciGen people did, but quite another to abuse a perfectly legitimate repository for non-peer-reviewed papers. In other words, it relies on good will and honesty of the submitters trying to submit good quality work. There are minor safeguards in place to avoid obvious scientific spam, but not against antagonistic submitters.
I do not know (and I do not want to know) what you are trying to achieve with this experiment, but the damage that you are likely to do with this can be so substantial in terms of loss of trust of arXiv and preprint services etc, that you would seriously need to pass it through an ethics committee who can evaluate what legitimate experimental parameters for such a large scale social experiment would be.
Without such a permission and clear delineation of your duties and limitations are which your institution's ethical committee has to evaluate, this research will be unpublishable in a serious journal. And frankly, your academic reputation will be finished. Damaging one of the most valuable resources of openly accessibly publications will make you persona non grata in academia.
Let me add one more thing. There are other preprint servers which have a less strong reputation. There, your experiment may do less damage, though also be less expressive. However, even there, I should believe that they rely on good will and that wilful tainting of wells for scientific knowledge is simply maximally antagonistic to the endeavour of science.
TL;DR: I believe the experiment is highly unethical and extremely damaging. However, you may want to see whether your institution's ethics committee can identify conditions under which such a social experiment might be feasible.
5
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
6
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
add a comment |
Without more information on your goals this is highly suspect. As has been mentioned many times above, the Sokal affair and other similar efforts were designed specifically to show that it is possible to create scientific sounding papers that are accepted, either by legitimate experts in their field (Sokal) or by predatory journals who are in it for the cash. I'm pretty sure a huge number of researchers have, for fun, submitted a BS article to a predatory journal just to see how far they could take it. I know I have, but I've never bothered to pay the fee to get it actually published because, as has been pointed out above, it's been done.
So, to arXiv. arXiv is designed specifically for rapid dissemination of results with the explicit understanding that the papers are not peer reviewed. It's up to the readers to make judgments about the validity and contribution of the papers. From that perspective, you're probably going to end up getting one of three types of responses, depending on the person reading it:
- An expert (or even someone mildly knowledgeable) will see it for what it is and probably ignore it.
- A student who is not an expert but is trying to be will try very hard to read the paper and think they can't understand it because it's too advanced. Most likely this student will give up, or embarrass themselves by asking their advisors or someone else for help. That would be mean on your part but, it's the Internet and not really unexpected.
- Someone from an unrelated field will come upon it, shrug at how different the other field is (thinking they don't understand because it's not their field), and move on.
The real problem I see is the damage done to arXiv, along the lines of "they'll publish anything". However, I'm not convinced that's a bad thing. There are many news articles that reference papers in arXiv as though they are peer reviewed. Researchers using the service get it, but journalists and the general public may not. The big question is whether or not polluting arXiv like this would lead to researchers not using it as much anymore. If you are reasonably sure that won't happen, then your harm is minimized (except for the poor student in point 2 above). On the other hand, if this leads to researchers having a suspicion that arXiv is not useful and they stop disseminating their research on it, that would be a terrible blow.
I think your next step is to perform a comprehensive study of researchers and their opinions on the service, what they think they would do in this situation, and then base your idea on how to proceed off of that.
add a comment |
Any research with human subjects must go through an IRB approval process. I'd expect in this case that the people moderating the arxiv and reading the arxiv would be considered human subjects. Typically a key part of ethical research on human subjects is obtaining informed consent, which is not done in your proposed experiment. I expect it would be difficult to IRB approval for this experiment, but maybe with the right design it is possible. More importantly though, it's unethical and a serious violation of university rules (and rules of most funding agencies) to go ahead with an experiment on human subjects without prior IRB approval.
So ask your IRB, their answer is much more important than the opinion of a bunch of random people on the internet.
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "415"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f127921%2fis-it-ethical-to-upload-a-automatically-generated-paper-to-a-non-peer-reviewed-s%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
3 Answers
3
active
oldest
votes
3 Answers
3
active
oldest
votes
active
oldest
votes
active
oldest
votes
"Shall I poison a well to see how many drink out of it?"
Frankly, the idea of debunking review processes is not that new, and the latest wave started with the Sokal hoax. There were a couple of follow-ups, with computer-generated papers.
The result was a scandal, a journalistic anecdote. It created attention. Been there, done that. It's no longer an original idea. We got it. You can fool badly screened journals and predatory conferences.
But ok, now, you talk about actual "research" with fake paper dissemination. That may or may not be a legitimate research question, but the fact that you talk about "poisoning" arXiv, which is a serious and expressly not peer-reviewed site makes it already very questionable what you are trying to achieve.
It is one thing to embarrass badly screened journals or conferences (possibly even suspected predatory ones - namely the conferences in question) which Sokal and the SciGen people did, but quite another to abuse a perfectly legitimate repository for non-peer-reviewed papers. In other words, it relies on good will and honesty of the submitters trying to submit good quality work. There are minor safeguards in place to avoid obvious scientific spam, but not against antagonistic submitters.
I do not know (and I do not want to know) what you are trying to achieve with this experiment, but the damage that you are likely to do with this can be so substantial in terms of loss of trust of arXiv and preprint services etc, that you would seriously need to pass it through an ethics committee who can evaluate what legitimate experimental parameters for such a large scale social experiment would be.
Without such a permission and clear delineation of your duties and limitations are which your institution's ethical committee has to evaluate, this research will be unpublishable in a serious journal. And frankly, your academic reputation will be finished. Damaging one of the most valuable resources of openly accessibly publications will make you persona non grata in academia.
Let me add one more thing. There are other preprint servers which have a less strong reputation. There, your experiment may do less damage, though also be less expressive. However, even there, I should believe that they rely on good will and that wilful tainting of wells for scientific knowledge is simply maximally antagonistic to the endeavour of science.
TL;DR: I believe the experiment is highly unethical and extremely damaging. However, you may want to see whether your institution's ethics committee can identify conditions under which such a social experiment might be feasible.
5
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
6
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
add a comment |
"Shall I poison a well to see how many drink out of it?"
Frankly, the idea of debunking review processes is not that new, and the latest wave started with the Sokal hoax. There were a couple of follow-ups, with computer-generated papers.
The result was a scandal, a journalistic anecdote. It created attention. Been there, done that. It's no longer an original idea. We got it. You can fool badly screened journals and predatory conferences.
But ok, now, you talk about actual "research" with fake paper dissemination. That may or may not be a legitimate research question, but the fact that you talk about "poisoning" arXiv, which is a serious and expressly not peer-reviewed site makes it already very questionable what you are trying to achieve.
It is one thing to embarrass badly screened journals or conferences (possibly even suspected predatory ones - namely the conferences in question) which Sokal and the SciGen people did, but quite another to abuse a perfectly legitimate repository for non-peer-reviewed papers. In other words, it relies on good will and honesty of the submitters trying to submit good quality work. There are minor safeguards in place to avoid obvious scientific spam, but not against antagonistic submitters.
I do not know (and I do not want to know) what you are trying to achieve with this experiment, but the damage that you are likely to do with this can be so substantial in terms of loss of trust of arXiv and preprint services etc, that you would seriously need to pass it through an ethics committee who can evaluate what legitimate experimental parameters for such a large scale social experiment would be.
Without such a permission and clear delineation of your duties and limitations are which your institution's ethical committee has to evaluate, this research will be unpublishable in a serious journal. And frankly, your academic reputation will be finished. Damaging one of the most valuable resources of openly accessibly publications will make you persona non grata in academia.
Let me add one more thing. There are other preprint servers which have a less strong reputation. There, your experiment may do less damage, though also be less expressive. However, even there, I should believe that they rely on good will and that wilful tainting of wells for scientific knowledge is simply maximally antagonistic to the endeavour of science.
TL;DR: I believe the experiment is highly unethical and extremely damaging. However, you may want to see whether your institution's ethics committee can identify conditions under which such a social experiment might be feasible.
5
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
6
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
add a comment |
"Shall I poison a well to see how many drink out of it?"
Frankly, the idea of debunking review processes is not that new, and the latest wave started with the Sokal hoax. There were a couple of follow-ups, with computer-generated papers.
The result was a scandal, a journalistic anecdote. It created attention. Been there, done that. It's no longer an original idea. We got it. You can fool badly screened journals and predatory conferences.
But ok, now, you talk about actual "research" with fake paper dissemination. That may or may not be a legitimate research question, but the fact that you talk about "poisoning" arXiv, which is a serious and expressly not peer-reviewed site makes it already very questionable what you are trying to achieve.
It is one thing to embarrass badly screened journals or conferences (possibly even suspected predatory ones - namely the conferences in question) which Sokal and the SciGen people did, but quite another to abuse a perfectly legitimate repository for non-peer-reviewed papers. In other words, it relies on good will and honesty of the submitters trying to submit good quality work. There are minor safeguards in place to avoid obvious scientific spam, but not against antagonistic submitters.
I do not know (and I do not want to know) what you are trying to achieve with this experiment, but the damage that you are likely to do with this can be so substantial in terms of loss of trust of arXiv and preprint services etc, that you would seriously need to pass it through an ethics committee who can evaluate what legitimate experimental parameters for such a large scale social experiment would be.
Without such a permission and clear delineation of your duties and limitations are which your institution's ethical committee has to evaluate, this research will be unpublishable in a serious journal. And frankly, your academic reputation will be finished. Damaging one of the most valuable resources of openly accessibly publications will make you persona non grata in academia.
Let me add one more thing. There are other preprint servers which have a less strong reputation. There, your experiment may do less damage, though also be less expressive. However, even there, I should believe that they rely on good will and that wilful tainting of wells for scientific knowledge is simply maximally antagonistic to the endeavour of science.
TL;DR: I believe the experiment is highly unethical and extremely damaging. However, you may want to see whether your institution's ethics committee can identify conditions under which such a social experiment might be feasible.
"Shall I poison a well to see how many drink out of it?"
Frankly, the idea of debunking review processes is not that new, and the latest wave started with the Sokal hoax. There were a couple of follow-ups, with computer-generated papers.
The result was a scandal, a journalistic anecdote. It created attention. Been there, done that. It's no longer an original idea. We got it. You can fool badly screened journals and predatory conferences.
But ok, now, you talk about actual "research" with fake paper dissemination. That may or may not be a legitimate research question, but the fact that you talk about "poisoning" arXiv, which is a serious and expressly not peer-reviewed site makes it already very questionable what you are trying to achieve.
It is one thing to embarrass badly screened journals or conferences (possibly even suspected predatory ones - namely the conferences in question) which Sokal and the SciGen people did, but quite another to abuse a perfectly legitimate repository for non-peer-reviewed papers. In other words, it relies on good will and honesty of the submitters trying to submit good quality work. There are minor safeguards in place to avoid obvious scientific spam, but not against antagonistic submitters.
I do not know (and I do not want to know) what you are trying to achieve with this experiment, but the damage that you are likely to do with this can be so substantial in terms of loss of trust of arXiv and preprint services etc, that you would seriously need to pass it through an ethics committee who can evaluate what legitimate experimental parameters for such a large scale social experiment would be.
Without such a permission and clear delineation of your duties and limitations are which your institution's ethical committee has to evaluate, this research will be unpublishable in a serious journal. And frankly, your academic reputation will be finished. Damaging one of the most valuable resources of openly accessibly publications will make you persona non grata in academia.
Let me add one more thing. There are other preprint servers which have a less strong reputation. There, your experiment may do less damage, though also be less expressive. However, even there, I should believe that they rely on good will and that wilful tainting of wells for scientific knowledge is simply maximally antagonistic to the endeavour of science.
TL;DR: I believe the experiment is highly unethical and extremely damaging. However, you may want to see whether your institution's ethics committee can identify conditions under which such a social experiment might be feasible.
answered 17 hours ago
Captain EmacsCaptain Emacs
23.6k95485
23.6k95485
5
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
6
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
add a comment |
5
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
6
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
5
5
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
First of all, thank you for your answer. The idea is not to see "how many drink from it", it is something that goes further but I'm checking how to do it without damaging Arxiv or the community. In fact, Arxiv was thought to be the tool, no the end result. I will consider how to do this in a different way, if it is going to affect the community so much. Thank you again
– AnonimousPhD
16 hours ago
6
6
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
@AnonimousPhD Ok, I understand. Perhaps better tests can be done in communities where there is an active evaluation model, such as slashdot, reddit, etc.
– Captain Emacs
16 hours ago
add a comment |
Without more information on your goals this is highly suspect. As has been mentioned many times above, the Sokal affair and other similar efforts were designed specifically to show that it is possible to create scientific sounding papers that are accepted, either by legitimate experts in their field (Sokal) or by predatory journals who are in it for the cash. I'm pretty sure a huge number of researchers have, for fun, submitted a BS article to a predatory journal just to see how far they could take it. I know I have, but I've never bothered to pay the fee to get it actually published because, as has been pointed out above, it's been done.
So, to arXiv. arXiv is designed specifically for rapid dissemination of results with the explicit understanding that the papers are not peer reviewed. It's up to the readers to make judgments about the validity and contribution of the papers. From that perspective, you're probably going to end up getting one of three types of responses, depending on the person reading it:
- An expert (or even someone mildly knowledgeable) will see it for what it is and probably ignore it.
- A student who is not an expert but is trying to be will try very hard to read the paper and think they can't understand it because it's too advanced. Most likely this student will give up, or embarrass themselves by asking their advisors or someone else for help. That would be mean on your part but, it's the Internet and not really unexpected.
- Someone from an unrelated field will come upon it, shrug at how different the other field is (thinking they don't understand because it's not their field), and move on.
The real problem I see is the damage done to arXiv, along the lines of "they'll publish anything". However, I'm not convinced that's a bad thing. There are many news articles that reference papers in arXiv as though they are peer reviewed. Researchers using the service get it, but journalists and the general public may not. The big question is whether or not polluting arXiv like this would lead to researchers not using it as much anymore. If you are reasonably sure that won't happen, then your harm is minimized (except for the poor student in point 2 above). On the other hand, if this leads to researchers having a suspicion that arXiv is not useful and they stop disseminating their research on it, that would be a terrible blow.
I think your next step is to perform a comprehensive study of researchers and their opinions on the service, what they think they would do in this situation, and then base your idea on how to proceed off of that.
add a comment |
Without more information on your goals this is highly suspect. As has been mentioned many times above, the Sokal affair and other similar efforts were designed specifically to show that it is possible to create scientific sounding papers that are accepted, either by legitimate experts in their field (Sokal) or by predatory journals who are in it for the cash. I'm pretty sure a huge number of researchers have, for fun, submitted a BS article to a predatory journal just to see how far they could take it. I know I have, but I've never bothered to pay the fee to get it actually published because, as has been pointed out above, it's been done.
So, to arXiv. arXiv is designed specifically for rapid dissemination of results with the explicit understanding that the papers are not peer reviewed. It's up to the readers to make judgments about the validity and contribution of the papers. From that perspective, you're probably going to end up getting one of three types of responses, depending on the person reading it:
- An expert (or even someone mildly knowledgeable) will see it for what it is and probably ignore it.
- A student who is not an expert but is trying to be will try very hard to read the paper and think they can't understand it because it's too advanced. Most likely this student will give up, or embarrass themselves by asking their advisors or someone else for help. That would be mean on your part but, it's the Internet and not really unexpected.
- Someone from an unrelated field will come upon it, shrug at how different the other field is (thinking they don't understand because it's not their field), and move on.
The real problem I see is the damage done to arXiv, along the lines of "they'll publish anything". However, I'm not convinced that's a bad thing. There are many news articles that reference papers in arXiv as though they are peer reviewed. Researchers using the service get it, but journalists and the general public may not. The big question is whether or not polluting arXiv like this would lead to researchers not using it as much anymore. If you are reasonably sure that won't happen, then your harm is minimized (except for the poor student in point 2 above). On the other hand, if this leads to researchers having a suspicion that arXiv is not useful and they stop disseminating their research on it, that would be a terrible blow.
I think your next step is to perform a comprehensive study of researchers and their opinions on the service, what they think they would do in this situation, and then base your idea on how to proceed off of that.
add a comment |
Without more information on your goals this is highly suspect. As has been mentioned many times above, the Sokal affair and other similar efforts were designed specifically to show that it is possible to create scientific sounding papers that are accepted, either by legitimate experts in their field (Sokal) or by predatory journals who are in it for the cash. I'm pretty sure a huge number of researchers have, for fun, submitted a BS article to a predatory journal just to see how far they could take it. I know I have, but I've never bothered to pay the fee to get it actually published because, as has been pointed out above, it's been done.
So, to arXiv. arXiv is designed specifically for rapid dissemination of results with the explicit understanding that the papers are not peer reviewed. It's up to the readers to make judgments about the validity and contribution of the papers. From that perspective, you're probably going to end up getting one of three types of responses, depending on the person reading it:
- An expert (or even someone mildly knowledgeable) will see it for what it is and probably ignore it.
- A student who is not an expert but is trying to be will try very hard to read the paper and think they can't understand it because it's too advanced. Most likely this student will give up, or embarrass themselves by asking their advisors or someone else for help. That would be mean on your part but, it's the Internet and not really unexpected.
- Someone from an unrelated field will come upon it, shrug at how different the other field is (thinking they don't understand because it's not their field), and move on.
The real problem I see is the damage done to arXiv, along the lines of "they'll publish anything". However, I'm not convinced that's a bad thing. There are many news articles that reference papers in arXiv as though they are peer reviewed. Researchers using the service get it, but journalists and the general public may not. The big question is whether or not polluting arXiv like this would lead to researchers not using it as much anymore. If you are reasonably sure that won't happen, then your harm is minimized (except for the poor student in point 2 above). On the other hand, if this leads to researchers having a suspicion that arXiv is not useful and they stop disseminating their research on it, that would be a terrible blow.
I think your next step is to perform a comprehensive study of researchers and their opinions on the service, what they think they would do in this situation, and then base your idea on how to proceed off of that.
Without more information on your goals this is highly suspect. As has been mentioned many times above, the Sokal affair and other similar efforts were designed specifically to show that it is possible to create scientific sounding papers that are accepted, either by legitimate experts in their field (Sokal) or by predatory journals who are in it for the cash. I'm pretty sure a huge number of researchers have, for fun, submitted a BS article to a predatory journal just to see how far they could take it. I know I have, but I've never bothered to pay the fee to get it actually published because, as has been pointed out above, it's been done.
So, to arXiv. arXiv is designed specifically for rapid dissemination of results with the explicit understanding that the papers are not peer reviewed. It's up to the readers to make judgments about the validity and contribution of the papers. From that perspective, you're probably going to end up getting one of three types of responses, depending on the person reading it:
- An expert (or even someone mildly knowledgeable) will see it for what it is and probably ignore it.
- A student who is not an expert but is trying to be will try very hard to read the paper and think they can't understand it because it's too advanced. Most likely this student will give up, or embarrass themselves by asking their advisors or someone else for help. That would be mean on your part but, it's the Internet and not really unexpected.
- Someone from an unrelated field will come upon it, shrug at how different the other field is (thinking they don't understand because it's not their field), and move on.
The real problem I see is the damage done to arXiv, along the lines of "they'll publish anything". However, I'm not convinced that's a bad thing. There are many news articles that reference papers in arXiv as though they are peer reviewed. Researchers using the service get it, but journalists and the general public may not. The big question is whether or not polluting arXiv like this would lead to researchers not using it as much anymore. If you are reasonably sure that won't happen, then your harm is minimized (except for the poor student in point 2 above). On the other hand, if this leads to researchers having a suspicion that arXiv is not useful and they stop disseminating their research on it, that would be a terrible blow.
I think your next step is to perform a comprehensive study of researchers and their opinions on the service, what they think they would do in this situation, and then base your idea on how to proceed off of that.
answered 14 hours ago
Michael StachowskyMichael Stachowsky
2,74511225
2,74511225
add a comment |
add a comment |
Any research with human subjects must go through an IRB approval process. I'd expect in this case that the people moderating the arxiv and reading the arxiv would be considered human subjects. Typically a key part of ethical research on human subjects is obtaining informed consent, which is not done in your proposed experiment. I expect it would be difficult to IRB approval for this experiment, but maybe with the right design it is possible. More importantly though, it's unethical and a serious violation of university rules (and rules of most funding agencies) to go ahead with an experiment on human subjects without prior IRB approval.
So ask your IRB, their answer is much more important than the opinion of a bunch of random people on the internet.
add a comment |
Any research with human subjects must go through an IRB approval process. I'd expect in this case that the people moderating the arxiv and reading the arxiv would be considered human subjects. Typically a key part of ethical research on human subjects is obtaining informed consent, which is not done in your proposed experiment. I expect it would be difficult to IRB approval for this experiment, but maybe with the right design it is possible. More importantly though, it's unethical and a serious violation of university rules (and rules of most funding agencies) to go ahead with an experiment on human subjects without prior IRB approval.
So ask your IRB, their answer is much more important than the opinion of a bunch of random people on the internet.
add a comment |
Any research with human subjects must go through an IRB approval process. I'd expect in this case that the people moderating the arxiv and reading the arxiv would be considered human subjects. Typically a key part of ethical research on human subjects is obtaining informed consent, which is not done in your proposed experiment. I expect it would be difficult to IRB approval for this experiment, but maybe with the right design it is possible. More importantly though, it's unethical and a serious violation of university rules (and rules of most funding agencies) to go ahead with an experiment on human subjects without prior IRB approval.
So ask your IRB, their answer is much more important than the opinion of a bunch of random people on the internet.
Any research with human subjects must go through an IRB approval process. I'd expect in this case that the people moderating the arxiv and reading the arxiv would be considered human subjects. Typically a key part of ethical research on human subjects is obtaining informed consent, which is not done in your proposed experiment. I expect it would be difficult to IRB approval for this experiment, but maybe with the right design it is possible. More importantly though, it's unethical and a serious violation of university rules (and rules of most funding agencies) to go ahead with an experiment on human subjects without prior IRB approval.
So ask your IRB, their answer is much more important than the opinion of a bunch of random people on the internet.
answered 9 hours ago
Noah SnyderNoah Snyder
14.7k13369
14.7k13369
add a comment |
add a comment |
Thanks for contributing an answer to Academia Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f127921%2fis-it-ethical-to-upload-a-automatically-generated-paper-to-a-non-peer-reviewed-s%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
18
Here's a short note from Ginsparg about how arXiv screens (well, screened back in 2014) for fake papers. If you're interested in seeing "how easy it is" to get a paper past the filter (as opposed to more social aspects) arXiv might be interested in collaborating, in order to strengthen their filters.
– Anyon
16 hours ago
9
What are you hoping to learn from this research? What is your hypothesis?
– Buffy
15 hours ago
8
This paper might be of interest. It was reviewed and rated as excellent by this journal.
– Eric Duminil
12 hours ago
4
.... Why spending time on generating automatic rubbish instead of generating automatic valuable content...? As you seem to be a clever person, use it for the good rather than for the bad.
– YYY
12 hours ago
6
@EricDuminil It is an excellent paper. It has a clear abstract and message, crisp and compact, it really manages to get the story across. Its graphics is pertinent, and it makes also clear what the way forward in the future is and it spawned insights beyond its own initial scope. It is a paradigmatic example of clear and unambiguous communication. It is also not significantly compressible by gzip, which means that there is little redundancy. Every line has something new to say. I am sure this is one of the best papers that this journal has ever published.
– Captain Emacs
12 hours ago