How did researchers use to find articles before the Internet and the computer era?API, EULA, and scraping for...
In native German words, is Q always followed by U, as in English?
Being paid less than a "junior" colleague
Why are there so many religions and gods?
Why do I need two parameters in an HTTP parameter pollution attack?
In the context of a differentiator circuit, what is a “current-sensing resistor”?
Symbol for "not absolutely continuous" in Latex
Miss Toad and her frogs
Could human civilization live 150 years in a nuclear-powered aircraft carrier colony without resorting to mass killing/ cannibalism?
Can I ask to speak to my future colleagues before accepting an offer?
What is the difference between handcrafted and learned features
How can I convince my reader that I will not use a certain trope?
"Plugged in" or "Plugged in in"
How did researchers use to find articles before the Internet and the computer era?
Why do user defined scalar functions require the schema?
Can Access Fault Exceptions of the MC68040 caused by internal access faults occur in normal situations?
What is a macro? Difference between macro and function?
How hard is it to sell a home which is currently mortgaged?
Java Optional working of orElse is not as if else
Does the Pi 4 resolve the Ethernet+USB bottleneck issue of past versions?
Details of video memory access arbitration in Space Invaders
How exactly is a normal force exerted, at the molecular level?
Can another character physically take something that Mage Hand is carrying/holding?
What is the difference between x RadToDeg cos x div and COSC?
Which resurrection spells are valid to use with the Zealot's 'Warrior of the Gods' Feature?
How did researchers use to find articles before the Internet and the computer era?
API, EULA, and scraping for Google ScholarIs it necessary to show what improvements you have made to similar work in literature reviews section?How do you keep track of papers during a brainstorming literature review?What do mathematics researchers do if they aren't good?How to find the right balance between details and the main ideas?How to obtain the files created by previous university researchers, both legally and physically?How often do academic researchers use inferior tools for their research, when clearly better tools exist but are too difficult to use?A research validity issue and a work aroundWhat strategies are there for finding literature for a literature survey when the terminology used is diverse?Tips for literature search
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
I find it hard to write the literature review while I have Google, the Internet, and all free very easy to search for information tools.
I have to search for days to find a piece of information that related to my research.
I really would not be able to do that without the Internet and the technology help.
This really makes me wonder how people in the past did that:
Did they have to read the entire book to find a piece of information?
I know they might have used the index, but still this wouldn’t have given them the details of what they were looking for.Does that mean people in the past (before the Internet) worked harder to achieve their degrees?
Does that mean that research before relied less on references?
research-process literature-search history
add a comment |
I find it hard to write the literature review while I have Google, the Internet, and all free very easy to search for information tools.
I have to search for days to find a piece of information that related to my research.
I really would not be able to do that without the Internet and the technology help.
This really makes me wonder how people in the past did that:
Did they have to read the entire book to find a piece of information?
I know they might have used the index, but still this wouldn’t have given them the details of what they were looking for.Does that mean people in the past (before the Internet) worked harder to achieve their degrees?
Does that mean that research before relied less on references?
research-process literature-search history
3
Often enough, they didn't :) Lots of stuff used to get rediscovered again and again by different groups. Long bibliographies are rare in 1950s' papers.
– darij grinberg
12 hours ago
Great question! I could not even imagine those days.
– Eilia
10 hours ago
add a comment |
I find it hard to write the literature review while I have Google, the Internet, and all free very easy to search for information tools.
I have to search for days to find a piece of information that related to my research.
I really would not be able to do that without the Internet and the technology help.
This really makes me wonder how people in the past did that:
Did they have to read the entire book to find a piece of information?
I know they might have used the index, but still this wouldn’t have given them the details of what they were looking for.Does that mean people in the past (before the Internet) worked harder to achieve their degrees?
Does that mean that research before relied less on references?
research-process literature-search history
I find it hard to write the literature review while I have Google, the Internet, and all free very easy to search for information tools.
I have to search for days to find a piece of information that related to my research.
I really would not be able to do that without the Internet and the technology help.
This really makes me wonder how people in the past did that:
Did they have to read the entire book to find a piece of information?
I know they might have used the index, but still this wouldn’t have given them the details of what they were looking for.Does that mean people in the past (before the Internet) worked harder to achieve their degrees?
Does that mean that research before relied less on references?
research-process literature-search history
research-process literature-search history
edited 1 hour ago
Laurel
4815 silver badges12 bronze badges
4815 silver badges12 bronze badges
asked 12 hours ago
asmgxasmgx
3041 silver badge10 bronze badges
3041 silver badge10 bronze badges
3
Often enough, they didn't :) Lots of stuff used to get rediscovered again and again by different groups. Long bibliographies are rare in 1950s' papers.
– darij grinberg
12 hours ago
Great question! I could not even imagine those days.
– Eilia
10 hours ago
add a comment |
3
Often enough, they didn't :) Lots of stuff used to get rediscovered again and again by different groups. Long bibliographies are rare in 1950s' papers.
– darij grinberg
12 hours ago
Great question! I could not even imagine those days.
– Eilia
10 hours ago
3
3
Often enough, they didn't :) Lots of stuff used to get rediscovered again and again by different groups. Long bibliographies are rare in 1950s' papers.
– darij grinberg
12 hours ago
Often enough, they didn't :) Lots of stuff used to get rediscovered again and again by different groups. Long bibliographies are rare in 1950s' papers.
– darij grinberg
12 hours ago
Great question! I could not even imagine those days.
– Eilia
10 hours ago
Great question! I could not even imagine those days.
– Eilia
10 hours ago
add a comment |
4 Answers
4
active
oldest
votes
We depended on libraries and librarians. Grad students would spend hours in, say, the math section of a good academic library, going from book to book and taking copious notes (on paper, of course).
But, often enough, the next paper we needed to look at wasn't in that library at all, so you would go to the librarian and ask for a loan of the resource from another library.
But it was also an important technique to use the librarian as a 'knowledge expert' who could, and would, suggest things for you to look at and places to look. I don't know if librarians still get the training to do that.
And, of course, you could ask your colleagues for hints about which rocks to uncover to find the gems.
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
9
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
1
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
add a comment |
(Comment extended to post:)
My impression is that part of the answer is "they didn't", or more precisely "they were only as good at it as their own knowledge and that of their communities". In particular, at least anecdotally, many things in mathematics were discovered in parallel for lack of easy communication and inter-visibility. [This is complementary to @Buffy's answer, which explains why people found anything at all.]
I have tried to put this on solid footing by comparing numbers of references in a 1970 issue of a mathematical journal vs. in a 2019 issue of the same journal. This turned out to be surprisingly nontrivial. Firstly, it's not clear if I am comparing apples to apples, since most journals have changed their publication criteria and sometimes even their (implicit) subject within these 49 years. Secondly, papers in almost every part of mathematics have gotten much longer (by a factor of 2.8 in my sample). Thirdly, empirically, Project Euclid bans your IP if you load more than about 20 PDFs in rapid succession, and Sci-Hub is slow and has captchas. There might be a way to do such research using MathSciNet, but I am nowhere near proficient enough at its use.
So I ended up comparing Proceedings of the AMS (due to their long back-catalog of freely accessible issues), and came up with this ("reference" means "bibliography item", not "place where a bibliography item is being cited"):
I picked 13 of the papers from Proc. AMS 141 (2019) #12 (more or less picking the first 13, except I skipped a few from the Abhyankar cluster since he writes and cites in rather idiosyncratic ways). The average paper has 1.5 references per page:

I picked 13 of the papers from Proc. AMS 24 (1970) #1. The average paper has 1.2 references per page:

Should we really compare references per page? There are good reasons to assume that the number of references per page should decrease as papers get longer, since the references cited in Section 1 won't normally be disjoint from the references cited in Section 2. As a consequence, the discrepancy between the above numbers looks even starker.
I can only explain this discrepancy in two ways:
the literature has grown much larger, and not just by the addition of new disciplines but also by more people writing about the same discipline;
(as the OP observed) finding relevant references in the literature has gotten easier thanks to the Internet, Google Scholar, etc.
I don't know how to properly disentangle these two causes.
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
add a comment |
It was a LOT harder before the internet. Time traveling to and from the information source is eliminated by instant transmission of data. If people were lucky enough to be able to spend long stretches of time in a library, the amount of information they could find was, for those days, a "lot." There were these things called "card catalogs." They were furniture, basically, in which long, little drawers were kept, and the drawers were organized by subject, and inside each drawer were hundreds of little cards, and you'd find information about one individual book on each of these cards and determine if you wanted to go walk sometimes long distances and up elevators or stairs to "the stacks" (where the books were) to find this particular book or not. (Google Dewey Decimal System.) You'd write down the ID info about all these books onto what would often become long lists. Then you'd go to another part of the library, where the books were ("the stacks") and pull books, many of them hardbound, off of shelves. Lots and lots of books sometimes. Yes, they'd actually read "the whole book"!!! (Couldn't help but laugh hard at that question.) And sometimes not. And they'd underline sections in pencil (and ink, unfortunately), and place books face down with pages open to pages they needed to look at as their hands went to and from the typewriter, and they'd put bookmarks in between pages in an effort to be able to go back to references and material they wanted to put into the project they were working on, as they attempted to create an effective structure without Select, Copy, Cut, Paste. If they couldn't type, they'd write it out by hand on pads of paper, and cut paragraphs and sentences with scissors (I"m not making this up) out of one section so they could rearrange the sequence of their text by taping it and gluing it to other cut-up pieces. (Google the word "mucilage.") Before this stuff called WhiteOut was invented (by a mom, apparently, with stuff in her kitchen), typists had no way to correct an error on a page; they'd have to start the entire page over again. The invention of the IBM Selectric typewriter was revolutionary and a gift from heaven because you could correct backwardsly about 12 spaces. You could check books out with a library card, and you had to return them usually within two weeks or pay a small fine. And if you didn't return the book, you had to pay for the book. (One of the many good things that broke down in the social decay of the last few decades was that people started stealing books from libraries, something nobody ever did before.) Some libraries had little tiny rooms (e.g. New York City) that they'd let serious researchers use privately for months. And they could get "a lot" (by the standards of the day) done. But it was a small fraction of what you can get done now. Someday, when you're in your 60s or so, a young person is going to ask a question that will make you laugh because you can't believe things have changed so much that young people don't know what something used to be like. It was a LOT, LOT, LOT harder to get a degree, build a business, make almost anything... than it is now. I mean A LOT LOT HARDER.
they
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
Although I haven't really known this time myself, I think it's important to mention the much more crucial role that conferences and journals used to play in the dissemination of specialized knowledge. A researcher would usually try to attend the conferences of their field and get their local library to subscribe to the relevant journals in order to keep up to date with what people are doing in their research community.
At the time researchers would preciously keep these massive conference proceedings whenever they attend a conference. I know a few senior researchers who still have their offices shelves full of old proceedings and journal issues. In order to keep up one had to follow the series of conferences/journals relevant to their field, but it was feasible because there were not as many publications (and publication venues) as nowadays. They didn't have to read the entire volume but at least they would read the most important publications and make a note of potentially relevant ones. To some extent they relied less on references indeed, and they relied more on the reputation of a journal or conference to cover the recent progress of the field.
The question of whether they worked harder is subjective. The nature of bibliographical work was different and certainly more time-consuming, but researchers were not expected to process more than what is humanly possible: overall the research system was proportionate to the technical constraints. Like for many things, I think that people used to make more out of fewer resources: exploiting the resources they had access to in a deeper and more extensive way, whereas nowadays we often can only afford to skim through the massive amount of literature... I could keep rambling about disposable research but that would be very subjective and out of topic ;)
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "415"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f132376%2fhow-did-researchers-use-to-find-articles-before-the-internet-and-the-computer-er%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
4 Answers
4
active
oldest
votes
4 Answers
4
active
oldest
votes
active
oldest
votes
active
oldest
votes
We depended on libraries and librarians. Grad students would spend hours in, say, the math section of a good academic library, going from book to book and taking copious notes (on paper, of course).
But, often enough, the next paper we needed to look at wasn't in that library at all, so you would go to the librarian and ask for a loan of the resource from another library.
But it was also an important technique to use the librarian as a 'knowledge expert' who could, and would, suggest things for you to look at and places to look. I don't know if librarians still get the training to do that.
And, of course, you could ask your colleagues for hints about which rocks to uncover to find the gems.
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
9
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
1
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
add a comment |
We depended on libraries and librarians. Grad students would spend hours in, say, the math section of a good academic library, going from book to book and taking copious notes (on paper, of course).
But, often enough, the next paper we needed to look at wasn't in that library at all, so you would go to the librarian and ask for a loan of the resource from another library.
But it was also an important technique to use the librarian as a 'knowledge expert' who could, and would, suggest things for you to look at and places to look. I don't know if librarians still get the training to do that.
And, of course, you could ask your colleagues for hints about which rocks to uncover to find the gems.
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
9
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
1
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
add a comment |
We depended on libraries and librarians. Grad students would spend hours in, say, the math section of a good academic library, going from book to book and taking copious notes (on paper, of course).
But, often enough, the next paper we needed to look at wasn't in that library at all, so you would go to the librarian and ask for a loan of the resource from another library.
But it was also an important technique to use the librarian as a 'knowledge expert' who could, and would, suggest things for you to look at and places to look. I don't know if librarians still get the training to do that.
And, of course, you could ask your colleagues for hints about which rocks to uncover to find the gems.
We depended on libraries and librarians. Grad students would spend hours in, say, the math section of a good academic library, going from book to book and taking copious notes (on paper, of course).
But, often enough, the next paper we needed to look at wasn't in that library at all, so you would go to the librarian and ask for a loan of the resource from another library.
But it was also an important technique to use the librarian as a 'knowledge expert' who could, and would, suggest things for you to look at and places to look. I don't know if librarians still get the training to do that.
And, of course, you could ask your colleagues for hints about which rocks to uncover to find the gems.
answered 12 hours ago
BuffyBuffy
69.7k18 gold badges210 silver badges319 bronze badges
69.7k18 gold badges210 silver badges319 bronze badges
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
9
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
1
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
add a comment |
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
9
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
1
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
In physics/engineering we had the Citation Index to look through - kind of like the Web of Science on paper (and not as up to date, but you knew the people working in your area).
– Jon Custer
11 hours ago
9
9
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
When I needed to access papers I started by collecting coins. Some went to feed a parking meter. The photocopy machines got most of them.
– Patricia Shanahan
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
@PatriciaShanahan, I was lucky to be on a campus with free parking (or to live close to the library) but unlucky to have studied before photocopy machines existed. So, no coins required.
– Buffy
11 hours ago
1
1
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
I made good use of the interlibrary loan system - even though the uni I was at had a very good engineering library, I was after books by Judge, Ricardo, Cummins etc all famous names then and still now... oh, and most important : we could read... I ask students which books they have read and most come back with “I only read the condensed version”...
– Solar Mike
7 hours ago
add a comment |
(Comment extended to post:)
My impression is that part of the answer is "they didn't", or more precisely "they were only as good at it as their own knowledge and that of their communities". In particular, at least anecdotally, many things in mathematics were discovered in parallel for lack of easy communication and inter-visibility. [This is complementary to @Buffy's answer, which explains why people found anything at all.]
I have tried to put this on solid footing by comparing numbers of references in a 1970 issue of a mathematical journal vs. in a 2019 issue of the same journal. This turned out to be surprisingly nontrivial. Firstly, it's not clear if I am comparing apples to apples, since most journals have changed their publication criteria and sometimes even their (implicit) subject within these 49 years. Secondly, papers in almost every part of mathematics have gotten much longer (by a factor of 2.8 in my sample). Thirdly, empirically, Project Euclid bans your IP if you load more than about 20 PDFs in rapid succession, and Sci-Hub is slow and has captchas. There might be a way to do such research using MathSciNet, but I am nowhere near proficient enough at its use.
So I ended up comparing Proceedings of the AMS (due to their long back-catalog of freely accessible issues), and came up with this ("reference" means "bibliography item", not "place where a bibliography item is being cited"):
I picked 13 of the papers from Proc. AMS 141 (2019) #12 (more or less picking the first 13, except I skipped a few from the Abhyankar cluster since he writes and cites in rather idiosyncratic ways). The average paper has 1.5 references per page:

I picked 13 of the papers from Proc. AMS 24 (1970) #1. The average paper has 1.2 references per page:

Should we really compare references per page? There are good reasons to assume that the number of references per page should decrease as papers get longer, since the references cited in Section 1 won't normally be disjoint from the references cited in Section 2. As a consequence, the discrepancy between the above numbers looks even starker.
I can only explain this discrepancy in two ways:
the literature has grown much larger, and not just by the addition of new disciplines but also by more people writing about the same discipline;
(as the OP observed) finding relevant references in the literature has gotten easier thanks to the Internet, Google Scholar, etc.
I don't know how to properly disentangle these two causes.
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
add a comment |
(Comment extended to post:)
My impression is that part of the answer is "they didn't", or more precisely "they were only as good at it as their own knowledge and that of their communities". In particular, at least anecdotally, many things in mathematics were discovered in parallel for lack of easy communication and inter-visibility. [This is complementary to @Buffy's answer, which explains why people found anything at all.]
I have tried to put this on solid footing by comparing numbers of references in a 1970 issue of a mathematical journal vs. in a 2019 issue of the same journal. This turned out to be surprisingly nontrivial. Firstly, it's not clear if I am comparing apples to apples, since most journals have changed their publication criteria and sometimes even their (implicit) subject within these 49 years. Secondly, papers in almost every part of mathematics have gotten much longer (by a factor of 2.8 in my sample). Thirdly, empirically, Project Euclid bans your IP if you load more than about 20 PDFs in rapid succession, and Sci-Hub is slow and has captchas. There might be a way to do such research using MathSciNet, but I am nowhere near proficient enough at its use.
So I ended up comparing Proceedings of the AMS (due to their long back-catalog of freely accessible issues), and came up with this ("reference" means "bibliography item", not "place where a bibliography item is being cited"):
I picked 13 of the papers from Proc. AMS 141 (2019) #12 (more or less picking the first 13, except I skipped a few from the Abhyankar cluster since he writes and cites in rather idiosyncratic ways). The average paper has 1.5 references per page:

I picked 13 of the papers from Proc. AMS 24 (1970) #1. The average paper has 1.2 references per page:

Should we really compare references per page? There are good reasons to assume that the number of references per page should decrease as papers get longer, since the references cited in Section 1 won't normally be disjoint from the references cited in Section 2. As a consequence, the discrepancy between the above numbers looks even starker.
I can only explain this discrepancy in two ways:
the literature has grown much larger, and not just by the addition of new disciplines but also by more people writing about the same discipline;
(as the OP observed) finding relevant references in the literature has gotten easier thanks to the Internet, Google Scholar, etc.
I don't know how to properly disentangle these two causes.
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
add a comment |
(Comment extended to post:)
My impression is that part of the answer is "they didn't", or more precisely "they were only as good at it as their own knowledge and that of their communities". In particular, at least anecdotally, many things in mathematics were discovered in parallel for lack of easy communication and inter-visibility. [This is complementary to @Buffy's answer, which explains why people found anything at all.]
I have tried to put this on solid footing by comparing numbers of references in a 1970 issue of a mathematical journal vs. in a 2019 issue of the same journal. This turned out to be surprisingly nontrivial. Firstly, it's not clear if I am comparing apples to apples, since most journals have changed their publication criteria and sometimes even their (implicit) subject within these 49 years. Secondly, papers in almost every part of mathematics have gotten much longer (by a factor of 2.8 in my sample). Thirdly, empirically, Project Euclid bans your IP if you load more than about 20 PDFs in rapid succession, and Sci-Hub is slow and has captchas. There might be a way to do such research using MathSciNet, but I am nowhere near proficient enough at its use.
So I ended up comparing Proceedings of the AMS (due to their long back-catalog of freely accessible issues), and came up with this ("reference" means "bibliography item", not "place where a bibliography item is being cited"):
I picked 13 of the papers from Proc. AMS 141 (2019) #12 (more or less picking the first 13, except I skipped a few from the Abhyankar cluster since he writes and cites in rather idiosyncratic ways). The average paper has 1.5 references per page:

I picked 13 of the papers from Proc. AMS 24 (1970) #1. The average paper has 1.2 references per page:

Should we really compare references per page? There are good reasons to assume that the number of references per page should decrease as papers get longer, since the references cited in Section 1 won't normally be disjoint from the references cited in Section 2. As a consequence, the discrepancy between the above numbers looks even starker.
I can only explain this discrepancy in two ways:
the literature has grown much larger, and not just by the addition of new disciplines but also by more people writing about the same discipline;
(as the OP observed) finding relevant references in the literature has gotten easier thanks to the Internet, Google Scholar, etc.
I don't know how to properly disentangle these two causes.
(Comment extended to post:)
My impression is that part of the answer is "they didn't", or more precisely "they were only as good at it as their own knowledge and that of their communities". In particular, at least anecdotally, many things in mathematics were discovered in parallel for lack of easy communication and inter-visibility. [This is complementary to @Buffy's answer, which explains why people found anything at all.]
I have tried to put this on solid footing by comparing numbers of references in a 1970 issue of a mathematical journal vs. in a 2019 issue of the same journal. This turned out to be surprisingly nontrivial. Firstly, it's not clear if I am comparing apples to apples, since most journals have changed their publication criteria and sometimes even their (implicit) subject within these 49 years. Secondly, papers in almost every part of mathematics have gotten much longer (by a factor of 2.8 in my sample). Thirdly, empirically, Project Euclid bans your IP if you load more than about 20 PDFs in rapid succession, and Sci-Hub is slow and has captchas. There might be a way to do such research using MathSciNet, but I am nowhere near proficient enough at its use.
So I ended up comparing Proceedings of the AMS (due to their long back-catalog of freely accessible issues), and came up with this ("reference" means "bibliography item", not "place where a bibliography item is being cited"):
I picked 13 of the papers from Proc. AMS 141 (2019) #12 (more or less picking the first 13, except I skipped a few from the Abhyankar cluster since he writes and cites in rather idiosyncratic ways). The average paper has 1.5 references per page:

I picked 13 of the papers from Proc. AMS 24 (1970) #1. The average paper has 1.2 references per page:

Should we really compare references per page? There are good reasons to assume that the number of references per page should decrease as papers get longer, since the references cited in Section 1 won't normally be disjoint from the references cited in Section 2. As a consequence, the discrepancy between the above numbers looks even starker.
I can only explain this discrepancy in two ways:
the literature has grown much larger, and not just by the addition of new disciplines but also by more people writing about the same discipline;
(as the OP observed) finding relevant references in the literature has gotten easier thanks to the Internet, Google Scholar, etc.
I don't know how to properly disentangle these two causes.
edited 2 hours ago
Laurel
4815 silver badges12 bronze badges
4815 silver badges12 bronze badges
answered 11 hours ago
darij grinbergdarij grinberg
3,2311 gold badge12 silver badges25 bronze badges
3,2311 gold badge12 silver badges25 bronze badges
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
add a comment |
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
Thanks @Laurel for the improvements!
– darij grinberg
1 hour ago
add a comment |
It was a LOT harder before the internet. Time traveling to and from the information source is eliminated by instant transmission of data. If people were lucky enough to be able to spend long stretches of time in a library, the amount of information they could find was, for those days, a "lot." There were these things called "card catalogs." They were furniture, basically, in which long, little drawers were kept, and the drawers were organized by subject, and inside each drawer were hundreds of little cards, and you'd find information about one individual book on each of these cards and determine if you wanted to go walk sometimes long distances and up elevators or stairs to "the stacks" (where the books were) to find this particular book or not. (Google Dewey Decimal System.) You'd write down the ID info about all these books onto what would often become long lists. Then you'd go to another part of the library, where the books were ("the stacks") and pull books, many of them hardbound, off of shelves. Lots and lots of books sometimes. Yes, they'd actually read "the whole book"!!! (Couldn't help but laugh hard at that question.) And sometimes not. And they'd underline sections in pencil (and ink, unfortunately), and place books face down with pages open to pages they needed to look at as their hands went to and from the typewriter, and they'd put bookmarks in between pages in an effort to be able to go back to references and material they wanted to put into the project they were working on, as they attempted to create an effective structure without Select, Copy, Cut, Paste. If they couldn't type, they'd write it out by hand on pads of paper, and cut paragraphs and sentences with scissors (I"m not making this up) out of one section so they could rearrange the sequence of their text by taping it and gluing it to other cut-up pieces. (Google the word "mucilage.") Before this stuff called WhiteOut was invented (by a mom, apparently, with stuff in her kitchen), typists had no way to correct an error on a page; they'd have to start the entire page over again. The invention of the IBM Selectric typewriter was revolutionary and a gift from heaven because you could correct backwardsly about 12 spaces. You could check books out with a library card, and you had to return them usually within two weeks or pay a small fine. And if you didn't return the book, you had to pay for the book. (One of the many good things that broke down in the social decay of the last few decades was that people started stealing books from libraries, something nobody ever did before.) Some libraries had little tiny rooms (e.g. New York City) that they'd let serious researchers use privately for months. And they could get "a lot" (by the standards of the day) done. But it was a small fraction of what you can get done now. Someday, when you're in your 60s or so, a young person is going to ask a question that will make you laugh because you can't believe things have changed so much that young people don't know what something used to be like. It was a LOT, LOT, LOT harder to get a degree, build a business, make almost anything... than it is now. I mean A LOT LOT HARDER.
they
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
It was a LOT harder before the internet. Time traveling to and from the information source is eliminated by instant transmission of data. If people were lucky enough to be able to spend long stretches of time in a library, the amount of information they could find was, for those days, a "lot." There were these things called "card catalogs." They were furniture, basically, in which long, little drawers were kept, and the drawers were organized by subject, and inside each drawer were hundreds of little cards, and you'd find information about one individual book on each of these cards and determine if you wanted to go walk sometimes long distances and up elevators or stairs to "the stacks" (where the books were) to find this particular book or not. (Google Dewey Decimal System.) You'd write down the ID info about all these books onto what would often become long lists. Then you'd go to another part of the library, where the books were ("the stacks") and pull books, many of them hardbound, off of shelves. Lots and lots of books sometimes. Yes, they'd actually read "the whole book"!!! (Couldn't help but laugh hard at that question.) And sometimes not. And they'd underline sections in pencil (and ink, unfortunately), and place books face down with pages open to pages they needed to look at as their hands went to and from the typewriter, and they'd put bookmarks in between pages in an effort to be able to go back to references and material they wanted to put into the project they were working on, as they attempted to create an effective structure without Select, Copy, Cut, Paste. If they couldn't type, they'd write it out by hand on pads of paper, and cut paragraphs and sentences with scissors (I"m not making this up) out of one section so they could rearrange the sequence of their text by taping it and gluing it to other cut-up pieces. (Google the word "mucilage.") Before this stuff called WhiteOut was invented (by a mom, apparently, with stuff in her kitchen), typists had no way to correct an error on a page; they'd have to start the entire page over again. The invention of the IBM Selectric typewriter was revolutionary and a gift from heaven because you could correct backwardsly about 12 spaces. You could check books out with a library card, and you had to return them usually within two weeks or pay a small fine. And if you didn't return the book, you had to pay for the book. (One of the many good things that broke down in the social decay of the last few decades was that people started stealing books from libraries, something nobody ever did before.) Some libraries had little tiny rooms (e.g. New York City) that they'd let serious researchers use privately for months. And they could get "a lot" (by the standards of the day) done. But it was a small fraction of what you can get done now. Someday, when you're in your 60s or so, a young person is going to ask a question that will make you laugh because you can't believe things have changed so much that young people don't know what something used to be like. It was a LOT, LOT, LOT harder to get a degree, build a business, make almost anything... than it is now. I mean A LOT LOT HARDER.
they
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
It was a LOT harder before the internet. Time traveling to and from the information source is eliminated by instant transmission of data. If people were lucky enough to be able to spend long stretches of time in a library, the amount of information they could find was, for those days, a "lot." There were these things called "card catalogs." They were furniture, basically, in which long, little drawers were kept, and the drawers were organized by subject, and inside each drawer were hundreds of little cards, and you'd find information about one individual book on each of these cards and determine if you wanted to go walk sometimes long distances and up elevators or stairs to "the stacks" (where the books were) to find this particular book or not. (Google Dewey Decimal System.) You'd write down the ID info about all these books onto what would often become long lists. Then you'd go to another part of the library, where the books were ("the stacks") and pull books, many of them hardbound, off of shelves. Lots and lots of books sometimes. Yes, they'd actually read "the whole book"!!! (Couldn't help but laugh hard at that question.) And sometimes not. And they'd underline sections in pencil (and ink, unfortunately), and place books face down with pages open to pages they needed to look at as their hands went to and from the typewriter, and they'd put bookmarks in between pages in an effort to be able to go back to references and material they wanted to put into the project they were working on, as they attempted to create an effective structure without Select, Copy, Cut, Paste. If they couldn't type, they'd write it out by hand on pads of paper, and cut paragraphs and sentences with scissors (I"m not making this up) out of one section so they could rearrange the sequence of their text by taping it and gluing it to other cut-up pieces. (Google the word "mucilage.") Before this stuff called WhiteOut was invented (by a mom, apparently, with stuff in her kitchen), typists had no way to correct an error on a page; they'd have to start the entire page over again. The invention of the IBM Selectric typewriter was revolutionary and a gift from heaven because you could correct backwardsly about 12 spaces. You could check books out with a library card, and you had to return them usually within two weeks or pay a small fine. And if you didn't return the book, you had to pay for the book. (One of the many good things that broke down in the social decay of the last few decades was that people started stealing books from libraries, something nobody ever did before.) Some libraries had little tiny rooms (e.g. New York City) that they'd let serious researchers use privately for months. And they could get "a lot" (by the standards of the day) done. But it was a small fraction of what you can get done now. Someday, when you're in your 60s or so, a young person is going to ask a question that will make you laugh because you can't believe things have changed so much that young people don't know what something used to be like. It was a LOT, LOT, LOT harder to get a degree, build a business, make almost anything... than it is now. I mean A LOT LOT HARDER.
they
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
It was a LOT harder before the internet. Time traveling to and from the information source is eliminated by instant transmission of data. If people were lucky enough to be able to spend long stretches of time in a library, the amount of information they could find was, for those days, a "lot." There were these things called "card catalogs." They were furniture, basically, in which long, little drawers were kept, and the drawers were organized by subject, and inside each drawer were hundreds of little cards, and you'd find information about one individual book on each of these cards and determine if you wanted to go walk sometimes long distances and up elevators or stairs to "the stacks" (where the books were) to find this particular book or not. (Google Dewey Decimal System.) You'd write down the ID info about all these books onto what would often become long lists. Then you'd go to another part of the library, where the books were ("the stacks") and pull books, many of them hardbound, off of shelves. Lots and lots of books sometimes. Yes, they'd actually read "the whole book"!!! (Couldn't help but laugh hard at that question.) And sometimes not. And they'd underline sections in pencil (and ink, unfortunately), and place books face down with pages open to pages they needed to look at as their hands went to and from the typewriter, and they'd put bookmarks in between pages in an effort to be able to go back to references and material they wanted to put into the project they were working on, as they attempted to create an effective structure without Select, Copy, Cut, Paste. If they couldn't type, they'd write it out by hand on pads of paper, and cut paragraphs and sentences with scissors (I"m not making this up) out of one section so they could rearrange the sequence of their text by taping it and gluing it to other cut-up pieces. (Google the word "mucilage.") Before this stuff called WhiteOut was invented (by a mom, apparently, with stuff in her kitchen), typists had no way to correct an error on a page; they'd have to start the entire page over again. The invention of the IBM Selectric typewriter was revolutionary and a gift from heaven because you could correct backwardsly about 12 spaces. You could check books out with a library card, and you had to return them usually within two weeks or pay a small fine. And if you didn't return the book, you had to pay for the book. (One of the many good things that broke down in the social decay of the last few decades was that people started stealing books from libraries, something nobody ever did before.) Some libraries had little tiny rooms (e.g. New York City) that they'd let serious researchers use privately for months. And they could get "a lot" (by the standards of the day) done. But it was a small fraction of what you can get done now. Someday, when you're in your 60s or so, a young person is going to ask a question that will make you laugh because you can't believe things have changed so much that young people don't know what something used to be like. It was a LOT, LOT, LOT harder to get a degree, build a business, make almost anything... than it is now. I mean A LOT LOT HARDER.
they
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
answered 1 hour ago
user110183user110183
311 bronze badge
311 bronze badge
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
user110183 is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
Although I haven't really known this time myself, I think it's important to mention the much more crucial role that conferences and journals used to play in the dissemination of specialized knowledge. A researcher would usually try to attend the conferences of their field and get their local library to subscribe to the relevant journals in order to keep up to date with what people are doing in their research community.
At the time researchers would preciously keep these massive conference proceedings whenever they attend a conference. I know a few senior researchers who still have their offices shelves full of old proceedings and journal issues. In order to keep up one had to follow the series of conferences/journals relevant to their field, but it was feasible because there were not as many publications (and publication venues) as nowadays. They didn't have to read the entire volume but at least they would read the most important publications and make a note of potentially relevant ones. To some extent they relied less on references indeed, and they relied more on the reputation of a journal or conference to cover the recent progress of the field.
The question of whether they worked harder is subjective. The nature of bibliographical work was different and certainly more time-consuming, but researchers were not expected to process more than what is humanly possible: overall the research system was proportionate to the technical constraints. Like for many things, I think that people used to make more out of fewer resources: exploiting the resources they had access to in a deeper and more extensive way, whereas nowadays we often can only afford to skim through the massive amount of literature... I could keep rambling about disposable research but that would be very subjective and out of topic ;)
add a comment |
Although I haven't really known this time myself, I think it's important to mention the much more crucial role that conferences and journals used to play in the dissemination of specialized knowledge. A researcher would usually try to attend the conferences of their field and get their local library to subscribe to the relevant journals in order to keep up to date with what people are doing in their research community.
At the time researchers would preciously keep these massive conference proceedings whenever they attend a conference. I know a few senior researchers who still have their offices shelves full of old proceedings and journal issues. In order to keep up one had to follow the series of conferences/journals relevant to their field, but it was feasible because there were not as many publications (and publication venues) as nowadays. They didn't have to read the entire volume but at least they would read the most important publications and make a note of potentially relevant ones. To some extent they relied less on references indeed, and they relied more on the reputation of a journal or conference to cover the recent progress of the field.
The question of whether they worked harder is subjective. The nature of bibliographical work was different and certainly more time-consuming, but researchers were not expected to process more than what is humanly possible: overall the research system was proportionate to the technical constraints. Like for many things, I think that people used to make more out of fewer resources: exploiting the resources they had access to in a deeper and more extensive way, whereas nowadays we often can only afford to skim through the massive amount of literature... I could keep rambling about disposable research but that would be very subjective and out of topic ;)
add a comment |
Although I haven't really known this time myself, I think it's important to mention the much more crucial role that conferences and journals used to play in the dissemination of specialized knowledge. A researcher would usually try to attend the conferences of their field and get their local library to subscribe to the relevant journals in order to keep up to date with what people are doing in their research community.
At the time researchers would preciously keep these massive conference proceedings whenever they attend a conference. I know a few senior researchers who still have their offices shelves full of old proceedings and journal issues. In order to keep up one had to follow the series of conferences/journals relevant to their field, but it was feasible because there were not as many publications (and publication venues) as nowadays. They didn't have to read the entire volume but at least they would read the most important publications and make a note of potentially relevant ones. To some extent they relied less on references indeed, and they relied more on the reputation of a journal or conference to cover the recent progress of the field.
The question of whether they worked harder is subjective. The nature of bibliographical work was different and certainly more time-consuming, but researchers were not expected to process more than what is humanly possible: overall the research system was proportionate to the technical constraints. Like for many things, I think that people used to make more out of fewer resources: exploiting the resources they had access to in a deeper and more extensive way, whereas nowadays we often can only afford to skim through the massive amount of literature... I could keep rambling about disposable research but that would be very subjective and out of topic ;)
Although I haven't really known this time myself, I think it's important to mention the much more crucial role that conferences and journals used to play in the dissemination of specialized knowledge. A researcher would usually try to attend the conferences of their field and get their local library to subscribe to the relevant journals in order to keep up to date with what people are doing in their research community.
At the time researchers would preciously keep these massive conference proceedings whenever they attend a conference. I know a few senior researchers who still have their offices shelves full of old proceedings and journal issues. In order to keep up one had to follow the series of conferences/journals relevant to their field, but it was feasible because there were not as many publications (and publication venues) as nowadays. They didn't have to read the entire volume but at least they would read the most important publications and make a note of potentially relevant ones. To some extent they relied less on references indeed, and they relied more on the reputation of a journal or conference to cover the recent progress of the field.
The question of whether they worked harder is subjective. The nature of bibliographical work was different and certainly more time-consuming, but researchers were not expected to process more than what is humanly possible: overall the research system was proportionate to the technical constraints. Like for many things, I think that people used to make more out of fewer resources: exploiting the resources they had access to in a deeper and more extensive way, whereas nowadays we often can only afford to skim through the massive amount of literature... I could keep rambling about disposable research but that would be very subjective and out of topic ;)
answered 44 mins ago
ErwanErwan
5,3411 gold badge13 silver badges26 bronze badges
5,3411 gold badge13 silver badges26 bronze badges
add a comment |
add a comment |
Thanks for contributing an answer to Academia Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f132376%2fhow-did-researchers-use-to-find-articles-before-the-internet-and-the-computer-er%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
3
Often enough, they didn't :) Lots of stuff used to get rediscovered again and again by different groups. Long bibliographies are rare in 1950s' papers.
– darij grinberg
12 hours ago
Great question! I could not even imagine those days.
– Eilia
10 hours ago