(Go: >> BACK << -|- >> HOME <<)

Scientific method: Difference between revisions

Content deleted Content added
article would be vastly improved after copyediting, add a tag for notice
→‎Relationship with statistics: Link to Wikipedia page for "Why Most Published Research Findings Are False"
(9 intermediate revisions by the same user not shown)
Line 7:
}}
{{Use dmy dates|cs1-dates=ly|date=August 2021}}
<!--
 
{{Copyedit|date=January 2024}}<!--
←-----------------------------------------------------------------------------
Please do not change the following lead paragraph without first discussing it on the talk page:
-------------------------------------------------------------------------------
-->
 
[[File:The Scientific Method.svg|thumb|upright=1.2|The scientific method is often represented as an [[#Elements of the scientific method|ongoing process]]. This diagram represents one variant, and [[commons:Category:Scientific method|there are many others]].]]
{{Science|expanded=Overview}}
The '''scientific method''' is an [[Empirical evidence|empirical]] method for acquiring [[knowledge]] that has characterized the development of [[science]] since at least the 17th century (with notable practitioners in previous centuries; see the article [[history of scientific method]] for additional detail.) It involves careful [[observation]], applying rigorous [[skepticism]] about what is observed, given that [[Philosophy of science#Observation inseparable from theory|cognitive assumptions]] can distort how one interprets the [[Perception#Process and terminology|observation]]. It involves formulating [[Hypothesis|hypotheses]], via [[Inductive reasoning|induction]], based on such observations; the [[testability]] of hypotheses, [[experiment]]al and the measurement-based statistical testing of [[Deductive reasoning|deductions]] drawn from the hypotheses; and refinement (or elimination) of the hypotheses based on the experimental findings. These are ''principles'' of the scientific method, as distinguished from a definitive series of steps applicable to all scientific enterprises.<ref>{{Cite book|title=Philosophiæ Naturalis Principia Mathematica|last=Newton|first=Issac|series=The Principia: Mathematical Principles of Natural Philosophy |publisher=University of California Press|others=Includes "A Guide to Newton's Principia" by I. Bernard Cohen, pp. 1–370. (The ''Principia'' itself is on pp. 371–946)|isbn=978-0-520-08817-7|location=Berkeley, CA|date=1999|at=791–796 ("Rules of Reasoning in Philosophy"); ''see also'' [[Philosophiæ Naturalis Principia Mathematica#Rules of Reason]]|translator-last=Cohen|translator-first=I. Bernard|trans-title=Mathematical Principles of Natural Philosophy|orig-year=1726 (3rd ed.)|translator-last2=Whitman|translator-first2=Anne|translator-last3=Budenz|translator-first3=Julia|title-link=Philosophiæ Naturalis Principia Mathematica}}</ref><ref>{{Citation|title=Oxford Dictionaries: British and World English|date=2016|chapter-url=http://www.oxforddictionaries.com/definition/english/scientific-method|chapter=scientific method|access-date=28 May 2016|archive-date=2016-06-20 |archive-url=https://web.archive.org/web/20160620062539/http://www.oxforddictionaries.com/definition/english/scientific-method|url-status=dead}}</ref><ref>{{Cite book|url=http://www.oed.com/view/Entry/383323|title=Oxford English Dictionary|via=OED Online|publisher=Oxford University Press|year=2014|edition=3rd|location=Oxford|url-access=subscription|access-date=2018-05-31 |archive-date=2023-11-29 |archive-url=https://web.archive.org/web/20231129112639/https://www.oed.com/dictionary/scientific-method_n|url-status=live}}</ref>
 
Although procedures vary from one [[Branches of science|field of inquiry]] to another, the underlying [[#Process|process]] is frequently the same from one field to another. The process in the scientific method involves making [[conjecture]]s (hypothetical explanations), deriving predictions from the hypotheses as logical consequences, and then carrying out experiments or empirical observations based on those predictions.{{efn|name= fallingBodies|See, for example, {{harvnb|Galileo Galilei|1638}}. His [[thought experiment]]s disprove Aristotle's physics of falling bodies.}}<ref name="NA">{{cite wikisource|title=A Neglected Argument for the Reality of God|date=1908|first=Charles Sanders|last=Peirce|wslink=A Neglected Argument for the Reality of God|volume=7|pages=90–112|journal=Hibbert Journal}} with added notes. Reprinted with previously unpublished part, ''Collected Papers'' v. 6, paragraphs 452–85, ''The Essential Peirce'' v. 2, pp. 434–450, and elsewhere. N.B. 435.30 'living institution': Hibbert J. mis-transcribed 'living institution': ("constitution" for "institution")</ref> A hypothesis is a conjecture, based on knowledge obtained while seeking answers to the question. The hypothesis might be very specific, or it might be broad. Scientists then test hypotheses by conducting experiments or studies. A scientific hypothesis must be [[falsifiable]], implying that it is possible to identify a possible outcome of an experiment or observation that conflicts with predictions deduced from the hypothesis; otherwise, the hypothesis cannot be meaningfully tested.{{sfn|Popper|1959|p=273}}
 
The purpose of an experiment is to determine whether [[#Characterizations|observation]]s{{efn-ua|name= aQuestion}}{{efn|name= fallingBodies}}{{efn|name= alhacenCharacterizes| ''[[Book of Optics]]'' (''circa'' 1027) After anatomical investigation of the human eye, and an exhaustive study of human visual perception, Alhacen characterizes the first postulate of [[Euclid's Optics]] as 'superfluous and useless'
Line 27 ⟶ 25:
==History==
{{Main|History of scientific method}}
{{See also|Timeline of the history of the scientific method}}
{{See also|Timeline of the history of the scientific method}}Important debates in the history of science concern skepticism that anything can be known for sure (such as views of [[Francisco Sanches#That Nothing Is Known|Francisco Sanches]]), [[rationalism]] (especially as advocated by [[René Descartes]]), [[inductivism]], [[empiricism]] (as argued for by [[Francis Bacon]], then rising to particular prominence with [[Isaac Newton]] and his followers), and [[hypothetico-deductivism]], which came to the fore in the early 19th century.
[[File:Aristotle Altemps Inv8575.jpg|thumb|upright=0.8|[[Aristotle]] (384–322 BCE). "As regards his method, Aristotle is recognized as the inventor of scientific method because of his refined analysis of logical implications contained in demonstrative discourse, which goes well beyond natural logic and does not owe anything to the ones who philosophized before him." – Riccardo Pozzo<ref>{{ cite book | first= Riccardo | last= Pozzo |date= 2004 | url= https://books.google.com/books?id=vayp8jxcPr0C&pg=PA41 | title= The impact of Aristotelianism on modern philosophy |archive-url=https://web.archive.org/web/20230406020558/https://books.google.com/books?id=vayp8jxcPr0C&pg=PA41 |archive-date=2023-04-06 |publisher= CUA Press|page= 41|isbn= 0-8132-1347-9}}</ref>]]
[[File:Hazan.png|thumb|upright=0.8|[[Ibn al-Haytham]] (965–1039). A polymath, considered by some to be the father of modern scientific [[methodology]], due to his emphasis on experimental data and [[reproducibility]] of its results.<ref name=news.bbc.co.uk>{{cite news|title=The 'first true scientist'|url=http://news.bbc.co.uk/2/hi/7810846.stm|work=BBC News|author=Jim Al-Khalili|date=4 January 2009|access-date=2014-04-07 |archive-date=2017-07-13 |archive-url=https://web.archive.org/web/20170713003351/http://news.bbc.co.uk/2/hi/7810846.stm|url-status=live}}</ref><ref>{{cite book|title=Mind, Brain, and Education Science: A Comprehensive Guide to the New Brain-Based Teaching|year=2010|publisher=W.W. Norton & Company|isbn=978-0-393-70607-9|author=Tracey Tokuhama-Espinosa|page=39|quote=Alhazen (or Al-Haytham; 965–1039 CE) was perhaps one of the greatest physicists of all times and a product of the Islamic Golden Age or Islamic Renaissance (7th–13th centuries). He made significant contributions to anatomy, astronomy, engineering, [[mathematics]], medicine, ophthalmology, philosophy, physics, psychology, and visual perception and is primarily attributed as the inventor of the scientific method, for which author Bradley Steffens (2006) describes him as the "first scientist".}}</ref><ref name=treatiseOnLight/>]]
[[File:JKepler.jpg|thumb|upright=0.8| [[Johannes Kepler]] (1571–1630). "Kepler shows his keen logical sense in detailing the whole process by which he finally arrived at the true orbit. This is the greatest piece of Retroductive reasoning ever performed." – [[Charles Sanders Peirce|C.&nbsp;S. Peirce]], {{circa|1896}}, on Kepler's reasoning through explanatory hypotheses<ref>Peirce, C.S., ''Collected Papers'' v. 1, paragraph 74.</ref>]]
[[File:Galileo.arp.300pix.jpg|thumb|upright=0.8|[[Galileo Galilei]] (1564–1642). According to [[Albert Einstein]], "All knowledge of reality starts from experience and ends in it. Propositions arrived at by purely logical means are completely empty as regards reality. Because Galileo saw this, and particularly because he drummed it into the scientific world, he is the father of modern physics – indeed, of modern science altogether."<ref>{{cite book |author=Albert Einstein |translator=Alan Harris |contribution=On the Method of Theoretical Physics |title=Einstein's essays in science |publisher=Dover |year=2009 |orig-year=1934 |pages=12–21 |isbn=9780486470115}}</ref>]]
 
Important debates in the history of science concern skepticism that anything can be known for sure (such as views of [[Francisco Sanches#That Nothing Is Known|Francisco Sanches]]), [[rationalism]] (especially as advocated by [[René Descartes]]), [[inductivism]], [[empiricism]] (as argued for by [[Francis Bacon]], then rising to particular prominence with [[Isaac Newton]] and his followers), and [[hypothetico-deductivism]], which came to the fore in the early 19th century.
 
The term "scientific method" emerged in the 19th century, when a significant institutional development of science was taking place and terminologies establishing clear [[Demarcation problem|boundaries]] between science and non-science, such as "scientist" and "pseudoscience", appeared.<ref name="Thurs" /> Throughout the 1830s and 1850s, at which time Baconianism was popular, naturalists like William Whewell, John Herschel, John Stuart Mill engaged in debates over "induction" and "facts" and were focused on how to generate knowledge.<ref name="Thurs" /> In the late 19th and early 20th centuries, a debate over [[Philosophical realism|realism]] vs. [[antirealism]] was conducted as powerful scientific theories extended beyond the realm of the observable.<ref name="auto">{{cite book |last=Achinstein |first= Peter |chapter=General Introduction |pages=1–5 |title=Science Rules: A Historical Introduction to Scientific Methods |publisher=Johns Hopkins University Press |date=2004 |isbn=978-0-8018-7943-2}}</ref>
Line 40 ⟶ 44:
{{efn-ua|name= introspection| [[instrumentalism|Never fail to recognize an idea]]... .— C. S. Peirce<ref name= How/>}}{{efn-ua|name= vacuum| Twenty-three hundred years ago, Aristotle proposed that a [[vacuum]] did not exist in nature; thirteen hundred years later, [[#alhazen|Alhazen disproved Aristotle's hypothesis]], using experiments on [[refraction]],<ref name=treatiseOnLight2>Alhacen (c.1035) ''Treatise on Light'' (رسالة في الضوء) as cited in [[Shmuel Sambursky]], ed. (1975) [https://archive.org/details/physicalthoughtf0000unse/page/136/mode/2up Physical thought from the Presocratics to the quantum physicists : an anthology], p.137</ref> thus deducing the existence of [[outer space]].<ref name= alhacenOnRefraction4.28 />}}
 
The ubiquitous element in the scientific method is [[empiricism]]. This is in opposition to stringent forms of [[rationalism]]: the scientific method embodies the position that reason alone cannot solve a particular scientific problem. A strong formulation of the scientific method is not always aligned with a form of [[empiricism]] in which the empirical data is put forward in the form of experience or other abstracted forms of knowledge; in [[#aModel|current scientific practice]], however, the use of [[scientific modelling]] and reliance on abstract typologies and theories is normally accepted. The scientific method counters claims that [[revelation]], political or religious [[dogma]], appeals to tradition, commonly held beliefs, common sense, or currently held theories pose the only possible means of demonstrating truth.<ref name= truthSought4sake /><ref name=" reasonsFirstRule">{{cite book |last=Peirce |first=Charles S. |title=Collected Papers |year=1899 |series=v. 1 |at=paragraphs 135–140 |chapter=F.R.L. [First Rule of Logic] |quote=...&nbsp;in order to learn, one must desire to learn&nbsp;... |access-date=2012-01-06 |chapter-url=http://www.princeton.edu/~batke/peirce/frl_99.htm |archive-url=https://web.archive.org/web/20120106071421/http://www.princeton.edu/~batke/peirce/frl_99.htm |archive-date=January 6, 2012 |url-status=dead}}</ref><ref name= tow />
 
Different early expressions of empiricism and the scientific method can be found throughout history, for instance with the ancient [[Stoics]], [[Epicurus]],<ref name=Asmis>Elizabeth Asmis (1985) ''Epicurus' Scientific Method''. Cornell University Press</ref> [[Alhazen]],{{efn-ua|1=[[Alhazen]] argued the importance of forming questions and subsequently testing them: "How does light travel through transparent bodies? Light travels through transparent bodies in straight lines only... We have explained this exhaustively in our ''[[Book of Optics]]''.{{efn|name= straightLinesOnly }} But let us now mention something to prove this convincingly: the fact that light travels in straight lines is clearly observed in the lights which enter into dark rooms through holes.... [T]he entering light will be clearly observable in the dust which fills the air.<ref name=treatiseOnLight>Alhazen, ''Treatise on Light'' ({{lang|ar|رسالة في الضوء}}), translated into English from German by M. Schwarz, from [http://menadoc.bibliothek.uni-halle.de/dmg/periodical/pageview/30949 "Abhandlung über das Licht"] {{Webarchive|url=https://web.archive.org/web/20191230190424/http://menadoc.bibliothek.uni-halle.de/dmg/periodical/pageview/30949 |date=2019-12-30 }}, J. Baarmann (editor and translator from Arabic to German, 1882) ''[[Zeitschrift der Deutschen Morgenländischen Gesellschaft]]'' Vol '''36''' as quoted in {{harvnb|Sambursky|1975|p=136}}.</ref>
Line 50 ⟶ 54:
A sea voyage from America to Europe afforded [[C. S. Peirce]] the distance to clarify [[#coord3kinds|his ideas]],{{efn-ua| Distancing oneself from the problem is one technique for solving problems<ref name= How/>}} gradually resulting in the [[hypothetico-deductive model]].{{sfn|Godfrey-Smith|2003|p=236}} Formulated in the 20th century, the model has undergone significant revision since first proposed (for a more formal discussion, see {{slink||Elements of the scientific method}}).
 
== Overview ==
{{Hatnote|The [[#DNA example|DNA example]] below is a synopsis of this method.}}
The scientific method is the process by which [[science]] is carried out.<ref name="allTheSciences">{{harvnb|Gauch|2003|p=xv}}: "The thesis of this book, as outlined in Chapter One, is that there are general principles applicable to all the sciences."</ref> As in other areas of inquiry, science (through the scientific method) can build on previous knowledge and develop a more sophisticated understanding of its topics of study over time.{{Cn|date=January 2024}} This model can be seen to underlie the [[scientific revolution]].<ref name="lindberg2007">{{harvnb|Lindberg|2007|pp=2–3}}: "There is a danger that must be avoided. ... If we wish to do justice to the historical enterprise, we must take the past for what it was. And that means we must resist the temptation to scour the past for examples or precursors of modern science. ...My concern will be with the beginnings of scientific ''theories'', the methods by which they were formulated, and the uses to which they were put; ... "</ref>
 
The scientific method is the process by which [[science]] is carried out.<ref name= allTheSciences >{{harvnb| Gauch | 2003 |p= xv}}: "The thesis of this book, as outlined in Chapter One, is that there are general principles applicable to all the sciences."</ref> As in other areas of inquiry, science (through the scientific method) can build on previous knowledge and develop a more sophisticated understanding of its topics of study over time.{{efn|For example, the concept of [[Falsifiability|falsification]] (first proposed in 1934) formalizes the attempt to ''disprove'' hypotheses{{sfn|Popper|2005|pp=17–20, 249–252, 437–438, and elsewhere}} rather than to prove them (which would introduce confirmation bias).}}<ref name= sn1987a>[[Leon Lederman]], for teaching [[physics first]], illustrates how to avoid confirmation bias: [[Ian Shelton]], in Chile, was initially skeptical that [[supernova 1987a]] was real, but possibly an artifact of instrumentation (null hypothesis), so he went outside and disproved his null hypothesis by observing SN 1987a with the naked eye. The [[Kamiokande]] experiment, in Japan, independently observed [[neutrino]]s from [[SN 1987a]] at the same time.</ref><ref name=Fixation/><ref>{{harvnb| Gauch | 2003 |p=1 }}: "The scientific method can function in the same way; This is the principle of noncontradiction."</ref><ref>[[Francis Bacon]] (1629) ''[[New Organon]]'', lists four types of error: Idols of the tribe (error due to the entire human race), the cave (errors due to an individual's own intellect), the marketplace (errors due to false words), and the theater (errors due to incredulous acceptance).</ref><ref name=Vital/><ref name=Anti-fragility/> This model can be seen to underlie the [[scientific revolution]].<ref name= lindberg2007>{{harvnb|Lindberg|2007|pp=2–3}}: "There is a danger that must be avoided. ... If we wish to do justice to the historical enterprise, we must take the past for what it was. And that means we must resist the temptation to scour the past for examples or precursors of modern science. ...My concern will be with the beginnings of scientific ''theories'', the methods by which they were formulated, and the uses to which they were put; ... "</ref>
The overall process involves making [[conjecture]]s ([[Hypothesis|hypotheses]]), deriving predictions from them as logical consequences, and then carrying out experiments based on those predictions to determine whether the original conjecture was correct.<ref name="NA" /> There are difficulties in a formulaic statement of method, however. Though the scientific method is often presented as a fixed sequence of steps, these actions are better considered as general principles.{{sfn|Gauch|2003|p=3}} Not all steps take place in every scientific inquiry (nor to the same degree), and they are not always done in the same order. As noted by scientist and philosopher [[William Whewell]] (1794–1866), "invention, sagacity, [and] genius"<ref name="Inductive Science 1837" /> are required at every step.
 
===Process===
=== Factors of scientific inquiry ===
The overall process involves making [[conjecture]]s ([[Hypothesis|hypotheses]]), deriving predictions from them as logical consequences, and then carrying out experiments based on those predictions to determine whether the original conjecture was correct.<ref name=NA /> There are difficulties in a formulaic statement of method, however. Though the scientific method is often presented as a fixed sequence of steps, these actions are better considered as general principles.{{sfn|Gauch|2003|p=3}} Not all steps take place in every scientific inquiry (nor to the same degree), and they are not always done in the same order. As noted by scientist and philosopher [[William Whewell]] (1794–1866), "invention, sagacity, [and] genius"<ref name="Inductive Science 1837"/> are required at every step.
There are different ways of outlining the basic method used for scientific inquiry. The [[scientific community]] and [[philosophers of science]] generally agree on the following classification of method components. These methodological elements and organization of procedures tend to be more characteristic of [[experimental science]]s than [[social science]]s. Nonetheless, the cycle of formulating hypotheses, testing and analyzing the results, and formulating new hypotheses, will resemble the cycle described below.{{anchor|epistemicCycle|Process}}The scientific method is an iterative, cyclical process through which information is continually revised.<ref>{{cite book |last1=Godfrey-Smith |first1=Peter |url=https://books.google.com/books?id=k23egtSWrb8C |title=Theory and Reality: An Introduction to the Philosophy of Science |date=2009 |publisher=University of Chicago Press |isbn=978-0-226-30062-7 |location=Chicago |author-link=Peter Godfrey-Smith |access-date=2020-05-09 |archive-url=https://web.archive.org/web/20231129112726/https://books.google.com/books?id=k23egtSWrb8C |archive-date=2023-11-29 |url-status=live}}</ref><ref name="Brody-1993">{{harvnb|Brody|1993|p=10}} calls this an ''[[Scientific method#epistemicCycle|epistemic cycle]]''; these cycles can occur at high levels of abstraction.</ref> It is generally recognized to develop advances in knowledge through the following elements, in varying combinations or contributions:<ref name="Fixation">{{cite wikisource|title=The Fixation of Belief|first=Charles Sanders|last=Peirce|year=1877|wslink=The Fixation of Belief|volume=12|pages=1–15|journal=Popular Science Monthly}}.</ref><ref name="Vital">Peirce, Charles S., ''Collected Papers'' v. 5, in paragraph 582, from 1898: "...&nbsp;[rational] inquiry of every type, fully carried out, has the vital power of self-correction and of growth. This is a property so deeply saturating its inmost nature that it may truly be said that there is but one thing needful for learning the truth, and that is a hearty and active desire to learn what is true."</ref><!--ref>{{cite book|last1=Kuhn |first1=Thomas S.|title=The Structure of Scientific Revolutions 50th Anniversary Edition|date=2012 |publisher=University of Chicago Press|location=Chicago|isbn=978-0-226-45811-3 |url=https://books.google.com/books?id=3eP5Y_OOuzwC|access-date=29 January 2018}}{{pn|date=August 2021}}</ref><ref>{{cite book|last1=Galison |first1=Peter|title=How Experiments End|date=1987|publisher=University of Chicago Press|location=Chicago|isbn=978-0-226-27915-2|url=https://books.google.com/books?id=DN-9m2jSo8YC |access-date=29 January 2018}}</ref-->
 
====Formulation of a question====
The question can refer to the explanation of a specific [[observation]],{{efn-ua|name= aQuestion}} as in "Why is the sky blue?" but can also be open-ended, as in "How can I [[Drug design|design a drug]] to cure this particular disease?" This stage frequently involves finding and evaluating evidence from previous experiments, personal scientific observations or assertions, as well as the work of other scientists. If the answer is already known, a different question that builds on the evidence can be posed. When applying the scientific method to research, determining a good question can be very difficult and it will affect the outcome of the investigation.<ref>{{cite book |editor-last1=Schuster |editor-first1=Daniel P. |editor-last2=Powers |editor-first2=William J. |year=2005 |title=Translational and Experimental Clinical Research |chapter=Ch. 1 |publisher=Lippincott Williams & Wilkins |isbn=9780781755658 |url=https://books.google.com/books?id=C7pZftbI0ZMC |access-date=2021-11-27 |archive-date=2023-11-29 |archive-url=https://web.archive.org/web/20231129112636/https://books.google.com/books?id=C7pZftbI0ZMC |url-status=live }} This chapter also discusses the different types of research questions and how they are produced.</ref>
 
====Hypothesis====
A [[hypothesis]] is a conjecture, based on knowledge obtained while formulating the question, that may explain any given behavior. The hypothesis might be very specific; for example, Einstein's [[equivalence principle]] or [[Francis Crick]]'s "DNA makes RNA makes protein",{{efn|This phrasing is attributed to [[Marshall Nirenberg]].}} or it might be broad; for example, "unknown species of life dwell in the unexplored depths of the oceans". ''See [[#Hypothesis development|§ Hypothesis development]]''
 
A [[Statistical hypothesis testing#Definition of terms|statistical hypothesis]] is a [[conjecture]] about a given [[statistical population]]. For example, the population might be ''people with a particular disease''. One conjecture might be that a new drug will cure the disease in some of the people in that population, as in a [[clinical trial]] of the drug.<ref name= gates>[[Bill and Melinda Gates Foundation]] {{cite web| url = https://docs.gatesfoundation.org/documents/clinical_trials.pdf| title = (2021) Definition of Clinical Trials| access-date = 2021-08-18 | archive-date = 2017-01-12 | archive-url = https://web.archive.org/web/20170112223801/https://docs.gatesfoundation.org/documents/clinical_trials.pdf| url-status = live}}</ref> A [[null hypothesis]] would conjecture that the statistical hypothesis is false; for example, that the new drug does nothing, and that any cure in the population would be caused by [[Luck|chance]] (a [[random variable]]).
 
An [[alternative hypothesis|alternative to the null hypothesis]], to be [[falsifiable]], must say that a treatment program with the drug does better than chance. To test the statement ''a treatment program with the drug does better than chance'', an experiment is designed in which a portion of the population {{anchor|the control group}}(the control group), is to be left untreated, while another, separate portion of the population is to be treated.<ref name="hannan">{{cite journal | vauthors = Hannan EL | title = Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations | journal = JACC. Cardiovascular Interventions | volume = 1 | issue = 3 | pages = 211–7 | date = June 2008 | pmid = 19463302 | doi = 10.1016/j.jcin.2008.01.008 | doi-access = free }}</ref> [[t-Test]]s could then specify how large the treated groups, and how large the control groups are to be, in order to infer whether some course of treatment of the population has resulted in a cure of some of them, in each of the groups.{{efn| name= misuseTtests| Regarding the Misuse of t-Tests<ref>{{cite journal| url = https://pubs.asahq.org/anesthesiology/article/60/5/505/29253/Regarding-the-Misuse-of-t-Tests| title = Regarding the Misuse of ''t'' Tests| journal = Anesthesiology| date = May 1984| volume = 60| issue = 5| pages = 505| doi = 10.1097/00000542-198405000-00026| last1 = Schaefer| first1 = Carl F| pmid = 6711862| access-date = 2021-08-29 | archive-date = 2021-08-29 | archive-url = https://web.archive.org/web/20210829012031/https://pubs.asahq.org/anesthesiology/article/60/5/505/29253/Regarding-the-Misuse-of-t-Tests| url-status = live| doi-access = free}}</ref>}} The groups are examined, in turn by the researchers, in a [[Protocol (science)|protocol]].{{efn|See [[Clinical trial protocol]]. That is, the examination of members of each group is to be uniform, and the steps of the examination are to be pre-defined (before the data is taken), systematic, and not ''ad hoc''.}}
 
[[Strong inference]] could alternatively propose multiple alternative hypotheses embodied in [[randomized controlled trial]]s, treatments A, B, C, ... , (say in a [[blinded experiment]] with varying dosages, or with lifestyle changes, and so forth) so as not to introduce [[confirmation bias]] in favor of a specific course of treatment.<ref name= platt /><!--ref>[[John R. Platt]] {{cite journal|journal= Science|volume= 146|issue= 3642|pages= 347–53|year= 1964|title= Strong inference| doi = 10.1126/science.146.3642.347 |pmid= 17739513|author-link= John R. Platt |url=http://256.com/gray/docs/strong_inference.html|bibcode=1964Sci...146..347P}}</ref --> Ethical considerations could be used, to minimize the numbers in the untreated groups, e.g., use almost every treatment in every group, but excluding A, B, C, ..., respectively as controls.{{efn|See [[Placebo-controlled study]]}}{{efn|name= factorialExperiments|See [[Factorial experiment#Advantages of factorial experiments]]}}
 
====Prediction====
The prediction step deduces the logical consequences of the hypothesis ''before the outcome is known''. These predictions are expectations for the results of testing. If the result is already known, it is evidence that is ready to be considered in acceptance or rejection of the hypothesis.
The evidence is also stronger if the actual result of the predictive test is not already known, as tampering with the test can be ruled out, as can [[hindsight bias]] (see [[postdiction]]). Ideally, the prediction must also distinguish the hypothesis from likely alternatives; if two hypotheses make the same prediction, observing the prediction to be correct is not evidence for either one over the other. (These statements about the relative [[strength of evidence]] can be mathematically derived using [[Bayes' Theorem]]).{{efn|Note: for a discussion of multiple hypotheses, see [[Bayesian inference#Informal]]}}
 
{{anchor|suitableTest}}The consequence, therefore, is to be stated at the same time or briefly after the statement of the hypothesis, but before the experimental result is known.
 
Likewise, the test protocol is to be stated before execution of the test. These requirements become precautions against tampering, and aid the reproducibility of the experiment.
 
====Testing====
Suitable tests<ref name= SuitableTest/><ref name=econ/> of a hypothesis compare the [[expected value]]s from the tests of that hypothesis with the actual results of those tests. Scientists (and other people) can then [[#hisPragmatism|secure, or discard, their hypotheses]] by conducting suitable [[#Experiments|experiment]]s.
<!--
The purpose of an experiment is to determine whether If they agree, confidence in the hypothesis increases; otherwise, it decreases. The agreement does not assure that the hypothesis is true; future experiments may reveal problems. [[Karl Popper]] advised scientists to try to falsify hypotheses, i.e., to search for and test those experiments that seem most doubtful. Large numbers of successful confirmations are not convincing if they arise from experiments that avoid risk.{{sfn|Popper|2003|p={{pn|date=August 2021}}}} Experiments should be designed to minimize possible errors, especially through the use of appropriate [[scientific control]]s. For example, tests of medical treatments are commonly run as [[Blind experiment#Double-blind trials|double-blind tests]]. Test personnel, who might unwittingly reveal to test subjects which samples are the desired test drugs and which are [[placebo]]s, are kept ignorant of which are which. Such hints can bias the responses of the test subjects. Furthermore, failure of an experiment does not necessarily mean the hypothesis is false. Experiments always depend on several hypotheses, e.g., that the test equipment is working properly, and a failure may be a failure of one of the auxiliary hypotheses. (See the [[Duhem–Quine thesis]].) Experiments can be conducted in a college lab, on a kitchen table, at CERN's [[Large Hadron Collider]], at the bottom of an ocean, on Mars (using one of the working [[Mars rover|rovers]]), and so on. Astronomers do experiments, searching for planets around distant stars. Finally, most individual experiments address highly specific topics for reasons of practicality. As a result, evidence about broader topics is usually accumulated gradually.
-->
 
====Analysis====
An analysis determines, from the results of the experiment, the next actions to take. The expected values from the test of the alternative hypothesis are compared to the [[expected value]]s resulting from the null hypothesis (that is, a prediction of no difference in the [[status quo]]). The difference between ''expected versus actual'' indicates which hypothesis better explains the resulting data from the experiment. In cases where an experiment is repeated many times, a [[Statistics|statistical analysis]] such as a [[chi-squared test]] whether the null hypothesis is true, may be required.
 
Evidence from other scientists, and from experience are available for incorporation at [[#Replication|any stage in the process]]. Depending on the complexity of the experiment, iteration of the process may be required to gather sufficient evidence to answer the question with confidence, or to build up other answers to highly specific questions, to answer a single broader question.
 
When the evidence has falsified the alternative hypothesis, a new hypothesis is required; if the evidence does not conclusively justify discarding the alternative hypothesis, other predictions from the alternative hypothesis might be considered. Pragmatic considerations, such as the resources available to continue inquiry, might guide the investigation's further course.{{efn-ua|name= FRL-1.136}} When evidence for a hypothesis strongly supports that hypothesis, further questioning can follow, for insight into the broader inquiry under investigation.
 
===DNA example===
{{anchor|Context}}
[[File:DNA icon (25x25).png|link=|alt=]]
The basic [[#Elements of the scientific method|elements of the scientific method]] are illustrated by the following example (which occurred from 1944 to 1953) from the discovery of the structure of [[DNA]]:
* ''[[#DNA-characterizations|Question]]'': Previous investigation of DNA had determined its chemical composition (the four [[nucleotide]]s), the structure of each individual nucleotide, and other properties. DNA had been identified as the carrier of genetic information by the [[Avery–MacLeod–McCarty experiment]] in 1944,{{sfn|McCarty|1985|page=252}} but the mechanism of how genetic information was stored in DNA was unclear.<ref name=florenceBell>X-ray diffraction patterns of DNA by [[Florence Bell (scientist)|Florence Bell]] in her Ph.D. thesis (1939) were similar to (although not as good as) "photo 51", but this research was interrupted by the events of World War II.</ref>
* ''[[#DNA-hypotheses|Hypothesis]]'': [[Linus Pauling]], [[Francis Crick]] and [[James D. Watson]] hypothesized that DNA had a helical structure.<ref>{{harvnb|McElheny|2004|p=40}}: October 1951 — "That's what a helix should look like!" Crick exclaimed in delight (This is the Cochran-Crick-Vand-Stokes theory of the transform of a helix).</ref>
* ''[[#DNA-predictions|Prediction]]'': If DNA had a helical structure, its X-ray diffraction pattern would be X-shaped.<ref name="McElheny 2004 43">{{harvnb|McElheny|2004|p=43}}: June 1952 — Watson had succeeded in getting X-ray pictures of TMV showing a diffraction pattern consistent with the transform of a helix.</ref><ref name="Crick pp. 137–138">{{harvnb|Judson|1979|pp=137–138}}: "Watson did enough work on [[Tobacco mosaic virus]] to produce the diffraction pattern for a helix, per Crick's work on the transform of a helix."</ref> This prediction was determined using the mathematics of the helix transform, which had been derived by Cochran, Crick, and Vand<ref name="HelixTransform">Cochran W, Crick FHC and Vand V. (1952) "The Structure of Synthetic Polypeptides. I. The Transform of Atoms on a Helix", ''[[Acta Crystallographica|Acta Crystallogr.]]'', '''5''', 581–586.</ref> (and independently by Stokes). This prediction was a mathematical construct, completely independent from the biological problem at hand.
*{{anchor|Crucial experiment}} ''[[#DNA-experiments|Experiment]]'': [[Rosalind Franklin]] used pure DNA to perform [[X-ray diffraction]] to produce [[photo 51]]. The results showed an X-shape.
* ''[[#DNA-iterations|Analysis]]'': When Watson saw the detailed diffraction pattern, he immediately recognized it as a helix.<ref name="TeaTime">{{harvnb|McElheny|2004|p=52}}: Friday, January 30, 1953. Tea time — Franklin confronts Watson and his paper – "Of course it [Pauling's pre-print] is wrong. DNA is not a helix." However, Watson then visits Wilkins' office, sees [[photo 51]], and immediately recognizes the diffraction pattern of a helical structure. But additional questions remained, requiring additional iterations of their research. For example, the number of strands in the backbone of the helix (Crick suspected 2 strands, but cautioned Watson to examine that more critically), the location of the base pairs (inside the backbone or outside the backbone), etc. One key point was that they realized that the quickest way to reach a result was not to continue a mathematical analysis, but to build a physical model. Later that evening — Watson urges Wilkins to begin model-building immediately. But Wilkins agrees to do so only after Franklin's departure.</ref><ref name="Watson 1968 167">{{harvnb|Watson|1968|p=167}}: "The instant I saw the picture my mouth fell open and my pulse began to race." Page 168 shows the X-shaped pattern of the B-form of [[DNA]], clearly indicating crucial details of its helical structure to Watson and Crick.</ref>{{efn|name= nextItemToSettle}} He and Crick then produced their model, using this information along with the previously known information about DNA's composition, especially Chargaff's rules of base pairing.<ref name="SameShape">{{harvnb|McElheny|2004|pp=57–59}}: Saturday, February 28, 1953 — Watson found the base-pairing mechanism which explained [[Chargaff's rules]] using his cardboard models.</ref>
 
The discovery became the starting point for many further studies involving the genetic material, such as the field of [[molecular genetics]], and it was awarded the [[Nobel Prize in Physiology or Medicine|Nobel Prize]] in 1962. Each step of the example is examined in more detail later in the article.
 
===Other components===
The scientific method also includes other components required even when all the iterations of the steps above have been completed:{{sfn|Galileo Galilei|1638}}
 
====Replication====
If an experiment cannot be [[Reproducibility|repeated]] to produce the same results, this implies that the original results might have been in error. As a result, it is common for a single experiment to be performed multiple times, especially when there are uncontrolled variables or other indications of [[Observational error|experimental error]]. For significant or surprising results, other scientists may also attempt to replicate the results for themselves, especially if those results would be important to their own work.<ref>{{cite web|url=http://www.fyysika.ee/vorgustik/wp-content/uploads/2011/11/Reconstruction-of-Galileo-Galilei.pdf|title=Reconstruction of Galileo Galilei's experiment – the inclined plane|access-date=2014-04-28 |archive-date=2014-04-29 |archive-url=https://web.archive.org/web/20140429075745/http://www.fyysika.ee/vorgustik/wp-content/uploads/2011/11/Reconstruction-of-Galileo-Galilei.pdf|url-status=live}}</ref>
Replication has become a contentious issue in social and biomedical science where treatments are administered to groups of individuals. Typically an ''experimental group'' gets the treatment, such as a drug, and the ''control group'' gets a placebo. [[John Ioannidis]] in 2005 pointed out that the method being used has led to many findings that cannot be replicated.<ref>{{cite journal |last=Ioannidis |first=John P. A. |date=August 2005 |title=Why most published research findings are false |journal=[[PLOS Medicine]] |volume=2 |issue=8 |pages=e124 |doi=10.1371/journal.pmed.0020124 |pmid=16060722 |pmc=1182327 |doi-access=free }}</ref>
 
====External review====
The process of [[peer review]] involves evaluation of the experiment by experts, who typically give their opinions anonymously. Some journals request that the experimenter provide lists of possible peer reviewers, especially if the field is highly specialized. Peer review does not certify the correctness of the results, only that, in the opinion of the reviewer, the experiments themselves were sound (based on the description supplied by the experimenter). If the work passes peer review, which occasionally may require new experiments requested by the reviewers, it will be published in a peer-reviewed [[Academic journal|scientific journal]]. The specific journal that publishes the results indicates the perceived quality of the work.{{efn|In ''Two New Sciences'', there are three 'reviewers': Simplicio, Sagredo, and Salviati, who serve as foil, antagonist, and protagonist. Galileo speaks for himself only briefly. But Einstein's 1905 papers were not peer-reviewed before their publication.}}
 
====Data recording and sharing====
Scientists typically are careful in recording their data, a requirement promoted by [[Ludwik Fleck]] (1896–1961) and others.{{sfn|Fleck|1979|pp=xxvii–xxviii}} Though not typically required, they might be requested to [[Data sharing|supply this data]] to other scientists who wish to replicate their original results (or parts of their original results), extending to the sharing of any experimental samples that may be difficult to obtain.<ref>"[http://grants.nih.gov/grants/policy/data_sharing/index.htm NIH Data Sharing Policy] {{Webarchive|url=https://web.archive.org/web/20120513171213/http://grants.nih.gov/grants/policy/data_sharing/index.htm |date=2012-05-13 }}."</ref> ''See [[#Communication and community|§Communication and community]].''
 
====Instrumentation====
{{see also|Scientific community|Big science}}
Institutional researchers might acquire an [[machine|instrument]] to [[institution]]alize their tests. These instruments would use [[observation]]s of the real world, which might agree with, or perhaps conflict with, their [[#Prediction|prediction]]s deduced from their [[#Hypothesis|hypothesis]]. These institutions thereby reduce the research function to a cost/benefit,<ref name= conjugatePairs /> which is expressed as money, and the time and attention of the researchers to be expended,<ref name= conjugatePairs /> in exchange for a report to their constituents.<ref name= nsf>National Science Foundation (NSF) (2021) [https://www.nsf.gov/oig/reports/ NSF Reports] {{Webarchive|url=https://web.archive.org/web/20210817165231/https://www.nsf.gov/oig/reports/ |date=2021-08-17 }} and [https://www.nsf.gov/news/ News] {{Webarchive|url=https://web.archive.org/web/20210820162008/https://www.nsf.gov/news/ |date=2021-08-20 }}</ref>
 
Current large instruments, such as CERN's [[Large Hadron Collider]] (LHC),<ref name= lhc>{{Cite web|url=https://lhc-commissioning.web.cern.ch/lhc-commissioning/schedule/LHC-long-term.htm|title=LHC long term schedule|website=lhc-commissioning.web.cern.ch|access-date=2021-08-22 |archive-date=2020-04-25 |archive-url=https://web.archive.org/web/20200425105121/https://lhc-commissioning.web.cern.ch/lhc-commissioning/schedule/LHC-long-term.htm|url-status=live}} (2021)</ref> or [[LIGO]],<ref name= ligo>{{cite web| url = https://www.ligo.caltech.edu/| title = ligo.caltech.edu (1999) Laser Interferometer Gravitational-Wave Observatory| access-date = 2021-08-30 | archive-date = 2021-09-01 | archive-url = https://web.archive.org/web/20210901125538/https://www.ligo.caltech.edu/| url-status = live}}</ref> or the [[National Ignition Facility]] (NIF),<ref name= nif>{{cite web| url = https://lasers.llnl.gov/about/what-is-nif| title = NIF (2021) What Is the National Ignition Facility?| access-date = 2021-08-22 | archive-date = 2017-07-31 | archive-url = https://web.archive.org/web/20170731064919/https://lasers.llnl.gov/about/what-is-nif| url-status = live}}</ref> or the [[International Space Station]] (ISS),<ref name= iss>{{cite web| url = https://www.nasa.gov/mission_pages/station/main/index.html| title = ISS (2021) International Space Station| date = 12 January 2015| access-date = 2021-08-22 | archive-date = 2005-09-07 | archive-url = https://web.archive.org/web/20050907073730/http://www.nasa.gov/mission_pages/station/main/index.html| url-status = live}}</ref> or the [[James Webb Space Telescope]] (JWST),<ref name= jwst>{{cite web| url = https://www.jwst.nasa.gov/| title = JWST (2021) WEBB Space Telescope| access-date = 2021-08-22 | archive-date = 2012-01-04 | archive-url = https://web.archive.org/web/20120104225155/http://www.jwst.nasa.gov/| url-status = live}}</ref><ref name= jwstDeploymentSeq>James Webb Space Telescope (JWST) [https://www.youtube.com/watch?v=RzGLKQ7_KZQ (12 Nov 2021) James Webb Space Telescope Deployment Sequence (Nominal)] {{Webarchive|url=https://web.archive.org/web/20211223035530/https://www.youtube.com/watch?v=RzGLKQ7_KZQ |date=2021-12-23 }} highlights the predictions from launch to day+29,</ref> entail expected costs of billions of dollars, and timeframes extending over decades. These kinds of institutions affect public policy, on a national or even international basis, and the researchers would require shared access to such machines and their [[#otherScientists|adjunct infrastructure]].{{efn|name= feedTheMachinery| The machinery of the mind can only transform knowledge, but never originate it, unless it be fed with facts of observation. —[[C.S. Peirce]]<ref name= How/>}}<ref name= Crutchfield/> ''See [[Perceptual control theory]], [[Control theory#Open-loop and closed-loop (feedback) control|§Open-loop and closed-loop feedback]]''
 
==Elements of the scientific method==
There are different ways of outlining the basic method used for scientific inquiry. The [[scientific community]] and [[philosophers of science]] generally agree on the following classification of method components. These methodological elements and organization of procedures tend to be more characteristic of [[experimental science]]s than [[social science]]s. Nonetheless, the cycle of formulating hypotheses, testing and analyzing the results, and formulating new hypotheses, will resemble the cycle described below.{{anchor|epistemicCycle}}
 
The scientific method is an iterative, cyclical process through which information is continually revised.<ref>{{cite book|last1=Godfrey-Smith|first1=Peter|author-link=Peter Godfrey-Smith|title=Theory and Reality: An Introduction to the Philosophy of Science|date=2009|publisher=University of Chicago Press|location=Chicago|isbn=978-0-226-30062-7|url=https://books.google.com/books?id=k23egtSWrb8C|access-date=2020-05-09 |archive-date=2023-11-29 |archive-url=https://web.archive.org/web/20231129112726/https://books.google.com/books?id=k23egtSWrb8C|url-status=live}}</ref><ref name= Brody-1993 >{{harvnb|Brody|1993|p=10}} calls this an ''[[#epistemicCycle|epistemic cycle]]''; these cycles can occur at high levels of abstraction.</ref> It is generally recognized to develop advances in knowledge through the following elements, in varying combinations or contributions:<ref name= Fixation/><ref name= Vital/><!--ref>{{cite book|last1=Kuhn |first1=Thomas S.|title=The Structure of Scientific Revolutions 50th Anniversary Edition|date=2012 |publisher=University of Chicago Press|location=Chicago|isbn=978-0-226-45811-3 |url=https://books.google.com/books?id=3eP5Y_OOuzwC|access-date=29 January 2018}}{{pn|date=August 2021}}</ref><ref>{{cite book|last1=Galison |first1=Peter|title=How Experiments End|date=1987|publisher=University of Chicago Press|location=Chicago|isbn=978-0-226-27915-2|url=https://books.google.com/books?id=DN-9m2jSo8YC |access-date=29 January 2018}}</ref-->
* Characterizations (observations, definitions, and measurements of the subject of inquiry)
* Hypotheses (theoretical, hypothetical explanations of observations and measurements of the subject)
* Predictions (inductive and deductive reasoning from the hypothesis or theory)
* Experiments (tests of all of the above)
 
Each element of the scientific method is subject to [[peer review]] for possible mistakes. These activities do not describe all that scientists do but [[#Beliefs and biases|apply mostly to experimental sciences]] (e.g., physics, chemistry, biology, and psychology). The elements above are often taught in [[education|the educational system]] as "the scientific method".{{efn-ua|name= aQuestion| In the [[Inquiry-based learning|inquiry-based education]] paradigm, the stage of "characterization, observation, definition, ..." is more briefly summed up under the rubric of a Question. The question at some stage might be as basic as the [[5Ws]], or ''is this answer true?'', or ''who else might know this?'', or ''can I ask them?'', and so forth. The questions of the inquirer spiral until the goal is reached.}}
 
The scientific method is not a single recipe: it requires intelligence, imagination, and creativity.<ref>{{harvnb|Einstein|Infeld|1938|p=92}}: "To raise new questions, new possibilities, to regard old problems from a new angle, requires creative imagination and marks real advance in science."</ref> In this sense, it is not a mindless set of standards and procedures to follow, but is rather an [[#Evaluation and improvement|ongoing cycle]], constantly developing more useful, accurate, and comprehensive models and methods. For example, when Einstein developed the Special and General Theories of Relativity, he did not in any way refute or discount Newton's ''Principia''. On the contrary, if the astronomically massive, the feather-light, and the extremely fast are removed from Einstein's theories – all phenomena Newton could not have observed – Newton's equations are what remain. Einstein's theories are expansions and refinements of Newton's theories and, thus, increase confidence in Newton's work.
 
{{anchor|aGuideline}}An iterative,<ref name=" Brody-1993" /> pragmatic<ref name=" truthSought4sake" /> scheme of the four points above is sometimes offered as a guideline for proceeding:<ref>{{cite journal |vauthors=Crawford S, Stucki L |year=1990 |title=Peer review and the changing research record |journal=Journal of the American Society for Information Science |volume=41 |issue=3 |pages=223–228 |doi=10.1002/(SICI)1097-4571(199004)41:3<223::AID-ASI14>3.0.CO;2-3 }}</ref>
 
# Define a question
Line 79 ⟶ 153:
 
While this schema outlines a typical hypothesis/testing method,{{sfn|Gauch|2003|loc=esp. chapters 5–8}} many philosophers, historians, and sociologists of science, including [[Paul Feyerabend]],{{efn|name= descartes| "no opinion, however absurd and incredible, can be imagined, which has not been maintained by some of the philosophers". —Descartes<ref name= discourseOnMethod >[[René Descartes]] (1637) [https://en.wikisource.org/wiki/Discourse_on_the_Method/Part_2 Discourse on the Method/Part 2] {{Webarchive|url=https://web.archive.org/web/20210901150801/https://en.wikisource.org/wiki/Discourse_on_the_Method/Part_2 |date=2021-09-01 }} Part II</ref> }} claim that such descriptions of scientific method have little relation to the ways that science is actually practiced.
 
==Elements of the scientific method==
{{anchor|Context}}The basic elements of the scientific method are illustrated by the following example (which occurred from 1944 to 1953) from the discovery of the structure of DNA (marked with [[File:DNA icon.svg|frameless|22x22px|link=|alt=DNA label]] and indented).
 
===Characterizations===
<blockquote>{{Anchor|DNA-characterizations}}[[File:DNA icon.svg|frameless|22x22px|link=|alt=DNA label]] In 1950, it was known that [[genetic inheritance]] had a mathematical description, starting with the studies of [[Gregor Mendel]], and that DNA contained genetic information (Oswald Avery's ''transforming principle'').{{sfn|McCarty|1985|page=252}} But the mechanism of storing genetic information (i.e., genes) in DNA was unclear. Researchers in [[William Lawrence Bragg|Bragg's]] laboratory at [[University of Cambridge|Cambridge University]] made [[X-ray]] [[diffraction]] pictures of various [[molecule]]s, starting with [[crystal]]s of [[salt]], and proceeding to more complicated substances. Using clues painstakingly assembled over decades, beginning with its chemical composition, it was determined that it should be possible to characterize the physical structure of DNA, and the X-ray images would be the vehicle.{{sfn|McElheny|2004|p=34}}</blockquote>The scientific method depends upon increasingly sophisticated characterizations of the subjects of investigation. (The ''subjects'' can also be called [[:Category:Lists of unsolved problems|''unsolved problems'']] or the ''unknowns''.){{efn-ua|name= aQuestion}} For example, [[Benjamin Franklin]] conjectured, correctly, that [[St. Elmo's fire]] was [[electrical]] in [[nature]], but it has taken a long series of experiments and theoretical changes to establish this. While seeking the pertinent properties of the subjects, careful thought may also [[logical consequence|entail]] some definitions and observations; the [[observations]] often demand careful [[measurements]] and/or counting.
 
The question can refer to the explanation of a specific [[observation]],{{efn-ua|name= aQuestion}} as in "Why is the sky blue?" but can also be open-ended, as in "How can I [[Drug design|design a drug]] to cure this particular disease?" This stage frequently involves finding and evaluating evidence from previous experiments, personal scientific observations or assertions, as well as the work of other scientists. If the answer is already known, a different question that builds on the evidence can be posed. When applying the scientific method to research, determining a good question can be very difficult and it will affect the outcome of the investigation.<ref>{{cite book |url=https://books.google.com/books?id=C7pZftbI0ZMC |title=Translational and Experimental Clinical Research |publisher=Lippincott Williams & Wilkins |year=2005 |isbn=9780781755658 |editor-last1=Schuster |editor-first1=Daniel P. |chapter=Ch. 1 |access-date=2021-11-27 |editor-last2=Powers |editor-first2=William J. |archive-url=https://web.archive.org/web/20231129112636/https://books.google.com/books?id=C7pZftbI0ZMC |archive-date=2023-11-29 |url-status=live}} This chapter also discusses the different types of research questions and how they are produced.</ref>
 
The systematic, careful collection of measurements or counts of relevant quantities is often the critical difference between [[Pseudoscience|pseudo-sciences]], such as alchemy, and science, such as chemistry or biology. Scientific measurements are usually tabulated, graphed, or mapped, and statistical manipulations, such as [[correlation]] and [[regression analysis|regression]], performed on them. The measurements might be made in a controlled setting, such as a laboratory, or made on more or less inaccessible or unmanipulatable objects such as stars or human populations. The measurements often require [[#Instrumentation|specialized]] [[scientific instrument]]s such as [[thermometer]]s, [[Spectrometer|spectroscopes]], [[particle accelerator]]s, or [[voltmeter]]s, and the progress of a scientific field is usually intimately tied to their invention and improvement.
[[File:Perihelio.svg|right|thumb|[[Apsidal precession|Precession]] of the [[Perihelion and aphelion|perihelion]]{{snd}}exaggerated in the case of Mercury, but observed in the case of [[S2 (star)|S2]]'s [[apsidal precession]] around [[Sagittarius A*]]<ref>{{cite web |date=16 April 2020 |title=ESO Telescope Sees Star Dance Around Supermassive Black Hole, Proves Einstein Right |url=https://www.eso.org/public/news/eso2006/ |url-status=live |archive-url=https://web.archive.org/web/20200515210420/https://www.eso.org/public/news/eso2006/ |archive-date=2020-05-15 |access-date=2020-04-17 |work=Science Release |publisher=[[European Southern Observatory]]}}</ref>]]
The characterization element can require extended and extensive study, even centuries. It took thousands of years of measurements, from the [[Chaldea]]n, [[India]]n, [[History of Iran|Persian]], [[Greece|Greek]], [[Arabs|Arabic]], and [[Ethnic groups in Europe|European]] astronomers, to fully record the motion of planet [[Earth]]. Newton was able to include those measurements into the consequences of his [[Newton's laws of motion|laws of motion]]. But the [[Perihelion and aphelion|perihelion]] of the planet [[Mercury (planet)|Mercury]]'s [[orbit]] exhibits a precession that cannot be fully explained by Newton's laws of motion (see diagram to the right), as Leverrier pointed out in 1859. The observed difference for Mercury's [[Apsidal precession|precession]] between Newtonian theory and observation was one of the things that occurred to [[Albert Einstein]] as a possible early test of his theory of [[General relativity]]. His relativistic calculations matched observation much more closely than did Newtonian theory. The difference is approximately 43 arc-seconds per century.
 
{{Blockquote|text=I am not accustomed to saying anything with certainty after only one or two observations.|author=[[Andreas Vesalius]]|source=(1546)<ref>
Line 97 ⟶ 164:
 
====Uncertainty====
Measurements in scientific work are also usually accompanied by estimates of their [[uncertainty]].<ref name=" conjugatePairs" /> The uncertainty is often estimated by making repeated measurements of the desired quantity. Uncertainties may also be calculated by consideration of the uncertainties of the individual underlying quantities used. Counts of things, such as the number of people in a nation at a particular time, may also have an uncertainty due to [[data collection]] limitations. Or counts may represent a sample of desired quantities, with an uncertainty that depends upon the [[sampling method]] used and the number of samples taken.
 
====Definition====
Measurements demand the use of ''[[operational definition]]s'' of relevant quantities. That is, a scientific quantity is described or defined by how it is measured, as opposed to some more vague, inexact, or "idealized" definition. For example, [[electric current]], measured in amperes, may be operationally defined in terms of the mass of silver deposited in a certain time on an electrode in an electrochemical device that is described in some detail. The operational definition of a thing often relies on comparisons with standards: the operational definition of "mass" ultimately relies on the use of an artifact, such as a particular kilogram of platinum-iridium kept in a laboratory in France.
 
The scientific definition of a term sometimes differs substantially from its [[natural language]] usage. For example, [[mass]] and [[weight]] overlap in meaning in common discourse, but have distinct meanings in [[mechanics]]. Scientific quantities are often characterized by their [[units of measurement|units of measure]] which can later be described in terms of conventional physical units when communicating the work.
 
New theories are sometimes developed after realizing certain terms have not previously been sufficiently clearly defined. For example, [[Albert Einstein]]'s first paper on [[Special relativity|relativity]] begins by defining [[Relativity of simultaneity|simultaneity]] and the means for determining [[length]]. These ideas were skipped over by [[Isaac Newton]] with, "I do not define [[time in physics#Galileo: the flow of time|time]], space, place and [[motion (physics)|motion]], as being well known to all." Einstein's paper then demonstrates that they (viz., absolute time and length independent of motion) were approximations. [[Francis Crick]] cautions us that when characterizing a subject, however, it can be premature to define something when it remains ill-understood.<ref>Crick, Francis (1994), ''The Astonishing Hypothesis'' {{ISBN|0-684-19431-7}} p. 20
</ref> In Crick's study of [[consciousness]], he actually found it easier to study [[awareness]] in the [[visual system]], rather than to study [[free will]], for example. His cautionary example was the gene; the gene was much more poorly understood before Watson and Crick's pioneering discovery of the structure of DNA; it would have been counterproductive to spend much time on the definition of the gene, before them.
 
====DNA-characterizations====
<span style="vertical-align:-120%">[[File:DNA icon (25x25).png|left|link=|alt=]]</span> The [[DNA#History|history]] of the discovery of the structure of DNA is a classic example of [[#Elements of the scientific method|the elements of the scientific method]]: in 1950 it was known that [[genetic inheritance]] had a mathematical description, starting with the studies of [[Gregor Mendel]], and that DNA contained genetic information (Oswald Avery's ''transforming principle'').{{sfn|McCarty|1985|page=252}} But the mechanism of storing genetic information (i.e., genes) in DNA was unclear. Researchers in [[William Lawrence Bragg|Bragg's]] laboratory at [[University of Cambridge|Cambridge University]] made [[X-ray]] [[diffraction]] pictures of various [[molecule]]s, starting with [[crystal]]s of [[salt]], and proceeding to more complicated substances. Using clues painstakingly assembled over decades, beginning with its chemical composition, it was determined that it should be possible to characterize the physical structure of DNA, and the X-ray images would be the vehicle.{{sfn|McElheny|2004|p=34}} [[#DNA-hypotheses|..''2. DNA-hypotheses'']]
 
====Another example: precession of Mercury====
[[File:Perihelio.svg|thumb|right|[[Apsidal precession|Precession]] of the [[Perihelion and aphelion|perihelion]]{{snd}}exaggerated in the case of Mercury, but observed in the case of [[S2 (star)|S2]]'s [[apsidal precession]] around [[Sagittarius A*]]<ref>{{cite web |publisher=[[European Southern Observatory]] |url=https://www.eso.org/public/news/eso2006/ |work=Science Release |date=16 April 2020 |title=ESO Telescope Sees Star Dance Around Supermassive Black Hole, Proves Einstein Right |access-date=2020-04-17 |archive-date=2020-05-15 |archive-url=https://web.archive.org/web/20200515210420/https://www.eso.org/public/news/eso2006/ |url-status=live }}</ref>]]
 
The characterization element can require extended and extensive study, even centuries. It took thousands of years of measurements, from the [[Chaldea]]n, [[India]]n, [[History of Iran|Persian]], [[Greece|Greek]], [[Arabs|Arabic]], and [[Ethnic groups in Europe|European]] astronomers, to fully record the motion of planet [[Earth]]. Newton was able to include those measurements into the consequences of his [[Newton's laws of motion|laws of motion]]. But the [[Perihelion and aphelion|perihelion]] of the planet [[Mercury (planet)|Mercury]]'s [[orbit]] exhibits a precession that cannot be fully explained by Newton's laws of motion (see diagram to the right), as Leverrier pointed out in 1859. The observed difference for Mercury's [[Apsidal precession|precession]] between Newtonian theory and observation was one of the things that occurred to [[Albert Einstein]] as a possible early test of his theory of [[General relativity]]. His relativistic calculations matched observation much more closely than did Newtonian theory. The difference is approximately 43 arc-seconds per century.
 
===Hypothesis development===
{{Main|Hypothesis formation}}
 
<blockquote>{{Anchor|DNA-hypotheses}}[[File:DNA icon.svg|frameless|22x22px|link=|alt=DNA label]] [[Linus Pauling]] proposed that DNA might be a [[triple helix]].<ref>{{harvnb|McElheny|2004|p=40}}: October 1951 — "That's what a helix should look like!" Crick exclaimed in delight (This is the Cochran-Crick-Vand-Stokes theory of the transform of a helix).</ref><ref>
A [[hypothesis]] is a suggested explanation of a phenomenon, or alternately a reasoned proposal suggesting a possible correlation between or among a set of phenomena.
{{harvnb|Judson|1979|p=157}}. {{"'}}The structure that we propose is a three-chain structure, each chain being a helix' – Linus Pauling"</ref> This hypothesis was also considered by [[Francis Crick]] and [[James D. Watson]] but discarded. When Watson and Crick learned of Pauling's hypothesis, they understood from existing data that Pauling was wrong.<ref>
{{harvnb|McElheny|2004|pp=49–50}}: January 28, 1953 — Watson read Pauling's pre-print, and realized that in Pauling's model, DNA's phosphate groups had to be un-ionized. But DNA is an acid, which contradicts Pauling's model.
</ref> and that Pauling would soon admit his difficulties with that structure.</blockquote>{{Anchor|Hypothesis}}A [[hypothesis]] is a suggested explanation of a phenomenon, or alternately a reasoned proposal suggesting a possible correlation between or among a set of phenomena.
 
Normally hypotheses have the form of a [[mathematical model]]. Sometimes, but not always, they can also be formulated as [[existential quantification|existential statements]], stating that some particular instance of the phenomenon being studied has some characteristic and causal explanations, which have the general form of [[universal quantification|universal statements]], stating that every instance of the phenomenon has a particular characteristic.
 
Scientists are free to use whatever resources they have – their own creativity, ideas from other fields, [[inductive reasoning]], [[Bayesian inference]], and so on – to imagine possible explanations for a phenomenon under study. {{anchor|noLogicalBridge}}Albert Einstein once observed that "there is no logical bridge between phenomena and their theoretical principles."<ref>{{cite book |last1=Einstein |first1=Albert |title=The World as I See It |date=1949 |publisher=Philosophical Library |location=New York |pages=24–28}}</ref>{{efn|name= leapIsInvolved |"A leap is involved in all thinking" —John Dewey<ref>{{harvnb|Dewey|1910|p=26}}</ref> }} [[Charles Sanders Peirce]], borrowing a page from [[Aristotle]] (''[[Prior Analytics]]'', [[Inquiry#Abduction|2.25]])<ref name="aristotleAbduction" >[https://en.wikisource.org/wiki/Organon_(Owen)/Prior_Analytics/Book_2#Chapter_25 Aristotle (trans. 1853) ''Prior Analytics'' 2.25] {{Webarchive|url=https://web.archive.org/web/20210910034741/https://en.wikisource.org/wiki/Organon_(Owen)/Prior_Analytics/Book_2#Chapter_25 |date=2021-09-10 }} via Wikisource</ref> described the incipient stages of [[inquiry]], instigated by the "irritation of doubt" to venture a plausible guess, as ''[[abductive reasoning]]''.<ref name="How">{{cite wikisource|title=How to Make Our Ideas Clear|first=Charles Sanders|last=Peirce|year=1877|wslink=How to Make Our Ideas Clear|volume=12|pages=286–302|journal=Popular Science Monthly}}</ref>{{rp|II,p.290}} The history of science is filled with stories of scientists claiming a "flash of inspiration", or a hunch, which then motivated them to look for evidence to support or refute their idea. [[Michael Polanyi]] made such creativity the centerpiece of his discussion of methodology.
 
[[William Glen (geologist and historian)|William Glen]] observes that{{sfn|Glen|1994|pp=37–38}}
Line 122 ⟶ 197:
In general scientists tend to look for theories that are "[[Elegance|elegant]]" or "[[beauty|beautiful]]". Scientists often use these terms to refer to a theory that is following the known facts but is nevertheless relatively simple and easy to handle. [[Occam's Razor]] serves as a rule of thumb for choosing the most desirable amongst a group of equally explanatory hypotheses.
 
To minimize the [[confirmation bias]] which results from entertaining a single hypothesis, [[strong inference]] emphasizes the need for entertaining multiple alternative hypotheses.<ref name=" platt" >{{cite journal |last=Platt |first=John R. |author-link=John R. Platt |date=16 October 1964 |title=Strong Inference |journal=Science |volume=146 |issue=3642 |pages=347– |doi=10.1126/science.146.3642.347|pmid=17739513 |bibcode=1964Sci...146..347P }}</ref>
 
====DNA-hypotheses====
<span style="vertical-align:-120%">[[File:DNA icon (25x25).png|left|link=|alt=]]</span> [[Linus Pauling]] proposed that DNA might be a [[triple helix]].<ref>
{{harvnb|Judson|1979|p=157}}. {{"'}}The structure that we propose is a three-chain structure, each chain being a helix' – Linus Pauling"</ref> This hypothesis was also considered by [[Francis Crick]] and [[James D. Watson]] but discarded. When Watson and Crick learned of Pauling's hypothesis, they understood from existing data that Pauling was wrong.<ref>
{{harvnb|McElheny|2004|pp=49–50}}: January 28, 1953 — Watson read Pauling's pre-print, and realized that in Pauling's model, DNA's phosphate groups had to be un-ionized. But DNA is an acid, which contradicts Pauling's model.
</ref> and that Pauling would soon admit his difficulties with that structure. So, the race was on to figure out the correct structure (except that Pauling did not realize at the time that he was in a race) ''[[#DNA-predictions|..3. DNA-predictions]]''
 
===Predictions from the hypothesis===
{{Further|Prediction#Science}}
{{Further|Prediction#Science}}<blockquote>{{Anchor|DNA-predictions}}[[File:DNA icon.svg|frameless|22x22px|link=|alt=DNA label]] [[James D. Watson]], [[Francis Crick]], and others hypothesized that DNA had a helical structure. This implied that DNA's X-ray diffraction pattern would be 'x shaped'.<ref name="Crick pp. 137–138">{{harvnb|Judson|1979|pp=137–138}}: "Watson did enough work on [[Tobacco mosaic virus]] to produce the diffraction pattern for a helix, per Crick's work on the transform of a helix."</ref><ref name="McElheny 2004 43">{{harvnb|McElheny|2004|p=43}}: June 1952 — Watson had succeeded in getting X-ray pictures of TMV showing a diffraction pattern consistent with the transform of a helix.</ref> This prediction followed from the work of Cochran, Crick and Vand<ref name="HelixTransform">Cochran W, Crick FHC and Vand V. (1952) "The Structure of Synthetic Polypeptides. I. The Transform of Atoms on a Helix", ''[[Acta Crystallographica|Acta Crystallogr.]]'', '''5''', 581–586.</ref> (and independently by Stokes). The Cochran-Crick-Vand-Stokes theorem provided a mathematical explanation for the empirical observation that diffraction from helical structures produces x shaped patterns.
 
In their first paper, Watson and Crick also noted that the [[double helix]] structure they proposed provided a simple mechanism for [[DNA replication]], writing, "It has not escaped our notice that the specific pairing we have postulated immediately suggests a possible copying mechanism for the genetic material".<ref>{{harvnb|McElheny|2004|p=68}}: ''Nature'' April 25, 1953.</ref></blockquote>{{Anchor|Prediction}}Any useful hypothesis will enable [[prediction]]s, by [[reasoning]] including [[deductive reasoning]]. It might predict the outcome of an experiment in a laboratory setting or the observation of a phenomenon in nature. The prediction can also be statistical and deal only with probabilities.
 
It is essential that the outcome of testing such a prediction be currently unknown. Only in this case does a successful outcome increase the probability that the hypothesis is true. If the outcome is already known, it is called a consequence and should have already been considered while [[#Hypothesis development|formulating the hypothesis]].
Line 133 ⟶ 214:
If the predictions are not accessible by observation or experience, the hypothesis is not yet testable and so will remain to that extent unscientific in a strict sense. A new technology or theory might make the necessary experiments feasible. For example, while a hypothesis on the existence of other intelligent species may be convincing with scientifically based speculation, no known experiment can test this hypothesis. Therefore, science itself can have little to say about the possibility. In the future, a new technique may allow for an experimental test and the speculation would then become part of accepted science.
 
====DNA-predictions====
For example, Einstein's theory of [[general relativity]] makes several specific predictions about the observable structure of [[spacetime]], such as that [[light]] bends in a [[gravitational field]], and that the amount of bending depends in a precise way on the strength of that gravitational field. [[Arthur Eddington]]'s [[Eddington experiment|observations made during a 1919 solar eclipse]] supported General Relativity rather than Newtonian [[gravitation]].<ref>In March 1917, the [[Royal Astronomical Society]] announced that on May 29, 1919, the occasion of a [[total eclipse]] of the sun would afford favorable conditions for testing Einstein's [[General theory of relativity]]. One expedition, to [[Sobral, Ceará]], [[Brazil]], and Eddington's expedition to the island of [[Principe]] yielded a set of photographs, which, when compared to photographs taken at [[Sobral, Ceará|Sobral]] and at [[Greenwich Observatory]] showed that the deviation of light was measured to be 1.69 [[Arc-second|arc-seconds]], as compared to Einstein's desk prediction of 1.75 [[Arc-second|arc-seconds]]. – Antonina Vallentin (1954), ''Einstein'', as quoted by Samuel Rapport and Helen Wright (1965), ''Physics'', New York: Washington Square Press, pp. 294–295.</ref>
<span style="vertical-align:-120%">[[File:DNA icon (25x25).png|left|link=|alt=]]</span> [[James D. Watson]], [[Francis Crick]], and others hypothesized that DNA had a helical structure. This implied that DNA's X-ray diffraction pattern would be 'x shaped'.<ref name="Crick pp. 137–138"/><ref name="McElheny 2004 43"/> This prediction followed from the work of Cochran, Crick and Vand<ref name="HelixTransform"/> (and independently by Stokes). The Cochran-Crick-Vand-Stokes theorem provided a mathematical explanation for the empirical observation that diffraction from helical structures produces x shaped patterns.
 
In their first paper, Watson and Crick also noted that the [[double helix]] structure they proposed provided a simple mechanism for [[DNA replication]], writing, "It has not escaped our notice that the specific pairing we have postulated immediately suggests a possible copying mechanism for the genetic material".<ref>{{harvnb|McElheny|2004|p=68}}: ''Nature'' April 25, 1953.</ref> [[#DNA-experiments|'' ..4. DNA-experiments'']]
 
====Another example: general relativity====
[[File:Gravitational lens-full.jpg|right|thumb|[[gravitational lensing|Einstein's prediction (1907): Light bends in a gravitational field]]]]
 
Einstein's theory of [[general relativity]] makes several specific predictions about the observable structure of [[spacetime]], such as that [[light]] bends in a [[gravitational field]], and that the amount of bending depends in a precise way on the strength of that gravitational field. [[Arthur Eddington]]'s [[Eddington experiment|observations made during a 1919 solar eclipse]] supported General Relativity rather than Newtonian [[gravitation]].<ref>In March 1917, the [[Royal Astronomical Society]] announced that on May 29, 1919, the occasion of a [[total eclipse]] of the sun would afford favorable conditions for testing Einstein's [[General theory of relativity]]. One expedition, to [[Sobral, Ceará]], [[Brazil]], and Eddington's expedition to the island of [[Principe]] yielded a set of photographs, which, when compared to photographs taken at [[Sobral, Ceará|Sobral]] and at [[Greenwich Observatory]] showed that the deviation of light was measured to be 1.69 [[arc-second]]s, as compared to Einstein's desk prediction of 1.75 [[arc-second]]s. – Antonina Vallentin (1954), ''Einstein'', as quoted by Samuel Rapport and Helen Wright (1965), ''Physics'', New York: Washington Square Press, pp. 294–295.</ref>
 
===Experiments===
{{Main|Experiment}}
{{Main|Experiment}}<blockquote>{{Anchor|DNA-experiments}}[[File:DNA icon.svg|frameless|22x22px|link=|alt=DNA label]] Watson and Crick showed an initial (and incorrect) proposal for the structure of DNA to a team from [[King's College London]] – [[Rosalind Franklin]], [[Maurice Wilkins]], and [[Raymond Gosling]]. Franklin immediately spotted the flaws which concerned the water content. Later Watson saw Franklin's [[photo 51]], a detailed X-ray diffraction image, which showed an X-shape<ref>{{cite web |title=The Secret of Photo 51 |url=https://www.pbs.org/wgbh/nova/photo51/ |url-status=live |archive-url=https://web.archive.org/web/20170831201252/http://www.pbs.org/wgbh/nova/photo51/ |archive-date=2017-08-31 |access-date=2017-09-11 |work=NOVA |publisher=PBS}}</ref> and was able to confirm the structure was helical.<ref name="TeaTime">{{harvnb|McElheny|2004|p=52}}: Friday, January 30, 1953. Tea time — Franklin confronts Watson and his paper – "Of course it [Pauling's pre-print] is wrong. DNA is not a helix." However, Watson then visits Wilkins' office, sees [[photo 51]], and immediately recognizes the diffraction pattern of a helical structure. But additional questions remained, requiring additional iterations of their research. For example, the number of strands in the backbone of the helix (Crick suspected 2 strands, but cautioned Watson to examine that more critically), the location of the base pairs (inside the backbone or outside the backbone), etc. One key point was that they realized that the quickest way to reach a result was not to continue a mathematical analysis, but to build a physical model. Later that evening — Watson urges Wilkins to begin model-building immediately. But Wilkins agrees to do so only after Franklin's departure.</ref><ref name="Watson 1968 167">{{harvnb|Watson|1968|p=167}}: "The instant I saw the picture my mouth fell open and my pulse began to race." Page 168 shows the X-shaped pattern of the B-form of [[DNA]], clearly indicating crucial details of its helical structure to Watson and Crick.</ref></blockquote>{{anchor|suitableTest|Testing|Crucial experiment}}Once predictions are made, they can be sought by experiments. If the test results contradict the predictions, the hypotheses which entailed them are called into question and become less tenable. Sometimes the experiments are conducted incorrectly or are not very well designed when compared to a [[crucial experiment]]. If the experimental results confirm the predictions, then the hypotheses are considered more likely to be correct, but might still be wrong and continue to be subject to [[#Evaluation and improvement|further testing.]] The [[experimental control]] is a technique for dealing with observational error. This technique uses [[#the control group|the contrast between multiple samples, or observations, or populations, under differing conditions]], to see what varies or what remains the same. We vary the conditions for the acts of measurement, to help isolate what has changed. [[Mill's canons]] can then help us figure out what the important factor is.<ref>[[John Stuart Mill|Mill, John Stuart]], "A System of Logic", University Press of the Pacific, Honolulu, 2002, {{ISBN|1-4102-0252-6}}.</ref> [[Factor analysis]] is one technique for discovering the important factor in an effect.
 
Once predictions are made, they can be sought by experiments. If the test results contradict the predictions, the hypotheses which entailed them are called into question and become less tenable. Sometimes the experiments are conducted incorrectly or are not very well designed when compared to a [[crucial experiment]]. If the experimental results confirm the predictions, then the hypotheses are considered more likely to be correct, but might still be wrong and continue to be subject to [[#Evaluation and improvement|further testing.]] The [[experimental control]] is a technique for dealing with observational error. This technique uses [[#the control group|the contrast between multiple samples, or observations, or populations, under differing conditions]], to see what varies or what remains the same. We vary the conditions for the acts of measurement, to help isolate what has changed. [[Mill's canons]] can then help us figure out what the important factor is.<ref>[[John Stuart Mill|Mill, John Stuart]], "A System of Logic", University Press of the Pacific, Honolulu, 2002, {{ISBN|1-4102-0252-6}}.</ref> [[Factor analysis]] is one technique for discovering the important factor in an effect.
Depending on the predictions, the experiments can have different shapes. It could be a classical experiment in a laboratory setting, a [[double-blind]] study or an archaeological [[excavation (archaeology)|excavation]]. Even taking a plane from [[New York City|New York]] to [[Paris]] is an experiment that tests the [[aerodynamics|aerodynamical]] hypotheses used for constructing the plane.
 
Depending on the predictions, the experiments can have different shapes. It could be a classical experiment in a laboratory setting, a [[double-blind]] study or an archaeological [[excavation (archaeology)|excavation]]. Even taking a plane from [[New York City|New York]] to [[Paris]] is an experiment that tests the [[aerodynamics|aerodynamical]] hypotheses used for constructing the plane.
These institutions thereby reduce the research function to a cost/benefit,<ref name="conjugatePairs" /> which is expressed as money, and the time and attention of the researchers to be expended,<ref name="conjugatePairs" /> in exchange for a report to their constituents.<ref name="nsf">National Science Foundation (NSF) (2021) [https://www.nsf.gov/oig/reports/ NSF Reports] {{Webarchive|url=https://web.archive.org/web/20210817165231/https://www.nsf.gov/oig/reports/|date=2021-08-17}} and [https://www.nsf.gov/news/ News] {{Webarchive|url=https://web.archive.org/web/20210820162008/https://www.nsf.gov/news/|date=2021-08-20}}</ref> Current large instruments, such as CERN's [[Large Hadron Collider]] (LHC),<ref name="lhc">{{Cite web |title=LHC long term schedule |url=https://lhc-commissioning.web.cern.ch/lhc-commissioning/schedule/LHC-long-term.htm |url-status=live |archive-url=https://web.archive.org/web/20200425105121/https://lhc-commissioning.web.cern.ch/lhc-commissioning/schedule/LHC-long-term.htm |archive-date=2020-04-25 |access-date=2021-08-22 |website=lhc-commissioning.web.cern.ch}} (2021)</ref> or [[LIGO]],<ref name="ligo">{{cite web |title=ligo.caltech.edu (1999) Laser Interferometer Gravitational-Wave Observatory |url=https://www.ligo.caltech.edu/ |url-status=live |archive-url=https://web.archive.org/web/20210901125538/https://www.ligo.caltech.edu/ |archive-date=2021-09-01 |access-date=2021-08-30}}</ref> or the [[National Ignition Facility]] (NIF),<ref name="nif">{{cite web |title=NIF (2021) What Is the National Ignition Facility? |url=https://lasers.llnl.gov/about/what-is-nif |url-status=live |archive-url=https://web.archive.org/web/20170731064919/https://lasers.llnl.gov/about/what-is-nif |archive-date=2017-07-31 |access-date=2021-08-22}}</ref> or the [[International Space Station]] (ISS),<ref name="iss">{{cite web |date=12 January 2015 |title=ISS (2021) International Space Station |url=https://www.nasa.gov/mission_pages/station/main/index.html |url-status=live |archive-url=https://web.archive.org/web/20050907073730/http://www.nasa.gov/mission_pages/station/main/index.html |archive-date=2005-09-07 |access-date=2021-08-22}}</ref> or the [[James Webb Space Telescope]] (JWST),<ref name="jwst">{{cite web |title=JWST (2021) WEBB Space Telescope |url=https://www.jwst.nasa.gov/ |url-status=live |archive-url=https://web.archive.org/web/20120104225155/http://www.jwst.nasa.gov/ |archive-date=2012-01-04 |access-date=2021-08-22}}</ref><ref name="jwstDeploymentSeq">James Webb Space Telescope (JWST) [https://www.youtube.com/watch?v=RzGLKQ7_KZQ (12 Nov 2021) James Webb Space Telescope Deployment Sequence (Nominal)] {{Webarchive|url=https://web.archive.org/web/20211223035530/https://www.youtube.com/watch?v=RzGLKQ7_KZQ|date=2021-12-23}} highlights the predictions from launch to day+29,</ref> entail expected costs of billions of dollars, and timeframes extending over decades. These kinds of institutions affect public policy, on a national or even international basis, and the researchers would require shared access to such machines and their [[#otherScientists|adjunct infrastructure]].{{efn|name= feedTheMachinery| The machinery of the mind can only transform knowledge, but never originate it, unless it be fed with facts of observation. —[[C.S. Peirce]]<ref name= How/>}}<ref name="Crutchfield" />
 
{{anchor|ethicalPosition}}Scientists assume an attitude of openness and accountability on the part of those experimenting. Detailed record-keeping is essential, to aid in recording and reporting on the experimental results, and supports the effectiveness and integrity of the procedure. They will also assist in reproducing the experimental results, likely by others. Traces of this approach can be seen in the work of [[Hipparchus]] (190–120 BCE), when determining a value for the precession of the Earth, while [[Scientific control|controlled experiments]] can be seen in the works of [[Muhammad ibn Jābir al-Harrānī al-Battānī|al-Battani]] (853–929 CE)<ref>[[Muhammad ibn Jābir al-Harrānī al-Battānī|al-Battani]], ''De Motu Stellarum'' [[Latin translations of the 12th century|translation from Arabic to Latin in 1116]], as cited by E. S. Kennedy, ''A Survey of Islamic Astronomical Tables,'' (Transactions of the American Philosophical Society, New Series, 46, 2), Philadelphia, 1956, pp. 10–11, 32–34.</ref> and [[#alhazen|Alhazen]] (965–1039 CE).<ref name=" smith2001" >{{cite book |author=Alhacen
|editor-last=Smith
|editor-first=A. Mark
Line 154 ⟶ 243:
|oclc= 47168716
}}</ref>{{efn|"And this [experiment using a [[camera obscura]]] can be tried anytime". Book I [6.86] p.379}}{{efn|''[[Book of Optics]]'' Book II [3.52] to [3.66] Summary p.444 for Alhazen's experiments on color; pp.343—394 for his physiological experiments on the eye}}{{efn|name= straightLinesOnly |''[[Book of Optics]]'' Book Seven, Chapter Two [2.1] p.220: — light travels through transparent bodies, such as air, water, glass, transparent stones, in straight lines. "Indeed, this is observable by means of experiment".<ref name= smith2010 >{{harvnb|Smith|2010|p=220}} Book Seven covers refraction.</ref> }}
 
====DNA-experiments====
<span style="vertical-align:-120%">[[File:DNA icon (25x25).png|left|link=|alt=]]</span> Watson and Crick showed an initial (and incorrect) proposal for the structure of DNA to a team from [[King's College London]] – [[Rosalind Franklin]], [[Maurice Wilkins]], and [[Raymond Gosling]]. Franklin immediately spotted the flaws which concerned the water content. Later Watson saw Franklin's detailed [[Photo 51|X-ray diffraction images]] which showed an X-shape<ref>{{cite web |url=https://www.pbs.org/wgbh/nova/photo51/ |publisher=PBS |work=NOVA |title=The Secret of Photo 51 |access-date=2017-09-11 |archive-date=2017-08-31 |archive-url=https://web.archive.org/web/20170831201252/http://www.pbs.org/wgbh/nova/photo51/ |url-status=live }}</ref> and was able to confirm the structure was helical.<ref name="TeaTime"/><ref name="Watson 1968 167"/> This rekindled Watson and Crick's model building and led to the correct structure. [[#DNA-characterizations|''..1. DNA-characterizations'']]
 
===Evaluation and improvement===
The scientific method is iterative. At any stage, it is possible to refine its [[accuracy and precision]], so that some consideration will lead the scientist to repeat an earlier part of the process. Failure to develop an interesting hypothesis may lead a scientist to re-define the subject under consideration. Failure of a hypothesis to produce interesting and testable predictions may lead to reconsideration of the hypothesis or of the definition of the subject. Failure of an experiment to produce interesting results may lead a scientist to reconsider the experimental method, the hypothesis, or the definition of the subject.
<blockquote>{{Anchor|DNA-iterations}}[[File:DNA icon.svg|frameless|22x22px|link=|alt=DNA label]] Watson and Crick then produced their model, using this information along with the previously known information about DNA's composition, especially Chargaff's rules of base pairing.<ref name="SameShape">{{harvnb|McElheny|2004|pp=57–59}}: Saturday, February 28, 1953 — Watson found the base-pairing mechanism which explained [[Chargaff's rules]] using his cardboard models.</ref> After considerable fruitless experimentation, being discouraged by their superior from continuing, and numerous false starts,<ref>{{harvnb|McElheny|2004|p=53}}: The weekend (January 31 – February 1) — After seeing photo 51, Watson informed Bragg of the X-ray diffraction image of DNA in B form. Bragg permitted them to restart their research on DNA (that is, model building).</ref><ref>{{harvnb|McElheny|2004|p=54}}: Sunday, February 8, 1953 — Maurice Wilkes gave Watson and Crick permission to work on models, as Wilkes would not be building models until Franklin left DNA research.</ref><ref>{{harvnb|McElheny|2004|p=56}}: [[Jerry Donohue]], on sabbatical from Pauling's lab and visiting Cambridge, advises Watson that textbook form of the base pairs was incorrect for DNA base pairs; rather, the keto form of the base pairs should be used instead. This form allowed the bases' hydrogen bonds to pair 'unlike' with 'unlike', rather than to pair 'like' with 'like', as Watson was inclined to model, based on the textbook statements. On February 27, 1953, Watson was convinced enough to make cardboard models of the nucleotides in their keto form.</ref> Watson and Crick were able to infer the essential structure of [[DNA]] by concrete [[model (abstract)|modeling]] [[DNA#History|of the physical shapes]] of the [[nucleotide]]s which comprise it.<ref name="SameShape" /><ref>
{{harvnb|Watson|1968|pp=194–197}}: "Suddenly I became aware that an [[adenine]]-[[thymine]] pair held together by two [[Hydrogen bond|hydrogen bonds]] was identical in shape to a [[guanine]]-[[cytosine]] pair held together by at least two hydrogen bonds.&nbsp;..."</ref><ref>
{{harvnb|McElheny|2004|p=57}}: Saturday, February 28, 1953 — Watson tried 'like with like' and admitted these base pairs didn't have hydrogen bonds that line up. But after trying 'unlike with unlike', and getting [[Jerry Donohue]]'s approval, the base pairs turned out to be identical in shape (as Watson stated above in his 1968 ''Double Helix'' memoir quoted above). Watson now felt confident enough to inform Crick. (Of course, 'unlike with unlike' increases the number of possible [[Codon|codons]], if this scheme were a [[genetic code]].)
</ref> They were guided by the bond lengths which had been deduced by [[Linus Pauling]] and by [[Rosalind Franklin]]'s X-ray diffraction images.</blockquote>{{Anchor|Analysis}}The scientific method is iterative. At any stage, it is possible to refine its [[accuracy and precision]], so that some consideration will lead the scientist to repeat an earlier part of the process. Failure to develop an interesting hypothesis may lead a scientist to re-define the subject under consideration. Failure of a hypothesis to produce interesting and testable predictions may lead to reconsideration of the hypothesis or of the definition of the subject. Failure of an experiment to produce interesting results may lead a scientist to reconsider the experimental method, the hypothesis, or the definition of the subject.
 
{{anchor|alhazen}}By 1027, [[Alhazen]], based on his measurements of the [[refraction]] of light, was able to deduce that [[outer space]] was less dense than [[air]], that is: "the body of the heavens is rarer than the body of air".<ref name=" alhacenOnRefraction4.28" >{{harvnb|Smith|2010}} Book 7, [4.28] p.270</ref> In 1079 [[Ibn Mu'adh al-Jayyani|Ibn Mu'adh]]'s ''Treatise On Twilight'' was able to infer that Earth's atmosphere was 50 miles thick, based on [[atmospheric refraction]] of the sun's rays.{{efn|name= crepusculis|1= The Sun's rays are still visible at [[twilight]] in the morning and evening due to atmospheric refraction even when the depression angle of the sun is 18° below the horizon.<ref name= brGoldstein >Goldstein, Bernard R. (1977) [[Ibn Mu'adh al-Jayyani|Ibn Mu'adh]]'s "[https://www.jstor.org/stable/41133483 (1079) Treatise On Twilight and the Height of the Atmosphere] {{Webarchive|url=https://web.archive.org/web/20220921011840/https://www.jstor.org/stable/41133483 |date=2022-09-21 }}" ''[[Archive for History of Exact Sciences]]'' Vol. '''17''', No. 2 (21.VII.1977), pp. 97-118 (22 pages) JSTOR. (''Treatise On Twilight'' was printed by F Risner in ''Opticae Thesaurus'' (1572) as ''Liber de crepusculis'', but attributed to Alhazen rather than Ibn Mu'adh.)</ref> }}
 
{{anchor|otherScientists}}Other scientists may start their own research and [[#Other components|enter the process]] at any stage. They might adopt the characterization and formulate their own hypothesis, or they might adopt the hypothesis and deduce their own predictions. Often the experiment is not done by the person who made the prediction, and the characterization is based on experiments done by someone else. Published results of experiments can also serve as a hypothesis predicting their own reproducibility.
 
====DNA-iterations====
<span style="vertical-align:-120%">[[File:DNA icon (25x25).png|left|link=|alt=]]</span> After considerable fruitless experimentation, being discouraged by their superior from continuing, and numerous false starts,<ref>{{harvnb|McElheny|2004|p=53}}: The weekend (January 31 – February 1) — After seeing photo 51, Watson informed Bragg of the X-ray diffraction image of DNA in B form. Bragg permitted them to restart their research on DNA (that is, model building).</ref><ref>{{harvnb|McElheny|2004|p=54}}: Sunday, February 8, 1953 — Maurice Wilkes gave Watson and Crick permission to work on models, as Wilkes would not be building models until Franklin left DNA research.</ref><ref>{{harvnb|McElheny|2004|p=56}}: [[Jerry Donohue]], on sabbatical from Pauling's lab and visiting Cambridge, advises Watson that textbook form of the base pairs was incorrect for DNA base pairs; rather, the keto form of the base pairs should be used instead. This form allowed the bases' hydrogen bonds to pair 'unlike' with 'unlike', rather than to pair 'like' with 'like', as Watson was inclined to model, based on the textbook statements. On February 27, 1953, Watson was convinced enough to make cardboard models of the nucleotides in their keto form.</ref> Watson and Crick were able to infer the essential structure of [[DNA]] by concrete [[model (abstract)|modeling]] [[DNA#History|of the physical shapes]] of the [[nucleotide]]s which comprise it.<ref name="SameShape" /><ref>
{{harvnb|Watson|1968|pp=194–197}}: "Suddenly I became aware that an [[adenine]]-[[thymine]] pair held together by two [[hydrogen bond]]s was identical in shape to a [[guanine]]-[[cytosine]] pair held together by at least two hydrogen bonds.&nbsp;..."</ref><ref>
{{harvnb|McElheny|2004|p=57}}: Saturday, February 28, 1953 — Watson tried 'like with like' and admitted these base pairs didn't have hydrogen bonds that line up. But after trying 'unlike with unlike', and getting [[Jerry Donohue]]'s approval, the base pairs turned out to be identical in shape (as Watson stated above in his 1968 ''Double Helix'' memoir quoted above). Watson now felt confident enough to inform Crick. (Of course, 'unlike with unlike' increases the number of possible [[codon]]s, if this scheme were a [[genetic code]].)
</ref> They were guided by the bond lengths which had been deduced by [[Linus Pauling]] and by [[Rosalind Franklin]]'s X-ray diffraction images. [[#DNA example|..''DNA Example'']]
 
===Confirmation<!--Linked from [[Confirmation (disambiguation)]]-->===
{{Main|Reproducibility}}
Science is a social enterprise, and scientific work tends to be accepted by the scientific community when it has been confirmed. Crucially, experimental and theoretical results must be reproduced by others within the scientific community. Researchers have given their lives for this vision; [[Georg Wilhelm Richmann]] was killed by [[ball lightning]] (1753) when attempting to replicate the 1752 kite-flying experiment of [[Benjamin Franklin]].<ref>{{cite journal |last=Krider |first=E. Philip |date=Jan 2006 |title=Benjamin Franklin and lightning rods |journal=Physics Today |volume=59 |issue=1 |page=42 |doi=10.1063/1.2180176 |bibcode=2006PhT....59a..42K |s2cid=110623159 |quote=On 6 August 1753, the Swedish scientist Georg Wilhelm Richmann was electrocuted in St. Petersburg ...|doi-access=free }}</ref>
 
To protect against bad science and fraudulent data, government research-granting agencies such as the [[National Science Foundation]], and science journals, including ''Nature'' and ''Science'', have a policy that researchers must archive their data and methods so that other researchers can test the data and methods and build on the research that has gone before. [[Scientific data archiving]] can be done at several national archives in the U.S. or the [[World Data Center]].
If an experiment cannot be [[Reproducibility|repeated]] to produce the same results, this implies that the original results might have been in error. As a result, it is common for a single experiment to be performed multiple times, especially when there are uncontrolled variables or other indications of [[Observational error|experimental error]]. For significant or surprising results, other scientists may also attempt to replicate the results for themselves, especially if those results would be important to their own work.<ref>{{cite web |title=Reconstruction of Galileo Galilei's experiment – the inclined plane |url=http://www.fyysika.ee/vorgustik/wp-content/uploads/2011/11/Reconstruction-of-Galileo-Galilei.pdf |url-status=live |archive-url=https://web.archive.org/web/20140429075745/http://www.fyysika.ee/vorgustik/wp-content/uploads/2011/11/Reconstruction-of-Galileo-Galilei.pdf |archive-date=2014-04-29 |access-date=2014-04-28}}</ref> Replication has become a contentious issue in social and biomedical science where treatments are administered to groups of individuals. Typically an ''experimental group'' gets the treatment, such as a drug, and the ''control group'' gets a placebo. [[John Ioannidis]] in 2005 pointed out that the method being used has led to many findings that cannot be replicated.<ref>{{cite journal |last=Ioannidis |first=John P. A. |date=August 2005 |title=Why most published research findings are false |journal=[[PLOS Medicine]] |volume=2 |issue=8 |pages=e124 |doi=10.1371/journal.pmed.0020124 |pmc=1182327 |pmid=16060722 |doi-access=free}}</ref>
 
The process of [[peer review]] involves evaluation of the experiment by experts, who typically give their opinions anonymously. Some journals request that the experimenter provide lists of possible peer reviewers, especially if the field is highly specialized. Peer review does not certify the correctness of the results, only that, in the opinion of the reviewer, the experiments themselves were sound (based on the description supplied by the experimenter). If the work passes peer review, which occasionally may require new experiments requested by the reviewers, it will be published in a peer-reviewed [[Academic journal|scientific journal]]. The specific journal that publishes the results indicates the perceived quality of the work.{{efn|In ''Two New Sciences'', there are three 'reviewers': Simplicio, Sagredo, and Salviati, who serve as foil, antagonist, and protagonist. Galileo speaks for himself only briefly. But Einstein's 1905 papers were not peer-reviewed before their publication.}}
 
Scientists typically are careful in recording their data, a requirement promoted by [[Ludwik Fleck]] (1896–1961) and others.{{sfn|Fleck|1979|pp=xxvii–xxviii}} Though not typically required, they might be requested to [[Data sharing|supply this data]] to other scientists who wish to replicate their original results (or parts of their original results), extending to the sharing of any experimental samples that may be difficult to obtain.<ref>"[http://grants.nih.gov/grants/policy/data_sharing/index.htm NIH Data Sharing Policy] {{Webarchive|url=https://web.archive.org/web/20120513171213/http://grants.nih.gov/grants/policy/data_sharing/index.htm|date=2012-05-13}}."</ref> To protect against bad science and fraudulent data, government research-granting agencies such as the [[National Science Foundation]], and science journals, including ''Nature'' and ''Science'', have a policy that researchers must archive their data and methods so that other researchers can test the data and methods and build on the research that has gone before. [[Scientific data archiving]] can be done at several national archives in the U.S. or the [[World Data Center]].
 
==Scientific inquiry==
Scientific inquiry generally aims to obtain [[knowledge]] in the form of [[#suitableTest|testable explanations]]<ref name=" SuitableTest">Peirce, Charles S., Carnegie application (L75, 1902), ''New Elements of Mathematics'' v. 4, pp. 37–38: "For it is not sufficient that a hypothesis should be a justifiable one. Any hypothesis which explains the facts is justified critically. But among justifiable hypotheses we have to select that one which is suitable for being tested by experiment."</ref><ref name="econ">Peirce, Charles S. (1902), Carnegie application, see MS L75.329330, from [http://www.cspeirce.com/menu/library/bycsp/l75/ver1/l75v1-08.htm#m27 Draft D] {{Webarchive|url=https://web.archive.org/web/20110524021101/http://www.cspeirce.com/menu/library/bycsp/l75/ver1/l75v1-08.htm#m27|date=2011-05-24}} of Memoir 27: "Consequently, to discover is simply to expedite an event that would occur sooner or later, if we had not troubled ourselves to make the discovery. Consequently, the art of discovery is purely a question of economics. The economics of research is, so far as logic is concerned, the leading doctrine concerning the art of discovery. Consequently, the conduct of abduction, which is chiefly a question of heuretic and is the first question of heuretic, is to be governed by economical considerations."</ref> that scientists can use to [[Predictability|predict]] the results of future experiments. This allows scientists to gain a better understanding of the topic under study, and later to use that understanding to intervene in its causal mechanisms (such as to cure disease). The better an explanation is at making predictions, the more useful it frequently can be, and the more likely it will continue to explain a body of evidence better than its alternatives. The most successful explanations – those which explain and make accurate predictions in a wide range of circumstances – are often called [[scientific theories]].{{efn-ua|name= aQuestion}}
 
Most experimental results do not produce large changes in human understanding; improvements in theoretical scientific understanding typically result from a gradual process of development over time, sometimes across different domains of science.<ref>Stanovich, Keith E. (2007). ''How to Think Straight About Psychology''. Boston: Pearson Education. p. 123</ref> Scientific models vary in the extent to which they have been experimentally tested and for how long, and in their acceptance in the scientific community. In general, explanations become accepted over time as evidence accumulates on a given topic, and the explanation in question proves more powerful than its alternatives at explaining the evidence. Often subsequent researchers re-formulate the explanations over time, or combined explanations to produce new explanations.
Line 195 ⟶ 285:
| date = 2010-09-11
}}
</ref> ''See [[Ceteris paribus]]'', and ''[[Mutatis mutandis]]''
</ref>
 
===Properties of scientific inquiry===
 
Scientific knowledge is closely tied to [[Empirical evidence|empirical findings]] and can remain subject to [[falsifiability|falsification]] if new experimental observations are incompatible with what is found. That is, no theory can ever be considered final since new problematic evidence might be discovered. If such evidence is found, a new theory may be proposed, or (more commonly) it is found that modifications to the previous theory are sufficient to explain the new evidence. The strength of a theory relates to how long it has persisted without major alteration to its core principles (''see [[#Invariant explanation|invariant explanation]]s'').
 
Theories can also become subsumed by other theories. For example, Newton's laws explained thousands of years of scientific observations of the planets [[#Another example: precession of Mercury|almost perfectly]]. However, these laws were then determined to be special cases of a more general theory ([[Theory of relativity|relativity]]), which explained both the (previously unexplained) exceptions to Newton's laws and predicted and explained other observations such as the deflection of [[light]] by [[gravity]]. Thus, in certain cases independent, unconnected, scientific observations can be connected, unified by principles of increasing explanatory power.{{sfn|Brody|1993 |pp=44–45}}{{sfn|Goldhaber|Nieto|2010|page=942}}
Line 232 ⟶ 322:
 
==Models of scientific inquiry==
{{Main|Models of scientific inquiry}}

===Classical model===
The classical model of scientific inquiry derives from Aristotle,<ref>
{{cite book |author=[[Aristotle]] |chapter=[[Prior Analytics]] |translator=Hugh Tredennick |pages=181–531 |title=Aristotle, Volume&nbsp;1 |series=[[Loeb Classical Library]] |publisher=William Heinemann |place=London |year=1938}}
</ref> who distinguished the forms of approximate and exact reasoning, set out the threefold scheme of [[abductive reasoning|abductive]], [[deductive reasoning|deductive]], and [[inductive reasoning|inductive]] [[inference]], and also treated the compound forms such as reasoning by [[analogy]].
 
===Hypothetico-deductive model===
The [[hypothetico-deductive model]] or method is a proposed description of the scientific method. Here, predictions from the hypothesis are central: if you assume the hypothesis to be true, what consequences follow? If a subsequent empirical investigation does not demonstrate that these consequences or predictions correspond to the observable world, the hypothesis can be concluded to be false.
The [[hypothetico-deductive model]] or method is a proposed description of the scientific method. Here, predictions from the hypothesis are central: if you assume the hypothesis to be true, what consequences follow?
 
If a subsequent empirical investigation does not demonstrate that these consequences or predictions correspond to the observable world, the hypothesis can be concluded to be false.
 
===Pragmatic model===
{{See also|Pragmatic theory of truth}}
In 1877,<ref name=Fixation>{{cite wikisource |last=Peirce |first=Charles Sanders |year=1877 |title=The Fixation of Belief |journal=Popular Science Monthly |volume=12 |pages=1–15 |wslink=The Fixation of Belief}}.</ref> [[Charles Sanders Peirce]] (1839–1914) characterized inquiry in general not as the pursuit of truth ''per se'' but as the struggle to move from irritating, inhibitory doubts born of surprises, disagreements, and the like, and to reach a [[#Beliefs and biases|secure belief]], the belief being that on which one is prepared to act. He framed scientific inquiry as part of a broader spectrum and as spurred, like inquiry generally, by actual doubt, not mere verbal or [[hyperbolic doubt]], which he held to be fruitless.{{efn|1="What one does not in the least doubt one should not pretend to doubt; but a man should train himself to doubt," said Peirce in a brief intellectual autobiography.<ref>{{cite book |contributor-last=Ketner |contributor-first=Kenneth Laine |year=2009 |contribution=Charles Sanders Peirce: Interdisciplinary Scientist |last=Peirce |first=Charles S. |editor-last=Bisanz |editor-first=Elize |title=The Logic of Interdisciplinarity |publisher=Akademie Verlag |place=Berlin}}</ref> Peirce held that actual, genuine doubt originates externally, usually in surprise, but also that it is to be sought and cultivated, "provided only that it be the weighty and noble metal itself, and no counterfeit nor paper substitute".<ref>{{cite magazine |last=Peirce |first=Charles S. |date=October 1905 |title=Issues of Pragmaticism |magazine=The Monist |volume=XV |number=4 |pages=481–499, see [https://archive.org/stream/monistquart15hegeuoft#page/484/mode/1up p. 484], and [https://archive.org/stream/monistquart15hegeuoft#page/491/mode/1up p. 491]}} Reprinted in ''Collected Papers'' v. 5, paragraphs 438–463, see 443 and 451.</ref>}} He outlined four methods of settling opinion, ordered from least to most successful:
# The method of tenacity (policy of sticking to initial belief) – which brings comforts and decisiveness but leads to trying to ignore contrary information and others' views as if truth were intrinsically private, not public. It goes against the social impulse and easily falters since one may well notice when another's opinion is as good as one's own initial opinion. Its successes can shine but tend to be transitory.{{efn|But see [[Scientific method and religion]].}}
# The method of authority – which overcomes disagreements but sometimes brutally. Its successes can be majestic and long-lived, but it cannot operate thoroughly enough to suppress doubts indefinitely, especially when people learn of other societies' present and past.
# The method of the ''a priori'' – which promotes conformity less brutally but fosters opinions as something like tastes, arising in conversation and comparisons of perspectives in terms of "what is agreeable to reason." Thereby it depends on fashion in [[paradigm]]s and goes in circles over time. It is more intellectual and respectable but, like the first two methods, sustains accidental and capricious beliefs, destining some minds to doubt it.
# The scientific method – the method wherein inquiry regards itself as [[Fallibilism|fallible]] and purposely tests itself and criticizes, corrects, and improves itself.
 
Peirce held that slow, stumbling [[wikt:ratiocination|ratiocination]] can be dangerously inferior to instinct and traditional sentiment in practical matters, and that the scientific method is best suited to theoretical research,<ref>Peirce, Charles S. (1898), "Philosophy and the Conduct of Life", Lecture 1 of the Cambridge (MA) Conferences Lectures, published in ''Reasoning and the Logic of Things'', Kenneth Laine Ketner (ed.), pp. 105–122 and in ''Collected Papers'' v. 1, paragraphs 616–648 (in part), reprinted in ''Essential Peirce'' v. 2, pp. 27–41.</ref> which in turn should not be trammeled by the other methods and practical ends; reason's "first rule" is that, in order to learn, one must desire to learn and, as a corollary, must not block the way of inquiry.<ref name= reasonsFirstRule >{{cite book|quote=...&nbsp;in order to learn, one must desire to learn&nbsp;... |last=Peirce |first=Charles S. |year=1899 |chapter=F.R.L. [First Rule of Logic] |title=Collected Papers |series=v. 1 |at=paragraphs 135–140 |chapter-url=http://www.princeton.edu/~batke/peirce/frl_99.htm |access-date=2012-01-06 |url-status=dead |archive-url=https://web.archive.org/web/20120106071421/http://www.princeton.edu/~batke/peirce/frl_99.htm |archive-date=January 6, 2012}}</ref> The scientific method excels the others by being deliberately designed to arrive – eventually – at the most secure beliefs, upon which the most successful practices can be based. Starting from the idea that people seek not truth ''per se'' but instead to subdue irritating, inhibitory doubt, Peirce showed how, through the struggle, some can come to submit to the truth for the sake of belief's integrity, seek as truth the guidance of potential practice correctly to its given goal, and wed themselves to the scientific method.<ref name=Fixation/><ref name=Vital>Peirce, Charles S., ''Collected Papers'' v. 5, in paragraph 582, from 1898: "...&nbsp;[rational] inquiry of every type, fully carried out, has the vital power of self-correction and of growth. This is a property so deeply saturating its inmost nature that it may truly be said that there is but one thing needful for learning the truth, and that is a hearty and active desire to learn what is true."</ref>
 
For Peirce, rational inquiry implies presuppositions about truth and the real; to reason is to presuppose (and at least to hope), as a principle of the reasoner's self-regulation, that the real is discoverable and independent of our vagaries of opinion. In that vein, he defined truth as the correspondence of a sign (in particular, a proposition) to its object and, pragmatically, not as the actual consensus of some definite, finite community (such that to inquire would be to poll the experts), but instead as that final opinion which all investigators ''would'' reach sooner or later but still inevitably, if they were to push investigation far enough, even when they start from different points.<ref name=How>{{cite wikisource |last= Peirce |first= Charles Sanders |year= 1877 |title= How to Make Our Ideas Clear |journal= Popular Science Monthly |volume= 12 |pages= 286–302 |wslink= How to Make Our Ideas Clear}}</ref> In tandem he defined the real as a true sign's object (be that object a possibility or quality, or an actuality or brute fact, or a necessity or norm or law), which is what it is independently of any finite community's opinion and, pragmatically, depends only on the final opinion destined in a sufficient investigation. That is a destination as far, or near, as the truth itself to you or me or the given finite community. Thus, his theory of inquiry boils down to "Do the science." Those conceptions of truth and the real involve the idea of a community both without definite limits (and thus potentially self-correcting as far as needed) and capable of definite increase of knowledge.<ref>{{cite journal |last=Peirce |first=Charles S. |year=1868 |title=Some Consequences of Four Incapacities |journal=Journal of Speculative Philosophy |volume=2 |issue=3 |pages=140–157 |url=http://www.cspeirce.com/menu/library/bycsp/conseq/cn-frame.htm|url-status=dead|archive-url=https://web.archive.org/web/20110524015109/http://www.cspeirce.com/menu/library/bycsp/conseq/cn-frame.htm |archive-date=2011-05-24 |via=Arisbe}} Reprinted ''Collected Papers'' v. 5, paragraphs 264–317, ''The Essential Peirce'' v. 1, pp. 28–55 and elsewhere.</ref> As inference, "logic is rooted in the social principle" since it depends on a standpoint that is, in a sense, unlimited.<ref>{{cite magazine |last=Peirce |first=Charles S. |year=1878 |title=The Doctrine of Chances |magazine=Popular Science Monthly |volume=12 |pages=604–615, see pp. [https://archive.org/stream/popscimonthly12yoummiss#page/618/mode/1up 610–611] |via=Internet Archive}} Reprinted ''Collected Papers'' v. 2, paragraphs 645–68, ''Essential Peirce'' v. 1, pp. 142–154. "...&nbsp;death makes the number of our risks, the number of our inferences, finite, and so makes their mean result uncertain. The very idea of probability and of reasoning rests on the assumption that this number is indefinitely great.&nbsp;... logicality inexorably requires that our interests shall not be limited.&nbsp;... Logic is rooted in the social principle."</ref>
 
{{anchor|coord3kinds}}Paying special attention to the generation of explanations, Peirce outlined the scientific method as coordination of three kinds of inference in a purposeful cycle aimed at settling doubts, as follows (in §III–IV in "A Neglected Argument"<ref name=NA>{{cite wikisource |last=Peirce |first=Charles Sanders |date=1908 |title=A Neglected Argument for the Reality of God |journal=Hibbert Journal |volume=7 |pages=90–112 |wslink=A Neglected Argument for the Reality of God}} with added notes. Reprinted with previously unpublished part, ''Collected Papers'' v. 6, paragraphs 452–85, ''The Essential Peirce'' v. 2, pp. 434–450, and elsewhere. N.B. 435.30 'living institution': Hibbert J. mis-transcribed 'living institution': ("constitution" for "institution")</ref> except as otherwise noted):
 
<ol>
<li>''[[Abductive reasoning|Abduction]]'' (or ''retroduction''). Guessing, inference to explanatory hypotheses for selection of those best worth trying. From abduction, Peirce distinguishes induction as inferring, based on tests, the proportion of truth in the hypothesis. Every inquiry, whether into ideas, brute facts, or norms and laws, arises from surprising observations in one or more of those realms (and for example at any stage of an inquiry already underway). All explanatory content of theories comes from abduction, which guesses a new or outside idea to account in a simple, economical way for a surprising or complicative phenomenon. Oftenest, even a well-prepared mind guesses wrong. But the modicum of success of our guesses far exceeds that of sheer luck and seems born of attunement to nature by instincts developed or inherent, especially insofar as best guesses are optimally plausible and simple in the sense, said Peirce, of the "facile and natural", as by [[Galileo]]'s natural light of reason and as distinct from "logical simplicity". Abduction is the most fertile but least secure mode of inference. Its general rationale is inductive: it succeeds often enough and, without it, there is no hope of sufficiently expediting inquiry (often multi-generational) toward new truths.<ref name=PAP>Peirce, Charles S. (c. 1906), "PAP (Prolegomena for an Apology to Pragmatism)" (Manuscript 293, not the like-named article), ''The New Elements of Mathematics'' (NEM) 4:319–20, see first quote under {{cite web |title=Abduction |work=Commens Dictionary of Peirce's Terms |url=http://www.helsinki.fi/science/commens/terms/abduction.html |url-status=dead |archive-url=https://web.archive.org/web/20130502145016/http://www.helsinki.fi/science/commens/terms/abduction.html |archive-date=2013-05-02}}</ref> Coordinative method leads from abducing a plausible hypothesis to judging it for its [[testability]]<ref name=SuitableTest>Peirce, Charles S., Carnegie application (L75, 1902), ''New Elements of Mathematics'' v. 4, pp. 37–38: "For it is not sufficient that a hypothesis should be a justifiable one. Any hypothesis which explains the facts is justified critically. But among justifiable hypotheses we have to select that one which is suitable for being tested by experiment."</ref> and for how its trial would economize inquiry itself.<ref name=econ>Peirce, Charles S. (1902), Carnegie application, see MS L75.329330, from [http://www.cspeirce.com/menu/library/bycsp/l75/ver1/l75v1-08.htm#m27 Draft D] {{Webarchive|url=https://web.archive.org/web/20110524021101/http://www.cspeirce.com/menu/library/bycsp/l75/ver1/l75v1-08.htm#m27 |date=2011-05-24 }} of Memoir 27: "Consequently, to discover is simply to expedite an event that would occur sooner or later, if we had not troubled ourselves to make the discovery. Consequently, the art of discovery is purely a question of economics. The economics of research is, so far as logic is concerned, the leading doctrine concerning the art of discovery. Consequently, the conduct of abduction, which is chiefly a question of heuretic and is the first question of heuretic, is to be governed by economical considerations."</ref> {{anchor|hisPragmatism}}Peirce calls [[Pragmaticism|his pragmatism]] "the logic of abduction".<ref>{{cite book |last=Peirce |first=Charles S. |year=1903 |chapter=§3. Pragmatism – The Logic of Abduction |title=Collected Papers |series=Vol. V: Pragmatism and Pramaticism |at=paragraphs 195–205, especially 196 |chapter-url=http://www.textlog.de/7663.html |access-date=2007-11-26 |archive-date=2010-07-05 |archive-url=https://web.archive.org/web/20100705105407/http://www.textlog.de/7663.html |url-status=live }}</ref> His [[pragmatic maxim]] is: "Consider what effects that might conceivably have practical bearings you conceive the objects of your conception to have. Then, your conception of those effects is the whole of your conception of the object".<ref name=How /> His pragmatism is a method of reducing conceptual confusions fruitfully by equating the meaning of any conception with the conceivable practical implications of its object's conceived effects – a method of experimentational mental reflection hospitable to forming hypotheses and conducive to testing them. It favors efficiency. The hypothesis, being insecure, needs to have practical implications leading at least to mental tests and, in science, lending themselves to scientific tests. A simple but unlikely guess, if uncostly to test for falsity, may belong first in line for testing. [[Twenty Questions#divideAndConquer|A guess is intrinsically worth testing]] if it has instinctive plausibility or reasoned objective probability, while [[Subjective probability|subjective likelihood]], though reasoned, can be misleadingly seductive. Guesses can be chosen for trial strategically, for their caution (for which Peirce gave as an example the game of [[Twenty Questions#Computers, scientific method and situation puzzles|Twenty Questions]]), breadth, and incomplexity.<ref name=20Qs>Peirce, Charles S., "On the Logic of Drawing Ancient History from Documents", ''Essential Peirce'' v. 2, see pp. 107–109. On Twenty Questions, p. 109: "Thus, twenty skillful hypotheses will ascertain what 200,000 stupid ones might fail to do."</ref> One can hope to discover only that which time would reveal through a learner's sufficient experience anyway, so the point is to expedite it; the economy of research is what demands the leap, so to speak, of abduction and governs its art.<ref name=econ /></li>
 
<li>''[[Deductive reasoning|Deduction]]''. Two stages:
<ol type="i">
<li>Explication. Unclearly premised, but deductive, analysis of the hypothesis in order to render its parts as clear as possible.</li>
<li>Demonstration: Deductive argumentation, [[Euclid]]ean in procedure. Explicit deduction of hypothesis's consequences as predictions, for induction to test, about evidence to be found. [[Corollary|Corollarial]] or, if needed, theorematic.</li>
</ol></li>
 
<li>''[[Inductive reasoning|Induction]]''. The long-run validity of the rule of induction is deducible from the principle (presuppositional to reasoning, in general,<ref name=How />) that the real is only the object of the final opinion to which adequate investigation would lead;<ref>{{cite magazine |last=Peirce |first=Charles S. |year=1878 |title=The Probability of Induction |magazine=Popular Science Monthly |volume=12 |pages=705–718, see [https://books.google.com/books?id=ZKMVAAAAYAAJ&pg=PA718 718] via ''Google Books'' [https://archive.org/stream/popscimonthly12yoummiss#page/728/mode/1up 718] via ''Internet Archive''}} Reprinted often, including (''Collected Papers'' v. 2, paragraphs 669–693), (''The Essential Peirce'' v. 1, pp. 155–169).</ref> anything to which no such process would ever lead would not be real. Induction involving ongoing tests or observations follows a method which, sufficiently persisted in, will diminish its error below any predesignate degree. Three stages:
<ol type="i">
<li>Classification. Unclearly premised, but inductive, classing of objects of experience under general ideas.</li>
<li>Probation: direct inductive argumentation. Crude (the enumeration of instances) or gradual (new estimate of the proportion of truth in the hypothesis after each test). Gradual induction is qualitative or quantitative; if qualitative, then dependent on [[weighting]]s of qualities or characters;<ref>Peirce, Charles S. (1905 draft "G" of "A Neglected Argument"), "Crude, Quantitative, and Qualitative Induction", ''Collected Papers'' v. 2, paragraphs 755–760, see 759. Find under {{cite web |work=Commens Dictionary of Peirce's Terms |title=Induction |url=http://www.helsinki.fi/science/commens/terms/induction.html |archive-url=https://web.archive.org/web/20130502155705/http://www.helsinki.fi/science/commens/terms/induction.html |archive-date=2013-05-02 |url-status=dead}}</ref> if quantitative, then dependent on measurements, [[Charles Sanders Peirce#Probability and statistics|or on statistics]], or on countings.</li>
<li>Sentential Induction. "...&nbsp;which, by inductive reasonings, appraises the different probations singly, then their combinations, then makes self-appraisal of these very appraisals themselves, and passes final judgment on the whole result".</li>
</ol></li>
</ol>
 
===Invariant explanation===
In 1877,<ref name="Fixation" /> [[Charles Sanders Peirce]] (1839–1914) characterized inquiry in general not as the pursuit of truth ''per se'' but as the struggle to move from irritating, inhibitory doubts born of surprises, disagreements, and the like, and to reach a [[#Beliefs and biases|secure belief]], the belief being that on which one is prepared to act. He framed scientific inquiry as part of a broader spectrum and as spurred, like inquiry generally, by actual doubt, not mere verbal or [[hyperbolic doubt]], which he held to be fruitless.{{efn|1="What one does not in the least doubt one should not pretend to doubt; but a man should train himself to doubt," said Peirce in a brief intellectual autobiography.<ref>{{cite book |contributor-last=Ketner |contributor-first=Kenneth Laine |year=2009 |contribution=Charles Sanders Peirce: Interdisciplinary Scientist |last=Peirce |first=Charles S. |editor-last=Bisanz |editor-first=Elize |title=The Logic of Interdisciplinarity |publisher=Akademie Verlag |place=Berlin}}</ref> Peirce held that actual, genuine doubt originates externally, usually in surprise, but also that it is to be sought and cultivated, "provided only that it be the weighty and noble metal itself, and no counterfeit nor paper substitute".<ref>{{cite magazine |last=Peirce |first=Charles S. |date=October 1905 |title=Issues of Pragmaticism |magazine=The Monist |volume=XV |number=4 |pages=481–499, see [https://archive.org/stream/monistquart15hegeuoft#page/484/mode/1up p. 484], and [https://archive.org/stream/monistquart15hegeuoft#page/491/mode/1up p. 491]}} Reprinted in ''Collected Papers'' v. 5, paragraphs 438–463, see 443 and 451.</ref>}}
[[File:David_Deutsch.jpg|thumb|right|Model of [[#DNA_example|DNA]] with [[David Deutsch]], proponent of [[#Invariant explanation|invariant scientific explanations]] (2009)]]
{{transcluded section|source=David Deutsch}}
{{trim|{{#section-h:David Deutsch|Invariants}}}}
 
==Communication and community==
Line 245 ⟶ 375:
Frequently the scientific method is employed not only by a single person but also by several people cooperating directly or indirectly. Such cooperation can be regarded as an important element of a [[scientific community]]. Various standards of scientific methodology are used within such an environment.
 
===Peer review evaluation===
Scientific journals use a process of ''[[peer review]]'', in which scientists' manuscripts are submitted by editors of scientific journals to (usually one to three, and usually anonymous) fellow scientists familiar with the field for evaluation. In certain journals, the journal itself selects the referees; while in others (especially journals that are extremely specialized), the manuscript author might recommend referees. The referees may or may not recommend publication, or they might recommend publication with suggested modifications, or sometimes, publication in another journal. This standard is practiced to various degrees by different journals and can have the effect of keeping the literature free of obvious errors and generally improve the quality of the material, especially in the journals that use the standard most rigorously. The peer-review process can have limitations when considering research outside the conventional scientific paradigm: problems of "[[groupthink]]" can interfere with open and fair deliberation of some new research.<ref>Brown, C. (2005) Overcoming Barriers to Use of Promising Research Among Elite Middle East Policy Groups, Journal of Social Behaviour and Personality, Select Press.</ref>
 
===Documentation and replication===
{{Main|Reproducibility}}
Sometimes experimenters may make systematic errors during their experiments, veer from standard methods and practices ([[Pathological science]]) for various reasons, or, in rare cases, deliberately report false results. Occasionally because of this then, other scientists might attempt to repeat the experiments to duplicate the results.
 
====Archiving====
Researchers sometimes practice [[scientific data archiving]], such as in compliance with the policies of government funding agencies and scientific journals. In these cases, detailed records of their experimental procedures, raw data, statistical analyses, and source code can be preserved to provide evidence of the methodology and practice of the procedure and assist in any potential future attempts to [[Reproducibility|reproduce the result]]. These procedural records may also assist in the conception of new experiments to test the hypothesis, and may prove useful to engineers who might examine the potential practical applications of a discovery.
 
====Data sharing====
When additional information is needed before a study can be reproduced, the author of the study might be asked to provide it. They might provide it, or if the author refuses to [[data sharing|share data]], appeals can be made to the journal editors who published the study or to the institution which funded the research.
 
====Limitations====
Since a scientist cannot record ''everything'' that took place in an experiment, facts selected for their apparent relevance are reported. This may lead, unavoidably, to problems later if some supposedly irrelevant feature is questioned. For example, [[Heinrich Hertz]] did not report the size of the room used to test Maxwell's equations, which later turned out to account for a small deviation in the results. The problem is that parts of the theory itself need to be assumed to select and report the experimental conditions. The observations are hence sometimes described as being 'theory-laden'.
 
Line 277 ⟶ 415:
}}</ref> He opens Chapter 1 with a discussion of the [[Golgi apparatus|Golgi bodies]] and their initial rejection as an artefact of staining technique, and a discussion of [[Tycho Brahe|Brahe]] and [[Johannes Kepler|Kepler]] observing the dawn and seeing a "different" sunrise despite the same physiological phenomenon.{{efn|name= Kepler1604 }}{{efn|Brahe and Kepler are two different observers, [[intersubjectivity]] validates Hanson.}} Kuhn<ref>{{cite book |last=Kuhn |first=Thomas S. |title=The Structure of Scientific Revolutions |publisher=University of Chicago Press |location=Chicago, IL |year=2009 |isbn=978-1-4432-5544-8 |page=113 |title-link=The Structure of Scientific Revolutions}}<!--ISBN matches 2009 publication, not the 1962.-->
</ref> and Feyerabend<ref>Feyerabend, Paul K (1960) "Patterns of Discovery" The Philosophical Review (1960) vol. 69 (2) pp. 247–252</ref> acknowledge the pioneering significance of Hanson's work.
 
Kuhn said{{discuss|section= Kuhn_1961_p.166_citation|text= Propose striking this paragraph as inconsistent with the article. }} the scientist generally has a [[#Hypothesis|theory]] in mind before designing and undertaking [[#Experiments|experiment]]s to make empirical observations, and that the "route from theory to measurement can almost never be traveled backward". For Kuhn, this implies that how theory is tested is dictated by the [[#Predictions_from_the_hypothesis|nature of the theory]] itself, which led Kuhn to argue that "once it has been adopted by a profession&nbsp;... no theory is recognized to be testable by any quantitative tests that it has not already passed".{{sfn|Kuhn|1961|p=166}}
 
===Post-modernism and science wars===
Line 343 ⟶ 483:
 
=== Relationship with statistics ===
When the scientific method employs statistics as a key part of its arsenal, there are mathematical and practical issues that can have a deleterious effect on the reliability of the output of scientific methods. This is described in a popular 2005 scientific paper [[Why Most Published Research Findings Are False|"Why Most Published Research Findings Are False"]] by [[John Ioannidis]], which is considered foundational to the field of [[metascience]].<ref>{{Cite journal|title = Why Most Published Research Findings Are False|journal = PLOS Medicine|date = 2005-08-01|issn = 1549-1277|pmc = 1182327|pmid = 16060722|volume = 2|issue = 8|pages = e124|doi = 10.1371/journal.pmed.0020124|first = John P.A.|last = Ioannidis | doi-access=free }}</ref> Much research in metascience seeks to identify poor use of statistics and improve its use.{{efn|name= misuseOfpValues|For example, see [[misuse of p-values]].}}{{efn| name= misuseTtests|}} Regarding''See the Misuse of t-Tests<ref>{{cite journal| url = https://pubs.asahq.org/anesthesiology/article/60/5/505/29253/Regarding-the-Misuse-of-t-Tests| title = Regarding the Misuse of[[Preregistration (science)#Rationale]]''t'' Tests| journal = Anesthesiology| date = May 1984| volume = 60| issue = 5| pages = 505| doi = 10.1097/00000542-198405000-00026| last1 = Schaefer| first1 = Carl F| pmid = 6711862| access-date = 2021-08-29 | archive-date = 2021-08-29 | archive-url = https://web.archive.org/web/20210829012031/https://pubs.asahq.org/anesthesiology/article/60/5/505/29253/Regarding-the-Misuse-of-t-Tests| url-status = live| doi-access = free}}</ref>}}
 
The particular points raised are statistical ("The smaller the studies conducted in a scientific field, the less likely the research findings are to be true" and "The greater the flexibility in designs, definitions, outcomes, and analytical modes in a scientific field, the less likely the research findings are to be true.") and economical ("The greater the financial and other interests and prejudices in a scientific field, the less likely the research findings are to be true" and "The hotter a scientific field (with more scientific teams involved), the less likely the research findings are to be true.") Hence: "Most research findings are false for most research designs and for most fields" and "As shown, the majority of modern biomedical research is operating in areas with very low pre- and poststudy probability for true findings." However: "Nevertheless, most new discoveries will continue to stem from hypothesis-generating research with low or very low pre-study odds," which means that *new* discoveries will come from research that, when that research started, had low or very low odds (a low or very low chance) of succeeding. Hence, if the scientific method is used to expand the frontiers of knowledge, research into areas that are outside the mainstream will yield the newest discoveries. ''See: [[Expected value of sample information]], [[False positives and false negatives]], [[Test statistic]], and [[Type I and type II errors]]''
 
===Role of chance in discovery===
Line 354 ⟶ 494:
 
==See also==
* {{Annotated link|Armchair theorizing}}
* {{Annotated link|Contingency (philosophy)|Contingency}}
* {{Annotated link|Empirical limits in science}}
* {{Annotated link|Evidence-based practices}}
* {{Annotated link|Fuzzy logic}}
* {{Annotated link|Information theory}}
* {{Annotated link|Logic}}
** {{Annotated link|Historical method}}
** {{Annotated link|Philosophical methodology}}
** {{Annotated link|Scholarly method}}
* {{Annotated link|Methodology}}
* {{Annotated link|Metascience}}
* {{Annotated link|Operationalization}}
* {{Annotated link|Quantitative research}}
* {{Annotated link|Rhetoric of science}}
* {{Annotated link|Royal Commission on Animal Magnetism}}
* {{Annotated link|Scientific law}}
* {{Annotated link|Social research}}
* {{Annotated link|Strong inference}}
* {{Annotated link|Testability}}
* {{Annotated link|Unsupervised learning}}
* {{Annotated link|Verificationism}}
 
===Problems and issues===
* {{Annotated link|Descriptive science}}
* {{Annotated link|Design science}}
* {{Annotated link|Holism in science}}
* {{Annotated link|Junk science}}
* {{Annotated link|List of cognitive biases}}
* {{Annotated link|Normative science}}
* {{Annotated link|Philosophical skepticism}}
* {{Annotated link|Poverty of the stimulus}}
* {{Annotated link|Problem of induction}}
* {{Annotated link|Pseudoscience}}
* {{Annotated link|Reference class problem}}
* {{Annotated link|Replication crisis}}
* {{Annotated link|Skeptical hypotheses}}
* {{Annotated link|Underdetermination}}
 
===History, philosophy, sociology===
* {{Annotated link|Baconian method}}
* {{Annotated link|Epistemology}}
* {{Annotated link|Epistemic theories of truth|Epistemic truth}}
* {{Annotated link|Mertonian norms}}
* {{Annotated link|Normal science}}
* {{Annotated link|Post-normal science}}
* {{Annotated link|Science studies}}
<!--* {{Annotated link|Sociology of scientific knowledge}}-->
* {{Annotated link|Timeline of the history of scientific method}}