Uncertainty and Risk in Civil Engineering Practice: Difference between revisions

From Risk Engineering
2026 01 19 GPT recommendations
Restore native revision 219 (24 Nov 2024); add provenance note and link to 2026 taxonomy draft
 
Line 1: Line 1:
'''Life is short and the art long; the occasion instant, experiment perilous, decision difficult.'''
:'''''Restoration note (August 2026).''' This article restores the site's native revision of 24 November 2024 (revision 219). The 20 January 2026 rewrite remains available in the [[Special:History/Uncertainty_and_Risk_in_Civil_Engineering_Practice|revision history]]. A proposed applied extension is under review at [[User:Pooyan/Civil Engineering Project Risk Taxonomy|Civil Engineering Project Risk Taxonomy]].''
(Hippocrates, as quoted in Fox)
 
:''See also [[Project Definition]], [[Project Life Cycle and Phase Models]], [[Project Delivery Methods]]'' 
:''See also [[Technical Outcomes for Civil Engineering: Risk and Uncertainty]]''
 
==Basic considerations==
Civil engineering practice requires decision-making in environments characterized by incomplete, imperfect, and evolving knowledge. Engineers routinely act in the presence of uncertainty related to physical phenomena, economic constraints, regulatory requirements, and human behavior. The professional problem is not the elimination of uncertainty, which is impossible in practice, but its reduction, partitioning, and management to a degree sufficient to support responsible action.
 
In this chapter, '''risk''' is treated as a bounded and decision-relevant subset of broader uncertainty. Uncertainty that can be reduced, structured, prioritized, and acted upon using professional knowledge, models, and experience is termed risk. Related but distinct is the concept of '''hazard''', which denotes a source or condition with the potential to cause harm, independent of likelihood or consequence.
 
This framing aligns with interdisciplinary treatments of risk analysis, which emphasize the role of uncertainty in shaping social, technical, and governance systems over long historical periods. McDaniels and Small describe risk analysis as emerging from the need to act despite imperfect knowledge and argue that societies have progressively shifted from fatalistic acceptance of uncertainty toward its active management through structured analysis and decision frameworks.<ref name="McDaniels">McDaniels, Timothy, and Mitchell Small. ''Risk Analysis and Society: An Interdisciplinary Characterization of the Field''. Cambridge University Press, 2004, p. 1.</ref>
 
Within civil engineering, this evolution has produced specialized practices focused on managing uncertainty through modeling, design standards, safety factors, reliability analysis, and project controls. These practices rely not only on domain knowledge of materials, loads, and systems, but also on '''meta-knowledge''': knowledge about the limitations, reliability, and appropriate use of engineering knowledge itself.
 
==Semantic, epistemic, and logical frameworks==
Clear terminology is a prerequisite for coherent risk analysis. In professional practice, inconsistent or interchangeable use of terms such as uncertainty, risk, hazard, error, and bias can obscure decision responsibility and complicate communication among stakeholders.
 
The semantic framework adopted in this chapter proceeds in stages:
# distinction between certainty and uncertainty;
# refinement of uncertainty into epistemic, aleatory, and behavioral components;
# use of error and bias as operational proxies for uncertainty;
# transition from general uncertainty to discipline-specific risk taxonomies.
 
Beyond this point, the discussion shifts from semantics to logical frameworks, where uncertainty is partitioned into structured taxonomies suitable for analysis, communication, and decision-making in engineering projects.


'''Life is short and the art long; the occasion instant, experiment perilous, decision difficult.''' (Hippocrates as quoted in Fox,)
:''See also [[Project Definition]] , [[Project Life Cycle and Phase Models]] , [[Project Delivery Methods]]''
:''See also [[Technical Outcomes for Civil Engineering:Risk and Uncertainty]]''
==Basic Considerations==
As human beings,'' ... being alive means seeking opportunities and taking risks.'' As knowledge professionals
living in the 21st century, this means coping with an increasingly complex number of uncertainties for humans
living in this environment. We seek to understand better how these uncertainties can be characterized and
managed. The essence of this article and the experience for engineers in general and civil engineers in particular is
that manageable uncertainty is, by definition, termed risk, and its kindred cousin is termed hazard. This causes us to experience the
:" ''... human dread of and fascination for risk and the increasingly important role of risk analysis within societies ...'' " <ref name="McDaniels"> McDaniels, Timothy, and Mitchell Small. Risk analysis and society: an interdisciplinary characterization of the field. Cambridge University Press, 2004, page 1 </ref> (Ibid.)
and, by extension, civil engineering. McDaniels et al. argue that risk management has been
fundamental to our social and governance development for the past 10,000 years. The scale and shape of the
uncertainties faced in this period shaped the societies that have developed today. The central thrust of this effort
over the centuries has been to reshape and re-frame our understanding and conception of uncertainty from one of
complete unknowing and simple acceptance as our fate in life to one of management (cf "''Against the Gods''"
concept in Bernstein's book <ref name = Bernstein">Bernstein, Peter L., and Jesse Boggs. Against the gods. Simon & Schuster 1997.</ref>.
: ''All the knowledge professions and disciplines have struggled with managing uncertainty, for it is impossible to manage unbounded uncertainty.'' <ref group="note">See McDaniels et al. 2004 for an extensive discussion and bibliography on the historical development of Risk Analysis and some key milestones in risk analysis in the 20th century.</ref>
As outlined below, professions such as civil engineering have successfully acted in the face of uncertainty. It lies in the profession's ability to reduce a wide variety of uncertainties into increasingly smaller and crucially bounded subsets that can be managed. These are called 'risks. More recently, this process has evolved, and individual disciplines such as Civil Engineering (CE) have developed their knowledge and models to perform risk analysis. Risk is also taught as a distinct discipline and specialty practice within civil engineering. Still, it has some unique features that set it apart from other more classical practices within CE. As such, it is one of the first of some very specialized CE practices that use knowledge about civil engineering knowledge, or meta-knowledge. Other examples of civil engineering metaknowledge are project controls and quality controls.
==Semantic, Epistemic and Logical frameworks==
The semantic, epistemic, and logical frameworks for uncertainty and risk have several dimensions and layers of logical frameworks. The semantics problems include interchangeable usages for risk and uncertainty and hazard, uncertain and imperfect, and a lack of definitional material or context. The semantical scheme for this article will be to proceed from the distinction between certainty and uncertainty through marginal refinements and reductions of uncertainty up to the point of causal uncertainties. Beyond this point of semantics will be the logic frameworks or the subject of taxonomies of professional knowledge. First, it is about simple, testable phenomena, and then, it moves on to complex taxonomy schemes for artificially constructed phenomena or engineering projects.
<ref group="note">TBD</ref>
==Semantics framework==
==Semantics framework==
===Certainty and Uncertainty===
''''' There is no such thing as absolute certainty, but there is assurance sufficient for the purposes of human life.''''' ([https://en.wikipedia.org/wiki/John_Stuart_Mill John Stuart Mill]) <br>
'''''If you tried to doubt everything, you would not get as far as doubting anything. The game of doubting itself presupposes certainty.''''' ([https://en.wikipedia.org/wiki/Ludwig_Wittgenstein Wittgenstein] # 115 from On [https://en.wikipedia.org/wiki/On_Certainty Certainty]) <br>
It is important to note that the references to epistemic or epidemiological knowledge in this article are assumed to relate to three forms of knowledge, namely:
* Knowledge that ( [https://en.wikipedia.org/wiki/Descriptive_knowledge descriptive or declarative or propositional knowledge])
* Knowledge how ( or "[https://en.wikipedia.org/wiki/Procedural_knowledge know-how]"), and
* [https://en.wikipedia.org/wiki/Knowledge_by_acquaintance Knowledge by acquaintance].
'''Certainty''' has been defined as "an epistemic property" of knowledge in all its forms and the state of our beliefs about that knowledge.
<ref>Certainty, Stanford Encyclopedia of Philosophy, accessed on September 12, 2015, at http://plato.stanford.edu/entries/certainty/#ConCer </ref>
Certainty about any belief about knowledge implies that it is not subject to doubt or skepticism. This immunity to criticism can be dogmatically based, emphasizing the importance of a propositional-based sense of truth over experiential, sensory perceptions. <ref>Definition of [https://en.wikipedia.org/wiki/Dogmatic_theology Dogmatic theology or belief], accessed at Wikipedia</ref> 
: '''The demarcation line between dogmatic and non-dogmatic beliefs lies in the presence and recognition of specific criteria and information that would make the believer change their beliefs.'''
An empirical framework of [https://en.wikipedia.org/wiki/Testability testability] and [https://en.wikipedia.org/wiki/Falsifiability falsification] is required to recognize this and limit dogmatism. For example, one could argue that people would change their minds if God asked them to. Similarly, one could construct a concept of epistemic as opposed to dogmatic belief certainty as the ability to know anything that one chooses to know and can be known or [https://en.wikipedia.org/wiki/Omniscience inherent omniscience].


===Certainty and uncertainty===
A second kind of certainty is epistemic, when conviction reflects the highest possible support for a belief. In this sense, knowledge is separate from beliefs, although someone may have beliefs about a property, such as certainty of knowledge. Logically, it has been shown that there will be unprovable statements within the system for any such knowledge system. Secondly, the knowledge system cannot demonstrate its own consistency. ([https://en.wikipedia.org/wiki/Gödel%27s_incompleteness_theorems Gödel's incompleteness theorems])
Certainty is commonly described as an epistemic property of belief, implying immunity from doubt or criticism. In practical contexts, however, absolute certainty is neither attainable nor desirable. As Mill observed, assurance sufficient for the purposes of human life does not require freedom from all doubt, but rather justified confidence grounded in experience and evidence.
: '''Certainty, in real life, is useless or often damaging (the idea is that "total security from error" is impossible in practice, and a complete "lack of doubt" is undesirable)''' ([[https://en.wikipedia.org/wiki/Certainty Physicist Carlo Rovelli]])
'''Uncertainty''', on the other hand, arises immediately in the slightest amount of doubt or criticism.  
<ref group="note"> The Merriam-Webster dictionary defines uncertainty as “the quality or state of being uncertain,” which is something of a circular definition. Likewise, one could define uncertainty as the state of not being certain.  


Uncertainty arises whenever beliefs or propositions are subject to doubt, criticism, or incomplete support. Contemporary treatments emphasize that uncertainty is not merely a feature of the external world, but also a cognitive condition reflecting awareness of incomplete knowledge. Han et al. characterize uncertainty as a meta-cognitive state: knowing that one does not know, or knowing that one’s knowledge may be incomplete or unreliable.<ref name="Han">Han, Paul K. J., William M. P. Klein, and Neeraj K. Arora. “Varieties of Uncertainty in Health Care: A Conceptual Taxonomy.''Medical Decision Making'' 31, no. 6 (2011): 828–838.</ref>
Synonyms are distrust, doubt, misgiving, mistrust, reservation, skepticism, and suspicion. Another writer added indefinite, indeterminate, not certain to occur, problematical, unreliable, untrustworthy, unknown beyond doubt, dubious, doubtful, not clearly identified or defined, not constant, variable, and fitful to the list.
:(Han, Paul KJ, William MP Klein, and Neeraj K. Arora. "Varieties of Uncertainty in Health Care: A Conceptual Taxonomy." Medical Decision Making 31.6 (2011): 828-838.)
Han et al. noted that any definition of uncertainty clearly encompasses "...numerous types, sources, and manifestations of uncertainty, and ...(any) ...useful working definition of uncertainty needs to specify the concept underlying these varied meanings of the term."</ref>
Implicit in this definition of uncertainty as a “state of” is ...
"...a conceptualization of uncertainty as a subjective, cognitive experience of people—a state of mind rather than a feature of the objective world. Furthermore, the defining feature of this state appears to be a lack of knowledge about some aspect of reality. Importantly, however, the concept of uncertainty also implies a subjective consciousness or awareness of one’s lack of knowledge, without which one could not feel uncertain; uncertainty is a form of “meta-cognition” ...(or its main component, meta-knowledge)... —a knowing about knowing." (Han, 2011, op. cit., Emphasis added)
Similarly, uncertainty could be defined as "...any departure from the unachievable goal of complete [https://en.wikipedia.org/wiki/Determinism determinism]."
<ref name="Walker1">Walker, W. E., Harremoës, P., Rotmans, J., Van Der Sluijs, J. P., Van Asselt, M. B., Janssen, P., & Krayer von Krauss, M. P. (2003). Defining uncertainty: a conceptual basis for uncertainty management in model-based decision support. Integrated assessment, 4(1), 5-17.</ref>
Reasoning under uncertainty is very different than performing the same under certainty. In reasoning under certainty, one has complete knowledge and deduces without doubt and equally important, without limitation, thereby concluding free from error. Reasoning under uncertainty, one works in a state of incomplete, inconsistent, and limited knowledge; doubts cloud any statements or assertions and thereby taint any deductions/inferences resulting in the potential for error. <ref group="note">Implicit in this definition of uncertainty as a “state of” is ...
"...a conceptualization of uncertainty as a subjective, cognitive experience of people—a state of mind rather than a feature of the objective world. The defining feature of this state, furthermore, appears to be a lack of knowledge about some aspect of reality. Importantly, however, the concept of uncertainty also implies a subjective consciousness or awareness of one’s lack of knowledge, without which one could not feel uncertain; uncertainty is a form of “meta-cognition” ...(or alternatively, its main component, meta-knowledge)... —a knowing about knowing." (Han, 2011, op. cit., Emphasis added)</ref>
:'''Knowledge professions reason in a state of incomplete, inconsistent and limited knowledge with doubts that cloud any statements or assertions and taint any deductions/inferences resulting in the potential for error.'''
:''' It is also important to note the semantical and logical correlation between 'reasoning under uncertainty' or 'acting in the face of uncertainty' with the 'potential for' or 'presence of' error. The presence of uncertainty is invariably linked to the potential presence of error.''' The [https://en.wikipedia.org/wiki/Contingency_(philosophy) contingent] nature of uncertainty logically implies the contingent nature of error.
:'''Knowledge Professions use error as a proxy for uncertainty such that within discipline knowledge frameworks, uncertainty can be managed.''' The rationale for this belief is that error can be reliably described, quantified, explained, and ultimately reduced in ways that uncertainty cannot.


In professional reasoning, uncertainty manifests as the potential for error in observation, modeling, judgment, and action. Reasoning under uncertainty therefore differs fundamentally from reasoning under certainty: conclusions are provisional, contingent, and subject to revision as new information becomes available.
'''Uncertainty''' implies a range of variation that is impossible in certainty. Concepts and definitions of uncertainty are unbounded and vast but start from the point of complete and total ignorance. In describing uncertainty, statements can range from complete ignorance to relatively high degrees of belief that there is less potential for error in our reasoning or action. The latter is based upon confidence in justified knowledge, favorable past experience, and reliable parameters/models. One can't make that statement about ranges in certainty. If certainty, by definition, precludes doubt of any type or nature, then how could that be graduated to any degree? <br>
Uncertainty, on the other hand, can be reduced through disciplined efforts to acquire knowledge. In short, we can reduce or even manage uncertainty (to a degree); how can certainty be improved? Are there higher degrees of perfection? The answer is no. We reason from an uncertain starting point. Yet this effort presumes, as Mill and Wittgenstein postulated, that we can develop or acquire an increasing degree of belief or conviction that there is less potential for error in our reasoning or action. This position assumes that some way exists to identify what a lesser degree of uncertainty would look like.
:'''Knowledge professions acquire an increasing belief or conviction that there is less potential for error in their reasoning or action based on justified knowledge, favorable past experience, and reliable parameters/models.'''
Uncertainty is, in some form, amenable to description and explanation through observation and analysis. It is explainable and predictable to such a degree that it interests professionals such as scientists and engineers. Professional knowledge of this type has explanatory or predictive power, albeit limited in scope and application to relevant subjects such as physical objects or phenomena and functionality.
:'''The very act of reducing the scope of uncertainty to a limited set of phenomena implies choice and, ultimately, the decision to act in the face of such uncertainty, but acting or judging in this manner adds more value than doing the same under relative ignorance.'''
'''Uncertainty''', as described above, implies a hybrid nature. Examples of this are economic or decision-theoretic applications. In economics, [https://en.wikipedia.org/wiki/Perfect_information perfect information] allows one within the limiting framework of perfect competition in economic games to make decisions with 'perfect knowledge.' The crucial difference here is the distinction between '[https://en.wikipedia.org/wiki/Perfection perfection],' broadly, a state of completeness and lawlessness, and 'perfect, which can be thought of as an analytical limit that is approachable but can never be attained. Arbitrarily delimiting the realm of knowledge into defined, finite boundaries allows the simulated production of perfect choice, assumed crucially, to be free from error. The hybrid nature of this form of 'simulated' certainty produced within boundaries defined by assumptions and, therefore, clouded by doubt is itself a form of uncertainty. The importance of this is the semantical and logical association that exists between certainty and perfection versus the hybrid concept of a perfect anything, whether knowledge, infraction, competition, etc., or in the case of engineering, elastic, permeable, conductive, etc., being contained within an admittedly imperfect matrix of uncertainty.
:'''Simply put, a finite, heavily bounded piece of uncertain knowledge can be improved through the simulated use of [https://www.merriam-webster.com/dictionary/assumed assumedly] perfect information, but the perfection of knowledge cannot be attained or simulated.'''
Engineering and Economics, for example, simulate finite elements of perfect knowledge or information, heavily bounded with assumptions and a range of applications. By doing so, these professions reduce the bounds and variability of uncertainty and thereby manage it. Using these hybrid models to acquire knowledge takes place in an economy (regulated or institutional) and environment (transparent and structured), which puts pressure on the various professions to recognize and use qualitative and quantitative knowledge better to reduce uncertainties in their activities. The challenges in this reflect the nature of the profession's or discipline's knowledge (e.g., scientific, engineering, or medical), the policies and structure of the relevant professional knowledge bodies, process objectives, constraints, and "the elusive demands of politics." <ref name="siren">Walker, Vern R. "The siren songs of science: toward a taxonomy of scientific uncertainty for decision-makers." Conn. L. Rev. 23 (1990): 567.</ref>
One common theme runs through all of these efforts to address the presence of uncertainty in professional activities. <br>
:"The available scientific information upon which a decision must be made is almost always a mixture of engineering knowledge and uncertainty. Regardless of the information or methodology, there is the potential for error. This is true regardless of the relevant science, whether archaeology or aeronautics, economics or engineering, pharmacology or toxicology or epidemiology. Achieving the best social decisions requires not only understanding and using what we know but also appreciating and weighing the extent of our uncertainty. In making the best use of ... information in ... decision-making, it is still true that the beginning of wisdom is knowing what it is we do not know." (Vern, Op. cit., Reformatted and engineering substituted for scientific) <br>
'''Driven by practical objectives and benefiting from past experience, knowledge professions such as engineering start by reasoning from uncertainty to develop explanations, calculate, and make predictions. This professional knowledge converges on but never reaches certainty, producing a "legitimacy" from the fruitfulness of its use.''' <ref>Randomness Is Unpredictability, Antony Eagle, The British Journal for the Philosophy of Science, Vol. 56, No. 4 (Dec., 2005), pp. 749-790 </ref> <br>
[[#top|Top of current page]]


===Error, bias, and uncertainty===
=== Bias and Uncertainty ===
In applied disciplines, uncertainty is rarely managed directly. Instead, it is addressed through its observable proxies: error and bias. Error refers to deviation between an estimate, measurement, or prediction and a reference value or observed outcome. Bias denotes systematic or directional error arising from model structure, data selection, judgment, or institutional practice.
Up to this point, the concept of error, as outlined in uncertainty, could easily be simulated by a truly random variable. There should be no detectable differences around the unseen or specified statistical mean. However, several instances in experience point to a tendency towards one extreme or a pattern of error, a collective that is in itself an error of errors, namely [https://en.wikipedia.org/wiki/Bias bias].


Error can often be quantified, propagated, and reduced using analytical and statistical methods. Bias is more difficult to detect and correct, frequently requiring theoretical analysis, validation studies, or comparison across independent methods. The management of uncertainty in civil engineering therefore depends critically on understanding how error and bias arise, how they propagate through sequential decisions, and how they can be bounded through professional controls.
Arguably, this could be part of the choice uncertainty discussion below, but it makes more sense to be looked at on its own. Acting in the face of uncertainty is an exercise of personal knowledge or experience. Whether using professional knowledge or individual experience, the potential is there to make a series of choices that, in some instances, make errors more likely than they would be if considered in the context of a statistical analysis.  


===Propagation of error and uncertainty===
This tendency for an individual to make the same error in a predictable or repeatable manner is termed bias. Personal experience, beliefs, knowledge, data, and models all have inherent built-in factors, errors, or defects that create predictable error patterns when applied in decision-making. Walker (1998) argues implicitly that such bias can also be considered systemic error. This type of uncertainty is difficult to identify except on theoretical grounds when the magnitude and direction of the bias are known. Most of these biases, whether systemic or knowledge-based, individual or practice-based, require disciplined efforts to "validate" such methods, models, and judgments at all layers while bounding the uncertainty.
Engineering decisions typically involve multi-step processes: observation, interpretation, modeling, design, construction, and operation. Errors introduced early in this chain can propagate and amplify downstream, while later errors may have limited impact depending on system sensitivity and redundancy.
: This is the challenge to professional knowledge that must be overcome, namely, developing and validating models and methods for managing bounded uncertainty that minimize this tendency towards repeatable groups of error or bias. Therefore, from this point forward, the discussion will refer to 'uncertainty and its proxies, error, and bias.'
===Propagating Error and Uncertainty===
Partitioning uncertainty and its proxies, error, and bias into logically distinct subsets involves or is associated with multiple-step execution or choice frameworks. Combining those measurements or choices into single parameters or choices involves, in some cases, assembling the data/information in a unique or limited range of sequences. This implies that associated errors in observing, calculating, or choosing will have unequal impacts or consequences depending on where in the chain the error occurs. Also implied in this is the possibility that subsequent errors will be causally linked to some degree. (In statistical practice, this depends upon whether the errors are independent of each other or correlated, specifically, co-variant.)
:'''Professions develop knowledge of how uncertainty and its proxies, error, and bias propagate through an ordered and normative series of observations or choices. This allows the profession to prioritize error and bias reduction to achieve an optimized reduction of uncertainty.'''
[[#top|Top of current page]]
===Cognition, Metacognition and Uncertainty===
The concept of choice and the resultant error in uncertainty can be further delimited depending on the role of [https://en.wikipedia.org/wiki/Cognition cognition], [https://en.wikipedia.org/wiki/Metacognition meta-cognition], and independent external elements. The rationale for this argument is that such choice activity in the face of uncertainty is a conscious, cognitive act.


Professional practice therefore emphasizes identifying where uncertainty enters the decision sequence and prioritizing error and bias reduction where it has the greatest effect on outcomes. This ordering principle underlies practices such as conservative design assumptions, staged investigations, peer review, and independent verification.
An argument could be made that such cognition is a prerequisite for exercising choice and introducing error, as presented and discussed above. The counterfactual to this argument is the example of uninformed choice. Choices introduce as much as errors or more as informed choices could be made. (???) Choice, in this sense, is indifferent to knowledge. Purposeful choice in an environment of objectives requires knowledge, method, and experience, but uninformed, speculative choice does not.
:"''' Cognition''' is the set of all mental abilities and processes related to knowledge, attention, memory and working memory, judgment and evaluation, reasoning and "computation," problem-solving and decision making, comprehension and production of language, etc. Human cognition is conscious and unconscious, concrete or abstract, as well as intuitive (like knowledge of a language) and conceptual (like a model of a language). Cognitive processes use existing knowledge and generate new knowledge." (Wikipedia)
:"'''Metacognition''' is "cognition about cognition", or "knowing about knowing" and can take many forms. It includes knowledge about when and how to use particular strategies for learning or problem-solving. There are generally two aspects of [https://en.wikipedia.org/wiki/Metacognition metacognition]: knowledge about cognition and regulation of cognition."
Some types of metacognition knowledge are:
:'''Person knowledge''' (declarative knowledge), which is understanding one's own capabilities.
:'''Task knowledge''' (procedural knowledge), which is how one perceives the difficulty of a task, which is the content, length, and type of assignment.
:'''Strategic knowledge''' (conditional knowledge) is one's capability to use strategies to learn information. (Accessed at Wikipedia)
Like metacognitive knowledge, metacognitive regulation or "cognitive control" contains three essential skills.
:'''Planning:''' refers to the appropriate selection of strategies and the correct allocation of resources that affect task performance.
:'''Monitoring:''' refers to one's awareness of comprehension and task performance.
:'''Evaluating:''' refers to appraising the final product of a task and the efficiency at which the task was performed. This can include re-evaluating strategies that were used. (Accessed at Wikipedia)
Nothing has been said up to this point that limits this structure to an individual, or a collective, or two entities making cognitive choices that are incompatible or inconsistent to varying degrees. Interpretations of this scheme include an individual professional exercising judgment in a decision that, in turn, relies upon the collective judgment and decision of the discipline as an underlying basis versus the decision of another individual to oppose/protest or otherwise contest that decision. Thus, the framework of cognitive/meta-cognitive applies to individuals, collectives, and controversies. In economic theory, this could be recast to cognitive/meta-cognitive roles in the theory of rational choice, economics of regulatory practice, and game theory.
:By solving useful problems in the face of inherent uncertainty, discipline-specific frameworks of cognitive/meta-cognitive activity apply to individuals, collectives, and controversies. In economic theory, this could be recast to cognitive/meta-cognitive roles in the theory of rational choice, the economics of regulatory practice, and game theory.
[[#top|Top of current page]]


===Epistemic, aleatory, and behavioral uncertainty===
===Probability and Uncertainty===
For practical purposes, uncertainty in civil engineering can be partitioned into three broad components:
Probability is a [https://en.wikipedia.org/wiki/Coherence_theory_of_truth coherent] approach to uncertainty in the physical and mathematics or "classical" domains such as engineering. <ref>See Colyvan for a critique of this claim, Colyvan Mark. "Is probability the only coherent approach to uncertainty?." Risk Analysis 28.3 (2008): 645-652.</ref> and is the "...is certainly the best-known and most widely used formalism for quantifying uncertainty.<ref>Morgan, Millett Granger, Max Henrion, and Mitchell Small. Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press, 1992.</ref> [https://en.wikipedia.org/wiki/Cox%27s_theorem Cox’s theorem] ("Any measure of belief is [https://en.wikipedia.org/wiki/Isomorphism isomorphic] (but not necessarily equal) to a probability measure") is a well-known argument for the validity of that argument.
* '''Epistemic uncertainty''', arising from incomplete knowledge, limited data, or imperfect models;
<ref group="note">Cox wanted his system to satisfy the following conditions:<br>
* '''Aleatory uncertainty''', reflecting inherent variability in physical processes;
Divisibility and comparability – The plausibility of a statement is a real number and is dependent on the information we have related to the statement.
* '''Behavioral uncertainty''', associated with human judgment, decision-making, and organizational interaction.
:Common sense – Plausibilities should vary sensibly with the assessment of plausibilities in the model.
:Consistency – If the plausibility of a statement can be derived in many ways, all the results must be equal.
Cox's theorem has come to be used as one of the justifications for the use of Bayesian probability theory. (For example, in Jaynes Jayne, Probability Theory: The Logic of Science, Cambridge University Press (2003). — preprint version (1996) at http://omega.albany.edu:8008/JaynesBook.html; Chapters 1 to 3 of published version at http://bayes.wustl.edu/etj/prob/book.pdf</ref>


This partitioning supports targeted mitigation strategies. Epistemic uncertainty may be reduced through investigation and analysis; aleatory uncertainty may be managed through design margins and reliability methods; behavioral uncertainty requires institutional controls, contractual clarity, and governance mechanisms.
Another writer, [https://en.wikipedia.org/wiki/Frank_Knight Knight] (1921,1956), presented the following taxonomy of probabilities:
<ref>As presented and discussed in Runde, Jochen. "Clarifying Frank Knight's discussion of the meaning of risk and uncertainty." Cambridge Journal of Economics 22.5 (1998): 539-546.</ref>
: '''Classical 'a priori' probability:''' As an idealized model, numerical probabilities are computed based on generalized principles of assigning equal likelihoods and mutually exhaustive possible outcomes (Runde, 1998) to all set members. Such probabilities are assigned to "...outcomes based on a judgment of indifference between those outcomes, that is, based on the absence of any evidence of real influences in play that may render any one outcome more or less probable than any other." (Runde, op. cit.) This builds upon Knights's concept of an 'absolutely homogeneous classification of instances that are completely identical except for [https://en.wikipedia.org/wiki/Indeterminate_(variable) indeterminate] factors. This judgment of probability or logical probability is on the same logical plane as the propositions of mathematics and ultimately [https://en.wikipedia.org/wiki/Inductivism inductions] from experience.'(Knight, 1956, pg.225)
: '''Bayesian 'a priori' probability:''' In contrast to interpreting probability as the "frequency" or "propensity" of some phenomenon, [https://en.wikipedia.org/wiki/Bayesian_probability Bayesian probability] is a quantity that we assign to represent a state of knowledge or a state of belief. In this view, probability is assigned to a hypothesis, often using the basis of past or prior experience. In contrast, under the frequentist view, a hypothesis is typically tested without being assigned a probability based on prior experience. The Bayesian interpretation of probability can be seen as an extension of propositional logic that enables reasoning with hypotheses, i.e., propositions whose truth or falsity is uncertain. Bayesian probability belongs to the category of evidential probabilities; to evaluate the probability of a hypothesis, the Bayesian probabilist specifies some prior probability, which is then updated in the light of new, relevant data (evidence). The Bayesian interpretation provides a standard set of procedures and formulae to perform this calculation. <ref>See also Larvor, B. "After Popper, Kuhn, and Feyerabend: Recent Issues in Theories of Scientific Method." Metascience (2002).</ref>
: '''Statistical or 'a posterior probability:''' Empirical evaluation of the frequency of association between predicates, not analyzable into varying combinations of equally probable or logical, 'a priori' alternatives. Knight argued that any "high degree of confidence" that the judgment that experience will remain valid for future predictions is "...still based on an 'a priori" judgment of indeterminateness." (Knight, Op. Cit.) Knight's argument to support this is what will be discussed further below that first, "...the impossibility of eliminating all factors not really indeterminate; and, second, the impossibility of enumerating the equally probable alternatives involved and determining their mode of combination so as to evaluate the probability by a priori calculation." (Knight, Op. Cit.) Knight noted that the main difference between this form and that of logical or inductive probability was the presence of empirical information, which allowed the analyst to identify propensity and direction in the observed phenomena. In this case, 'a priori' probability values may be derived from first principles and "statistical probabilities are determined a posteriori by the empirical method of counting instances." (Runde [1998] quoting Knight, op. cit.)
:'''Estimates:''' The distinction here is that there is no valid basis ('a priori' or 'a posteriori') for any classifying phenomena. For Knight, this form of probability presented the greatest logical difficulties of all ... but its distinction from the other types must be emphasized, and some of its complicated relations indicated..." (pp. 224-5, emphasis in the original)


==From uncertainty to risk and hazard==
Knight's concept of probability can be viewed as "..a continuum of probability situations, depending on the degree of homogeneity of the 'instances' in question" <ref>Runde, Jochen. "Clarifying Frank Knight's discussion of the meaning of risk and uncertainty." Cambridge Journal of Economics 22.5 (1998): 539-546.</ref>; i.e. going from a logically distinct but equally likely set of elements to a unique set with one member with statistical frequency in the middle. Knight's main motivation for distinguishing between a priori probability and statistical probability underscores his opinion that "(i) the 'mathematical or a priori type of probability is practically never met with in business, while the second is extremely common'; and (ii) 'the statistical treatment never gives closely accurate quantitative results' (Runde quoting Knight pp. 215-16). Runde argues that Knight couldn't conceive of (empirically tabulated) occurrences that are used in daily commerce classes of instances that we have to make do within the course of everyday economic life could be divided into subclasses of instances that are sufficiently homogeneous to permit the determination of what he calls 'real' probability (p. 217).
Risk and hazard are not synonymous with uncertainty, but structured subsets of it. Risk refers to uncertainty that has been framed in terms of potential consequences and that is sufficiently bounded to support decision-making. Hazard denotes a source or condition with the potential to cause harm, independent of likelihood.
:'''In modeling degrees of uncertainty, any measure of belief is isomorphic but not necessarily equal to a probability or statistics measure'''.
[[#top|Top of current page]]


In this chapter, '''general risk''' is defined as:
===Explanation, Prediction and Uncertainty===
:'''a bounded subset of uncertainty associated with the potential for material error or bias when acting or choosing in physical, economic, or social environments, and that can be represented using coherent analytical or probabilistic frameworks and subjected to testing or validation.'''
It should be clear that the general notion of uncertainty synonymous with complete ignorance must be bounded as part of a scheme to produce a useful concept of uncertainty in professional practice such as civil engineering.
:The first principle that must be introduced is that such uncertainty must be bounded by reliable and valuable knowledge gained from past experience combined with analytical and computational capabilities to address an immediate and real problem of interest. This could be viewed as the economic interest argument. Only uncertainties associated with physical phenomena and economic scarcity will be addressed.
:The second principle is that the knowledge model is capable of producing statements or assertions in the form of hypotheses that themselves are testable. [https://en.wikipedia.org/wiki/Testability Testability], in this sense, is defined as the property applying to an empirical hypothesis and involves two components:
::The logical property that is variously described as contingency, defeasibility, or falsifiability, which means that counterexamples to the hypothesis are logically possible. Contrast this to a [https://en.wikipedia.org/wiki/Tautology_(logic) logical tautology], which is always true that is true in every possible interpretation. The practical feasibility of observing a reproducible series of such counterexamples if they do exist. In short, a hypothesis is testable if there is some real, non-zero expectation of deciding whether it is true or false of verifiable, reproducible experience. Upon this property of its constituent hypotheses rests the ability to decide whether a theory can be supported or falsified by actual experience data. (Source Wikipedia.)
'''Knowledge models must be capable of producing expressions that can explain phenomena (physical, economic, and social) that meet the testability criteria described above in 'reasoning under uncertainty' or 'in the face of uncertainty' with the 'potential for' or 'presence of' error and bias.'''
===Variability and Aleatory Uncertainty===
The discussion up to this point has focused on uncertainty associated with various forms of knowledge referred to as epistemic uncertainty. Acting in the face of epistemic uncertainty introduces choice uncertainty (discussed below) and results in the production of explanations and predictions. It is implied that there will be testable hypotheses in the form of outcomes of interest to the knowledge professions. Inherent in nature is a variation of results, which may appear to uncertain but isn't. Observations of phenomena will not be the same, and part of the experimental process is to narrow those results down to within an acceptable level of tolerance. Statistical measures seek to identify underlying and unobserved measures of central tendency. These parameters are not directly observed but are derived to a degree of confidence.
In some cases, variation around a mean or within a statistical range may be perfectly acceptable to the knowledge profession. Examples of this are in the physical sciences and medicine. In Engineering and, to a lesser extent, economics, the process or phenomenon may be required to be more controlled to a narrower range than what a natural or "unmanaged" amount of variation would allow. Several courses of action present themselves.
:The first would be to ignore the aleatory phenomenon and choice, which is rejected outright.
:The second would be to assume that, in effect, such variation is itself a form of minimally managed uncertainty and treat it the same as epistemic uncertainty. This is not a desirable outcome as reducing Aleatory error and bias requires
:A third approach would be to acknowledge that process variation is, in some forms, manageable. This means making choices and acting in a way that presumes that the natural occurrence of error can be reduced, or more importantly, bias can be reduced. There is ample precedent for the third approach in civil engineering design and project management. In this sense, the argument is made that the aleatory response to managed efforts results in an elastic variation range. Presumably, an effective management effort either "shifts" the central tendency of the process results or reduces the variation range of occurrence or some other population parameter. Choosing to act and accept that narrower range rather than the broader natural variation may result in an outcome that, while well within the bounds of the expected variation, is outside the arbitrary control limits established by the choice and action. While this phenomenon mimics the broader uncertainty and its proxy error, it is not an error. The information on the variation was known, and the ability to produce narrower results was an error, albeit a pseudo-error, when compared to the broader classes of uncertainty discussed above, such as total ignorance.
::Looking at uncertainty using this third approach means that the error in choosing a new target parameter for this process may contain epistemic errors (our knowledge of the phenomenon may be erroneous, or the model flawed), aleatory uncertainties as discussed, or, more importantly, choice error or bias in thinking that we can move the process results to meet the requirements.
:'''In civil engineering practice, this may mean applying professional judgment in developing partitioning schemes or allocating uncertainty between the three dimensions (Epistemic, Aleatory, and Behavioral) of uncertainty.'''
Lastly, raising the topic like this brings the questions of effectiveness and efficiency to the fore. Advancing knowledge models that reduce error and bias at first are largely choice models resulting in justifications and favorable experiences. At some point in the process, the knowledge profession advances explanations and predictions that require reliable mathematical or logical concepts that are reduced to models and parameters. The question of efficiency becomes important; the broader uncertainty may have been reduced, but the process is economically inefficient. The profession is urged to become more frugal or, for example, reduce the variability of the outcomes. Knowledge professions often operate under conditions that require them to acquire knowledge and reduce uncertainty effectively and efficiently. Doing so requires understanding both epistemic uncertainty, as discussed above, and statistical process variation or aleatory variation.
:'''Knowledge professions manage and reduce uncertainty in the form of error and bias in an economically effective and efficient manner. This effort requires understanding both epistemic and aleatory uncertainty.'''
[[#top|Top of current page]]


This definition is discipline-neutral and applies across engineering, economics, medicine, and policy. Subsequent sections introduce discipline-specific taxonomies that adapt this general concept to the particular decision contexts of civil engineering projects.
===Choice and Behavioral Uncertainty===
 
The discussion up to this point has focused on uncertainty associated with various forms of knowledge, referred to as epistemic uncertainty, as well as the inherent variations in results, or what was termed aleatory uncertainty. Acting in the face of that epistemic and aleatory uncertainty introduces yet another uncertainty into the process, namely choice uncertainty. This uncertainty reflects uncertainties associated with first-person and third-person choice. This is particularly relevant for engineering with project stakeholders.
==Logical framework for specific risk taxonomies==
===Summary of Semantics Framework for Uncertainty===
Once uncertainty has been reduced to bounded, decision-relevant forms, it becomes possible to develop taxonomies that support analysis, communication, and management. Taxonomies are not required to be epistemically complete; rather, they must be logically distinct, practically exhaustive for their purpose, and aligned with decision needs.
Professional disciplines have gradually re-framed their understanding of uncertainty and, thru experience and analysis, have arrived at the following meta-knowledge concepts of uncertainty:
 
* '''Uncertainty and its proxy, error, have three components: [https://en.wikipedia.org/wiki/Uncertainty_quantification#Aleatoric_and_epistemic epistemic uncertainty], [https://en.wikipedia.org/wiki/Uncertainty_quantification#Aleatoric_and_epistemic aleatory uncertainty], and behavioral uncertainty.'''
The following sections examine how scientific, legal, economic, and engineering disciplines construct uncertainty and risk taxonomies, and how these perspectives inform civil engineering practice.
* '''Driven by practical objectives and benefiting from past experience, knowledge professions such as engineering start by reasoning from uncertainty using non-dogmatic beliefs, which recognize the existence of specific criteria and information that would make the believer change their beliefs using coherent approaches such as probability.'''
* '''Knowledge professions develop knowledge of how uncertainty and its proxy, error, propagate through an ordered and normative series of observations or choices that meet testability criteria in 'reasoning under uncertainty' or 'in the face of uncertainty' with the 'potential for' or 'presence of' error. An error can then be described, explained, and reduced in ways that uncertainty cannot. This allows the professions to prioritize error reduction to achieve an optimized reduction of uncertainty and produce a "legitimacy" from the fruitfulness of its use.'''
[[#top|Top of current page]]
===Uncertainty versus Risk/Hazard===
Up to this point, nothing has been said about risk or hazard. Now, risk can be defined. Simply put risk or hazard are finite, logically distinct subsets of the broader uncertainty. Risk and hazard are currently defined interchangeably. First and foremost, risk is a specific subset of general uncertainty. Any arbitrary subset of general uncertainty can be defined as a risk if it meets the following criteria:
* Uncertainty is associated with the potential for material error when acting or choosing in the face of such uncertainty in an environment of physical, economic, and social phenomena.
* Uncertainty and its proxy, error, can be partitioned into logically distinct subsets associated with multiple-step execution or choice frameworks in physical environments linked to a unique or limited range of sequences.
**Subcriteria 1:Resulting errors will have varying impacts or consequences depending on where the error occurs and the degree of causal linkage or influence in the chain.
**Subcriteria 2:Potential errors can be sequenced and prioritized to achieve an optimized reduction of error or bias and, by proxy, uncertainty over time.
* Uncertainty and its proxies, error bias, and environments are isomorphic to coherent approaches such as probability.
* Uncertainty and its proxies, error, and bias are isomorphic to coherent approaches such as knowledge models capable of producing expressions that can explain phenomena (physical, economic, and social) that meet the testability criteria in 'reasoning under uncertainty.'
This is a definition of general risk. There is no differentiation for engineering or economics, medicine or insurance. There is no difference between a 'good' risk consequence and a 'negative' one. Redefining general risk into simpler terms gives the following:
:'''General Risk is a subset of general uncertainty that is associated with the potential for material errors and biases when sequentially acting or choosing in the face of such uncertainty in an environment of physical, economic, and social phenomena; isomorphic to probability measures and methods and capable of testability.'''
[[#top|Top of current page]]


==Logical Framework for Specific Risk Taxonomies==
As noted above, at the most fundamental level, uncertainty is ".....the subjective perception of ignorance."
<ref name="Han">Han, Paul KJ, William MP Klein, and Neeraj K. Arora. "Varieties of Uncertainty in Health Care A Conceptual Taxonomy." Medical Decision Making 31.6 (2011): 828-838.</ref>
At this point in the discussion, the focus has moved from discussing uncertainty to its framed subset, risk.
:'''Further, the discussion moves from general risk to a professional or discipline-specific risk [https://en.wikipedia.org/wiki/Taxonomy taxonomy]. Beyond this point, risk will be used in place of uncertainty.'''
Han et al. note that, in general, "(t) taxonomies are valuable not only in their comprehensiveness but in their coherent reduction of uncertainty to conceptually discrete elements."
Uncertainty (and, by implication, risk or hazard) taxonomies offer an approach or tool to more precisely identify and define ontological uncertainty so that it can be quantified, analyzed, and communicated. Viewed this way, uncertainty is not a single, monolithic phenomenon but "...multi-dimensional with theoretically distinct domains and constructs that are potentially measurable and related to different outcomes, mechanisms of action, and management strategies." <ref name="Han"/> Taxonomic schemes for classifying the different kinds of scientific and, by extension, engineering uncertainty require identifying the various kinds of potential error associated with descriptive scientific or engineering information and knowledge. An example of this is the following quote from a legal authority:
:"I would especially stress the need for an agency to disclose the uncertainty that surrounds its determinations. ''' And by uncertainty, I mean the agency's ignorance as well as its quantitative estimates of error."''' (Emphasis added)
<ref>Walker citing Bazelon, Science, and Uncertainty: A Jurist's View, 5 HARV. ENVTLt L. REv. 209, 212 (1981).</ref>
''' Given the necessity of acting in the face of enormous uncertainties
<ref>Vern citing Ruckelshaus, Science. Risk, and Public Policy, 221 SCIENCE 1026, 1027 (1983)</ref>,
discipline taxonomies must offer a clearly coherent and probabilistic approach to uncertainty that is sufficiently general in nature, logically distinct and exhaustive in scope and "...provide decision-makers with a foundation for understanding the nature of discipline information..."''' <ref name="siren"/>


[[#top|Top of current page]]
[[#top|Top of current page]]
===Scientific risk taxonomies===
=== Scientific Risk Taxonomies ===
Scientific inquiry proceeds by observing phenomena, proposing explanatory models, and testing those models against experience. At every stage of this process, uncertainty is present. Scientific risk taxonomies arise from the need to identify, distinguish, and manage different sources of uncertainty that affect observation, modeling, inference, and prediction.
The [https://en.wikipedia.org/wiki/Scientific_method scientific method] is a body of techniques for investigating phenomena in its environment, acquiring new knowledge, or correcting and integrating previous knowledge. Inherent in that process are uncertainties of many forms. Any one taxonomy of [https://en.wikipedia.org/wiki/Uncertainty scientific uncertainty] has largely been focused on statistical models used to assess and quantify sampling, errors, and parameters, although several different taxonomies are conceivable: note-24 [18]
 
====Environment-specific, Phenomena oriented, model-centric taxonomy of uncertainties====
Most scientific taxonomies of uncertainty have focused on uncertainties associated with data, parameters, and models, particularly those that can be represented statistically. While multiple taxonomies are possible, a common organizing principle is that uncertainty is environment-specific, phenomenon-oriented, and model-centric.
** [https://en.wikipedia.org/wiki/Uncertainty_quantification#Sources_of_uncertainty '''Parameter uncertainty'''] the source of which is model parameters that are inputs to the computer model (mathematical model) but whose exact values are unknown and cannot be controlled, or whose values cannot be exactly inferred by statistical methods. Subsets of this type of uncertainty include but are not limited to:
 
***'''Experimental uncertainty''' is also known as observation error, which comes from the variability of experimental measurements. An example is repeating an experiment measurement several times using exactly the same settings for all inputs/variables and recording the variability. It is a subset of the larger uncertainty component, parameter uncertainty.  
====Environment-specific, phenomenon-oriented, model-centric taxonomy of uncertainty====
**'''Parametric variability''' comes from the variability of the input variables of the phenomena model and is also a subset of the larger uncertainty component, parameter uncertainty.  
A widely used scientific taxonomy distinguishes uncertainty according to its relationship to models and data:
*'''Structural uncertainty''', or model inadequacy, model [https://en.wikipedia.org/wiki/bias bias] or "[https://en.wikipedia.org/wiki/Systemic_bias systemic bias]", or model discrepancy, which comes from the lack of knowledge of the underlying true state of the phenomenon or its environment. It depends on how accurately a mathematical model describes the true state of the phenomenon or what is termed "model fitness". Due to the inherent nature of uncertainty in any knowledge body (scientific or engineering), models are only an approximation to reality. Therefore, any conclusions drawn from the model can be very misleading when the underlying basis is not plausible or lacks validity. '''note-25 [19]]'''
 
*** What is missing in this context is any concept of output variability due to the model itself. Part of this is due to the lack of recognition of "process" in scientific investigation. The concept of the scientific method started with a single investigator, such as Galileo or Michael Faraday, working in their laboratories. It has grown into planet and solar system scale experiments such as data gathered on planetary flybys such as Mars, Pluto, and Ceres to the hunt for the Higgs Boson. Ultimately, science has become more like engineering in the scale and complexity of its investigations and theory aggregates, such as the "Unified theory" of particle physics. Subsets of this type of uncertainty include but are not limited to: 
* '''Parameter uncertainty'''
*** '''Algorithmic uncertainty''', or numerical uncertainty, comes from numerical errors and numerical approximations per implementation of the computer model. Most models are too complicated to solve exactly. For example, the [https://en.wikipedia.org/wiki/Finite_element_method finite element method] or [https://en.wikipedia.org/wiki/Finite_difference_method finite difference method] [may be used to approximate a solution [https://en.wikipedia.org/wiki/Partial_differential_equation partial differential equation], which introduces numerical errors. Other examples are numerical integration and infinite sum truncation, which are necessary approximations in numerical implementation.
Parameter uncertainty arises from uncertainty in the numerical values of model inputs. These parameters may be physically unobservable, indirectly inferred, or only partially constrained by available data.
*** '''Interpolation uncertainty''' comes from a lack of available data collected from computer model simulations or experimental measurements. For other input settings that don't have simulation data or experimental measurements, one must interpolate or extrapolate to predict the corresponding responses.
** '''Experimental (observational) uncertainty''' results from variability in repeated measurements under nominally identical conditions.
[[#top|Top of current page]]
** '''Parametric variability''' reflects natural or contextual variability in input variables that are treated as fixed values within a model.
 
* '''Structural uncertainty'''
Structural uncertainty, also referred to as model inadequacy or model discrepancy, arises when a model fails to capture relevant features of the underlying phenomenon. Because all models are simplifications of reality, structural uncertainty is unavoidable and depends on model assumptions, scope, and fitness for purpose.
** Structural uncertainty is distinct from parameter uncertainty and cannot be reduced solely by collecting additional data.
** Inadequate model structure can lead to systematically misleading conclusions even when parameter estimates appear precise.
 
* '''Algorithmic (numerical) uncertainty'''
Algorithmic uncertainty arises from numerical approximations used to implement models computationally. Examples include discretization error, convergence error, and truncation error associated with numerical solution methods such as finite difference or finite element approximations.
** These uncertainties depend**


====Commentary====
A more comprehensive taxonomy of uncertainties that acknowledges knowledge, data, and linguistic uncertainties is:
*'''Epistemic uncertainty''' -[https://en.wikipedia.org/wiki/Uncertainty_quantification#Aleatoric_and_epistemic_uncertainty Epistemic uncertainty] or systematic uncertainty, in contrast, reflects limitations in the current “state of knowledge” underlying models themselves, originates from competing theories or models, is not readily quantifiable, and is manifest by subjective confusion or indecision. It includes uncertainty due to measurement limitations, insufficient data, extrapolations and interpolations, and variability over time and space. Epistemic uncertainty is uncertainty about "...some determinate fact ... because of a lack of complete information. '''cite_note-26 [20]]''' Epistemic uncertainty can be classified into six main types:'''cite_note-27 [21]]'''
*''' Measurement error''' - [https://web.archive.org/web/20170227055023/http://en.wikipedia.org/wiki/Observational_error Measurement error] is uncertainty that manifests itself as (apparently) random variation in the measurement of a quantity. Repeated measurements will vary and demonstrate classic statistical behavior.
* '''Systematic error''' - [https://en.wikipedia.org/wiki/Observational_error Systematic error] occurs due to bias in the measuring equipment, model, analysis, observation, or sampling procedure. It is formally defined as the difference between the true value of the quantity of interest and the value to which the mean of the results converges as sample or data sizes increase. Unlike measurement error, it is not (apparently) random, and therefore, results subject to systematic error alone do not vary about a true value. Systematic error can result from deliberate judgment to exclude (or include) data, parameters, or models that ought not to be excluded (or included).
** "The only way to deal with systematic error is to recognize a bias in the process, model, or procedure and remove it. Systematic error, however, is notoriously difficult to recognize except on theoretical grounds. Corrections may only be applied when the magnitude and direction of the bias are known. Such corrections underlie the application of double-sampling methods in environmental science." (Regan, et. al., op. cit.)
*'''Natural variation''' -  [https://en.wikipedia.org/wiki/Natural_process_variation Natural variation] or underlying process variation occurs in systems that "...change (concerning time, space, or other variables) in ways that are difficult to predict...across the full range of temporal and spatial values (or other related variables)." '''note-28 [22]'''
** This form of uncertainty is reduceable utilizing tools such as [https://en.wikipedia.org/wiki/Statistical_process_control statistical process control] and replication of experiments or observations.
*'''Inherent randomness''' - [https://en.wikipedia.org/wiki/Randomness randomness] or [https://en.wikipedia.org/wiki/Uncertainty_quantification#Aleatoric_and_epistemic_uncertainty aleatory uncertainty] exists because the system is"...in principle, irreducible to a deterministic one (the most well-known case is described by [https://en.wikipedia.org/wiki/Uncertainty_principle Heisenberg’s uncertainty principle] in quantum mechanics)." '''note-29 [23], note-30 [Note 7]'''
** Even if the argument is accepted that it is unlikely that any given physical system at some level is inherently random, it is important for any taxonomy to distinguish between systems that appear random due to incomplete or inconsistent information and those that are intrinsically random. (Again, see Regan (2002)).
*'''Model uncertainty''' - [https://web.archive.org/web/20170227055023/http://en.wikipedia.org/wiki/Scientific_modelling Model uncertainty] occurs in the process of generating a model as a conceptual representation of a particular phenomenon to create a [https://web.archive.org/web/20170227055023/http://en.wikipedia.org/wiki/Scientific_modelling#Overview simplified reflection of reality]. This selectivity of factors and variables creates uncertainty in at least three ways. (Regan (2002))
** '''Variables and processes''' that are regarded as relevant often represent a trade-off between system knowledge and assumed states and model objectives;
** '''Models''' depict observed processes using logical or mathematical constructs based on underlying theories about system states or dynamics using continuous equations to describe discrete processes.
** '''Curve fitting''' (including interpolation and extrapolation) with mathematical expressions using model variables where inputs are discrete data points.
** Regan (2002) argues that '''model uncertainty''' is "...notoriously difficult to quantify and impossible to eliminate ...(and)...(t)he only reliable way of determining how appropriate a model is for prediction is to perform validation studies."
** Subjective judgment occurs due to the interpretation of scarce or error-prone data.
*** The only way to address this type of uncertainty is to "...assign a degree of belief about an event in the form of a subjective probability." (Regan (2002))
*Linguistic uncertainty - Linguistic uncertainty, or "vagueness", is a source of uncertainty and includes uncertainties due to context dependence, ambiguity, and under-specificity. '''note-31 [24]], note-32 [25]]'''
** '''Context dependence''' is uncertainty concerning the context in which a statement is to be understood;
** '''Ambiguity''' occurs when words have multiple meanings, and further reduction to a single meaning is not logically possible in a given context.
** '''Underspecificity''' occurs in the presence of "unwanted generality" or multiple interpretations, and reduction to a smaller set or even a single interpretation is not logically possible.
*Stochastic or statistical uncertainty - Stochastic or statistical uncertainty, which is sometimes known as [https://en.wikipedia.org/wiki/Uncertainty_quantification#Aleatoric_and_epistemic_uncertainty Aleatoric uncertainty] as well as the subject of [https://en.wikipedia.org/wiki/Stochastic_control stochastic control] pertains to the parameters of a risk model, originates from sampling or measurement error, and can be quantified and mathematically expressed (e.g., using confidence intervals).
[[#top|Top of current page]]
[[#top|Top of current page]]


==Uncertainty taxonomies in a legal environment==
== Uncertainty Taxonomies in a Legal Environment ==
Legal decision-making operates under conditions of uncertainty that differ in purpose and structure from those of science or engineering. From a legal perspective, a taxonomy is a systematic scheme for distinguishing, ordering, and naming types within a subject field. Such taxonomies are not required to be epistemically complete; rather, they must be sufficient to organize the kinds of descriptive information commonly encountered by decision-makers and to support fair, effective, and defensible judgments.
From a legal perspective, a definition of taxonomy is dictionary-based, such as "the systematic distinguishing, ordering, and naming of type groups within a subject field." given by Walker (op. cit.). Such legal concepts of scientific or engineering taxonomies are not required to be epistemically complete. Still, they must cover "the most significant aspects of ...(current, good discipline practices) ... and of the descriptive information commonly encountered by decision-makers" in a logically distinct manner. (Walker, 1991, p. 571) These taxonomies must be sufficient to catalog the types of uncertainty associated with descriptive assertion, including the critical subset of cause and effect assertions. This legal/decision-maker framework has presented descriptive uncertainty as having six components (Walker, 1991). Although not part of the Walker taxonomy, underlying the scheme is linguistic uncertainty, or "vagueness," as a source of uncertainty, including uncertainties due to context dependence, ambiguity, and under-specificity. '''note-33 [26]]''' Arguably, these uncertainties underlie the most basic element in the taxonomy.
 
* '''Linguistic '''- or "vagueness", is a source of uncertainty and includes uncertainties due to context dependence, ambiguity, and under-specificity. (Regan, 2002)
Walker characterizes legal taxonomies of scientific and technical uncertainty as tools for cataloging uncertainty associated with descriptive assertions, particularly those involving cause-and-effect claims. These taxonomies emphasize clarity, logical distinction, and practical exhaustiveness over theoretical completeness.
* '''Conceptual'''- the definition by choice and design of descriptive concepts or variables to be used as [https://en.wikipedia.org/wiki/Predicate_(grammar) predicates] where the subject of an assertion identifies what is being discussed and the predicate provides information about the topic or characterizations such as what the subject is, what the subject is doing, or what the subject is like (Wikipedia).  
 
* "Conceptual uncertainty, or the potential for conceptual error, arises whenever predication occurs. Whenever a concept is used to describe something, using certain concepts instead of others begins to structure how we understand the object, event, or instance under discussion. Predication or conceptualization generates useful information about things, but it also can inhibit our ability to think about those things with concepts other than those selected. The concepts used may not be the most fruitful or the best designed- either for scientific purposes or for making wise, fair, effective, and efficient decisions." (Edited for reading, Walker, 1991)
===Core components of legal uncertainty===
* Similarly, choice and design of descriptive variables enhance and restrict data set membership, creating potentially incomplete, incompatible, or inconsistent data sets, "...the classification categories employed, and the relationships among those categories (nominal, ordinal or scalar)." '''note-34 [27]]'''
Legal frameworks distinguish multiple, logically distinct sources of uncertainty that may affect descriptive assertions and decisions:
* Concept uncertainty  '''note-35 [28]''' like systematic error discussed above is notoriously difficult to recognize, except on theoretical grounds, and the magnitude and direction of the bias are known.  
 
Both terms could be analogized to that of [https://en.wikipedia.org/wiki/Accuracy_and_precision#Terminology_of_ISO_5725 accuracy] in [https://www.bipm.org/en/publications/guides/ ISO 5725] which looks at the ability of the concept or system's ability to produce results that are proximate to the "true" value or state of the phenomenon. Conceptual uncertainty and systemic bias are related to another measure of uncertainty: validity. Walker has defined validity as the ability of a concept to quantitatively describe and explain what the phenomenon objective "truly" is. Walker also ties the concepts together when he states, "Validity concerns the "accuracy" of the measurement data, not its precision." (Walker, 1998) <br>
* '''Linguistic uncertainty''' 
Additionally, conceptual uncertainty and associated validity issues could be propagated throughout this taxonomy. Every component of action and decision in the face of uncertainty raises validity issues. Walker recognized this when the author defined epistemic choice for concepts used throughout the other uncertainty components or layers.  
Linguistic uncertainty, often described as vagueness, arises from limitations of language rather than from data or models.
* '''Measurement''' uncertainty or Misclassification error- the application of the underlying concepts or variables to specific, individual cases and the uncertainty of the reliability (Walker, 1998) of the resultant data. (It is important to remember that assessment observation and measurement are used interchangeably in this analysis.) Thus, an assessment method or procedure is considered "reliable" or "precise" in the scientific terms of ISO 5715 if it repeatedly produces consistent results.
** '''Context dependence''' occurs when the applicability of a statement depends on unstated or shifting contextual conditions.
* Measurement uncertainty is logically distinct from conceptual uncertainty, which can only occur after any conceptual uncertainty has been established. Still, misclassification can occur even when the conceptual uncertainty has been minimized. Conversely, underlying errors or errors made in measurement or classification propagate thru the reasoning chain and reduce the quality or value of the final result.
** '''Ambiguity''' arises when terms admit multiple meanings that cannot be resolved within the given context.
* While uncertainties associated with quantitative measurements or assessments can be statistically evaluated and described, uncertainties related to qualitative assessments are more problematic.  
** '''Underspecification''' occurs when descriptions lack sufficient detail to support a unique interpretation.
**Working through the taxonomic chain from base concept to causal explanation requires amassing and integrating qualitative information and quantitative data into input parameters for mathematical models. Developing procedures for producing consistent, repeatable sets of information from assessments that minimize conceptual error or systemic bias requires professional efforts to "validate" such methods, models, and judgments at all layers in the process. Validation as a process is something that civil engineering as a practice needs to embrace more frequently.  
Linguistic uncertainty underlies all other components of legal uncertainty, as it affects how evidence, concepts, and models are interpreted.
* '''[https://en.wikipedia.org/wiki/Sampling Sampling]'''- in the classical statistics sense, is the selection of a limited subset of a larger population to use as a basis for making estimates about the population in the form of attributes, proprieties, or parameters. The resulting information would be determinative in making forecasts about future population sampling or possessing a desired amount of predictive power. The uncertainty about the ability of this information to correctly predict future samples is termed sampling error.  
 
* '''Modeling'''- Modeling uncertainty arises whenever a claim is made that out of a class of candidate relationships and variable pairings, one variable pairing inclusive of constants is chosen that possesses a particular or persistent mathematical relationship to another variable X. Modeling errors arise in selecting the wrong variable pair and constants or by incorrectly specifying its constants. (Walker, 1991, pg. 599)
* '''Conceptual uncertainty''' 
** '''Causal'''- In causal modeling and analysis, the relationship between causal variables is not strictly a mathematical function. Still, it makes testable predictions and explains "...how a system of variables works, why a system works the way it does, or why it makes sense to think of certain variables as a system" at all." (Walker, 1991, pg. 609)
Conceptual uncertainty arises from the choice and definition of concepts used to describe phenomena. Whenever predicates are selected to characterize an object, event, or condition, alternative conceptualizations are excluded.
** '''Epistemic'''- the choice of interpretations for fundamental, logical concepts used throughout the other components or layers.  
Conceptualization generates useful structure, but it can also constrain understanding by privileging certain interpretations over others. Poorly chosen or inadequately defined concepts can therefore introduce systematic distortion into legal and technical reasoning.
The components of this uncertainty taxonomy can combine in different ways to "...produce different aggregate uncertainties." '''note-36 [29]'''
 
:''' Only the scientific and engineering professions possess the capacity to develop and validate procedures and models that combine the different kinds of qualitative '''note-37 [30]''' and quantitative information and their associated potential for error into an aggregate measure or "scalar variables" of uncertainty.'''note-38 [31]]
Conceptual uncertainty is closely related to issues of validity. A concept is valid to the extent that it accurately represents the phenomenon it is intended to describe. Conceptual bias, like systematic error in measurement, is difficult to detect and often recognizable only through theoretical analysis or comparison across alternative frameworks.
Scalar variables are quantitative variables whose categories are related by some measure of the relevant property's incremental frequency, degree, or amount. (Walker, 1991) Examples are Modulus of Elasticity, Compression stress in elastic materials, etc.  
 
* '''Measurement and classification uncertainty'''
Measurement uncertainty arises when concepts are applied to specific cases through observation, assessment, or classification. Even when conceptual uncertainty has been minimized, misclassification may occur due to procedural limitations, observer judgment, or data quality.
Measurement uncertainty affects the reliability and precision of descriptive assertions. Errors at this stage can propagate through subsequent reasoning and reduce the quality of causal inference or decision outcomes.
 
* '''Sampling uncertainty'''
Sampling uncertainty arises when conclusions about a population are inferred from a limited subset of observations. The uncertainty reflects the extent to which the sample represents the relevant population.
In legal and regulatory contexts, sampling uncertainty affects the credibility of generalizations, forecasts, and risk characterizations based on empirical evidence.
 
* '''Modeling uncertainty'''
Modeling uncertainty arises when descriptive or causal claims rely on simplified representations of complex systems. This includes uncertainty associated with variable selection, functional relationships, and parameter specification.
** '''Causal uncertainty''' arises when relationships between variables are inferred rather than directly observed. Legal decision-makers often rely on causal models to explain why an outcome occurred or to predict the consequences of alternative actions.
** '''Epistemic choice''' refers to uncertainty introduced by selecting among competing interpretive frameworks or explanatory models.
 
===Aggregation and interaction of uncertainties===
The components of legal uncertainty do not operate independently. Linguistic, conceptual, measurement, sampling, and modeling uncertainties can combine in different ways to produce aggregate uncertainty affecting the credibility, relevance, and weight of evidence.
 
Legal taxonomies therefore focus not on eliminating uncertainty, but on making its sources explicit so that decision-makers can assess reliability, assign weight, and determine appropriate standards of proof or precaution.
 
===Relationship to scientific and engineering practice===
While legal taxonomies do not require quantitative completeness, they depend critically on validated scientific and engineering methods to support descriptive and causal claims. Scientific and engineering disciplines provide procedures and models capable of integrating qualitative and quantitative information into structured representations of uncertainty.
 
However, the legal use of such information remains distinct. The objective is not optimization or prediction per se, but defensible judgment under uncertainty. Validation, transparency, and clarity of assumptions are therefore central concerns at the interface between legal, scientific, and engineering domains.
 
These distinctions inform how uncertainty is framed, communicated, and relied upon in civil engineering projects subject to regulatory review, contractual interpretation, or dispute resolution.
 


[[#top|Top of current page]]
[[#top|Top of current page]]


===Economics uncertainty taxonomies===
=== Economics Uncertainty Taxonomies ===
Like scientific and engineering treatments of uncertainty, economic approaches are environment-specific, phenomenon-oriented, and model-centric. In economics, the relevant environment is the market or sector of economic activity, and the phenomena of interest are human actions, organizational behavior, and manufactured constructs such as firms, contracts, and markets.
Like scientific concepts of uncertainty, economics is environment-specific (in this case, read sector of economy or markets), phenomenon-oriented (in this case, read human activity and manufactured phenomena such as firms and markets guided by human judgment and decision), and model-centric.  
 
:''' Economics is not interested in all forms of uncertainty, only specific, meaningful subsets possessing casual connections with material impacts, often labeled as 'risks'.'''
Economics does not address all forms of uncertainty. Instead, it focuses on subsets of uncertainty that possess causal connections to material outcomes, particularly those affecting prices, profits, losses, and allocation of resources. These subsets are commonly labeled as risks.
One of its earlier writers ([https://en.wikipedia.org/wiki/Frank_Knight#Life_and_career Knight], 1921, 1948, 1957) attempted to define "uncertainty" as the presence of "defects of managerial knowledge" (or [https://en.wikipedia.org/wiki/Knightian_uncertainty knightian uncertainty] and thus risk centric) as risk that is immeasurable, not possible to calculate.(Wikipedia) Risk in this sense was defined as "the ordinary risks of business activity which can ... be reduced... by applying the insurance principle." Knight does acknowledge that risk is a specific and unambiguous subset of uncertainty. (Risk, Uncertainty and Profit, 1957, pg. 19) For Knight, measuring uncertainty meant measuring the probability of its occurrence and the severity of its consequences or economic impact, e.g., measurable risk of loss versus unmeasurable uncertainty consequences, which Knight referred to as "the imperfection of knowledge". (Risk, Uncertainty and Profit, 1957, pg. 197) One of Knight's many contributions to this analysis was recognizing information and knowledge's role in economic activity.
 
:"''(W)e are concerned only to emphasize the fact that '''knowledge is in a sense variable in degree and that the practical problem may relate to the degree of knowledge rather than to its presence or absence in toto.''' We live only by knowing something about the future, while the problems of life, or conduct at least, arise from knowing so little. This is as true of business as of other spheres of activity. The situation's essence is action according to opinion, of greater or less foundation and value, neither entire ignorance nor complete and perfect information, but partial knowledge. If we are to understand the workings of the economic system, we must examine the meaning and significance of uncertainty; and to this end, some inquiry into the nature and function of knowledge itself is necessary.''" (Knight, pg. 199) Emphasis added
A foundational contribution to the economic treatment of uncertainty is associated with Frank Knight, who distinguished between measurable risk and unmeasurable uncertainty. Knight characterized uncertainty as arising from defects or limitations in knowledge, particularly managerial and organizational knowledge, rather than from inherent randomness alone. In this framework, risk refers to situations in which probabilities can be assigned to outcomes, while uncertainty refers to situations in which such assignment is not possible.
Knight also reinforced the difficulties in classifying uncertainties when he analyzed life insurance. In this case, accidental death was an uncertain phenomenon compared to sickness and accident, where an "...objective description and classification of cases was impossible..." (Knight, pg. 248) Another factor that made uncertainties ineligible as risks and, therefore, uninsurable because they were unclassifiable was the exercise of judgment in making decisions by the businessman. (Knight, pg. 251)
 
This is a simple classification of economic uncertainty and, as an idealization, is philosophically controversial. '''note-39 [32]'''
Knight defined risk as the class of uncertainties that can be reduced or managed through probabilistic reasoning and mechanisms such as insurance. By contrast, uncertainty in the strict sense reflects imperfect knowledge that cannot be reduced to numerical probabilities. For Knight, measuring uncertainty involved assessing both the likelihood of occurrence and the severity of economic consequences, while recognizing that some consequences remain fundamentally indeterminate.
* Uncertainty and information about the economic environment are distinct from uncertainty about others’ behavior or choices.  
 
* Risk as a specific subset of uncertainty implies that "...all possible acts are known, all possible outcomes arising from each act are known, and it is possible to assign probabilities to each act." '''note-40 [33]'''
Knight emphasized that economic decision-making is rarely conducted under conditions of complete ignorance or perfect information. Instead, action is typically based on partial knowledge, judgment, and opinion formed under uncertainty. Economic behavior therefore reflects degrees of belief and confidence rather than certainty, and the practical problem lies in managing variation in knowledge rather than eliminating uncertainty altogether.
Like the economic [https://en.wikipedia.org/wiki/Theory_of_the_firm theory of the firm], an economic theory of uncertainty seeks to explain and predict the nature of a specific subset of uncertainty (in this case, risk relating to physical phenomena and human activity), including its behavior, structure, and relationship to the universal uncertainty of physical phenomena. In this sense, uncertainty, like firms and markets, can establish price equilibriums under the right circumstances different from those that might have occurred in either of the other two. Such a theory of uncertainty offers a partitioning scheme that decomposes uncertainty into distinct and meaningful subsets, of which risk is a significant one. It also explains how the presence and variability of knowledge cause or " drive" economic consequences. Unlike physical phenomena, economic activity creates artificial objects such as products, firms, mediums of exchange, markets, economies, and knowledge about those activities. The economics of uncertainty exists as an alternative to "certainty" models that assume away imperfect knowledge and unknown choice/judgment preferences when it is more efficient for economic decision-making. This also allows the introduction of the logical concept of "hazard" versus "risk". Frank used hazard extensively in Risk, Uncertainty, and Profit, but not to the extent that one could say it was interchangeable. An example of this is in the term "[https://en.wikipedia.org/wiki/Moral_hazard Moral hazard]," where a firm could engage in "riskier" and potentially "uninsurable" behavior if the information were transparent, and, therefore, insurance coverage of losses is limited. note-41 [34]], note-42 [35]]
 
In his analysis of insurance markets, Knight illustrated the difficulty of classifying certain uncertainties. Events such as accidental death could be treated probabilistically, while sickness or business failure resisted objective classification due to heterogeneity, judgment, and contextual dependence. Uncertainties that could not be classified or grouped were therefore not insurable and remained outside the domain of measurable risk.
 
===Core distinctions in economic uncertainty===
Economic treatments of uncertainty commonly rely on a small number of foundational distinctions that shape both theory and practice.
 
* Uncertainty about the economic environment, including prices, demand, technology, and external conditions, is distinct from uncertainty about the behavior or choices of other actors.
* Risk is a subset of uncertainty in which the decision-maker can enumerate possible actions, identify possible outcomes arising from each action, and assign probabilities to those outcomes.
* Uncertainty arises when such enumeration or probability assignment is not feasible due to incomplete knowledge, structural change, heterogeneity, or reliance on judgment.
 
These distinctions form an idealized classification that has been influential in economic theory, despite remaining philosophically and empirically contested. They nevertheless provide a useful framework for distinguishing calculable exposure from judgment-dependent uncertainty in economic analysis.
 
===Uncertainty, knowledge, and economic models===
Like the theory of the firm, an economic theory of uncertainty seeks to explain and predict the behavior of specific subsets of uncertainty that affect material economic outcomes. These theories examine how the presence, distribution, and variability of knowledge influence decision-making, pricing, and allocation of resources.
 
For analytical convenience, many economic models assume certainty or perfect information. The economics of uncertainty exists as an alternative framework that explicitly incorporates imperfect information, unknown preferences, and judgment-based decisions when doing so improves explanatory or predictive power.
 
Unlike physical systems, economic activity produces artificial constructs such as firms, contracts, markets, financial instruments, and institutions. Uncertainty in economics therefore arises not only from external conditions but also from institutional design, incentives, strategic interaction, and information asymmetry.
 
===Risk, hazard, and moral hazard===
Economic analysis distinguishes between risk and hazard. While the terminology is not always used consistently, the distinction becomes most explicit in the concept of moral hazard.
 
Moral hazard arises when the presence of insurance, guarantees, or protection alters behavior, leading actors to take actions that increase exposure to loss. In such cases, uncertainty is not merely a property of the environment but is generated endogenously through behavior and information asymmetry.
 
This distinction is particularly relevant for engineering projects involving insurance, contracting, public–private partnerships, and regulatory oversight, where incentives and information structure influence both technical and economic outcomes.
 
In summary, economic uncertainty taxonomies emphasize the role of partial knowledge, judgment, and incentives in shaping material outcomes. These frameworks inform how risk is identified, priced, transferred, or retained and provide an essential foundation for understanding cost, schedule, and financial uncertainty in civil engineering practice.
 
[[#top|Top of current page]]
[[#top|Top of current page]]


===Uncertainty and risk in policy and regulatory environment===
=== Uncertainty and Risk in Policy and Regulatory Environment ===
Decision-making in policy and regulatory contexts must proceed under conditions of incomplete and potentially inaccurate information. The central problem is not eliminating uncertainty, but selecting decision rules that remain defensible in its presence.
:''"Hume's 'just reasoner', when faced with a difficult public policy decision in current times, would probably commission a risk analysis. But how could they incorporate 'a degree of doubt, caution, and modesty?"'' '''note-43 [36]'''
 
The problem of "decision-making in the face of uncertainty" is how to regulate based on incomplete information that has the potential to be materially inaccurate. A contextual assumption is that we need to evaluate decision rules for dealing with uncertainty. As a social enterprise, risk regulation, whatever its substantive objectives, should be as '''effective, efficient, and equitable''' as practically possible. These "three E's" form a set of "process objectives" or "meta-goals." From the uncertainty standpoint, causal information can be usefully divided into two major categories: information about groups and information about individuals.
As a social enterprise, risk regulation, regardless of substantive objectives, is commonly evaluated against three process objectives: effectiveness, efficiency, and equity. These objectives serve as meta-goals guiding regulatory choice under uncertainty.
 
From the standpoint of uncertainty analysis, causal information relevant to regulation can be divided into two broad categories:
* information about groups or populations, and
* information about individuals or specific cases.


Each category is associated with distinct forms of uncertainty. Group-level information is typically subject to sampling error, model uncertainty, and aggregation effects, while individual-level information is more strongly influenced by measurement error, classification uncertainty, and contextual variation. These uncertainties are logically distinct, generally independent, and cumulative, contributing to the overall uncertainty faced by decision-makers.
Each category, group, and individual has its distinctive types of inherent uncertainty. These are logically distinct, generally independent, and cumulative, contributing to '''(?????)'''
 
Policy and regulatory frameworks therefore rely on structured approaches to risk assessment and uncertainty characterization to determine appropriate thresholds for action, precaution, and intervention.


[[#top|Top of current page]]
[[#top|Top of current page]]
 
=== Engineering Uncertainty Taxonomies ===
===Engineering uncertainty taxonomies===
Like scientific and economic concepts of uncertainty, engineering is environment-specific, phenomena-oriented, model-centric, external choice, and driven by decision-making in the face of uncertainty. Like economics and unlike science, engineering is not interested in all forms of uncertainty, only those with determinable and material consequences. Like economics, engineering conceives risk as a specific and unambiguous subset of uncertainty determined by measuring the probability of its occurrence and the severity of its consequences or economic impact, e.g., measurable risk of loss versus unmeasurable uncertainty consequences. Also, engineering recognizes the role information and, by extension, knowledge plays in constructing the built environment.
Like scientific and economic treatments of uncertainty, engineering approaches are environment-specific, phenomenon-oriented, and model-centric. Engineering is explicitly driven by decision-making in the face of uncertainty and is concerned primarily with uncertainties that have determinable and material consequences.
'''note-44 [37]]''' Like economics, engineering differs from economics and scientific uncertainty in its interest in behavioral uncertainty.  
 
*"Behavioral or interaction uncertainty is how individuals or organizations act or interact. Behavioral uncertainty arises from four sources: design uncertainty, requirement uncertainty, volitional uncertainty, and human errors." '''note-45 [38]]'''
Like economics, engineering conceives risk as a specific and unambiguous subset of uncertainty, characterized by the probability of occurrence and the severity of consequences, including economic, safety, and performance impacts. Engineering practice also recognizes the central role of information and knowledge in constructing and operating the built environment.
** A design uncertainty is a choice among alternatives over which an individual or group of individuals exercises direct control but has not yet decided upon.
 
** Requirement uncertainty includes parameters of interest to and determined by the stakeholder, independent of the engineer or designer.
In contrast to scientific inquiry, engineering is not concerned with uncertainty for its own sake. It focuses on uncertainty insofar as it affects design choices, system performance, project execution, and stakeholder outcomes.
** Volitional uncertainty is uncertainty about what the subject him/herself will decide. Other people’s future actions and conduct are not entirely predictable, particularly when dealing with other organizations.
 
** Human errors occur during the development of a system or project due to blunders or mistakes by an individual or individuals.  
===Behavioral and interaction uncertainty in engineering===
In addition to epistemic and aleatory uncertainty, engineering explicitly addresses behavioral or interaction uncertainty, which arises from how individuals and organizations act or interact within projects and systems.
 
Behavioral uncertainty arises from several sources:
* '''Design uncertainty''', which reflects choices among alternatives under the direct control of engineers or project teams that have not yet been resolved.
* '''Requirement uncertainty''', which includes parameters determined by stakeholders and external parties, independent of the engineer or designer.
* '''Volitional uncertainty''', which concerns uncertainty about future decisions and actions of individuals or organizations, particularly in multi-party or contractual environments.
* '''Human error''', which arises from mistakes, lapses, or blunders during the development, construction, or operation of systems and projects.
 
These sources of behavioral uncertainty interact with technical and economic uncertainties and must be managed through engineering judgment, governance structures, contractual arrangements, and professional standards.


[[#top|Top of current page]]
[[#top|Top of current page]]


==Practice frameworks for uncertainty and risk in civil engineering practice==
==Practice Frameworks for Uncertainty and Risk in Civil Engineering Practice==
Professional practice frameworks in civil engineering address uncertainty indirectly through their treatment of risk, assumptions, variability, and decision-making. These frameworks differ in how explicitly they define uncertainty and in how they relate risk to underlying knowledge limitations.
===PMIBoK===
 
PMI does not define uncertainty, but the PMI Body of Knowledge uses the term in 45 places (uncertainty) and as describing properties in 8 places (uncertainties). [See Note 8] PMI does define "risk" and uses the term over 1,300 times in the same document. In its glossary, PMI also defines terms such as "threat" and "opportunity" but not events.[391 The BoK contextually defines uncertainty when it states that project risk has its origins in the uncertainty present in all projects. (Op. Cit., pg 309) <br>
===Project Management Institute Body of Knowledge (PMIBoK)===
'''Uncertainty''' is contextually defined and taken as having the property of affecting project execution and the ability to meet stakeholder expectations. Uncertainty is more than the sum of all individual risks (known and unknown). The nature of this uncertainty is not defined, only its capacity to affect something else or its properties.<br>
The PMI Body of Knowledge does not provide a formal definition of uncertainty. Nevertheless, the term is used repeatedly throughout the document to describe properties affecting projects. Uncertainty is treated contextually as a condition inherent in all projects and as the underlying source of project risk.
'''Risk''' is defined as " ... an uncertain event or condition that, if it occurs, has a positive or negative effect on one or more project objectives." (Ibid.) Beyond this formal definition, PMI adds context when, in its risk management section (Sec. 11 ), the BoK states that risk is a caused event or condition with multiple causes and impacts. The BoK even offers specific techniques for mapping cause-and-effect relationships and influence diagrams. (Sec. 11.2.2.5) Not as evident but equally important is the recognition that not only is risk caused but the impact is "triggered". The risk trigger is an event or situation that signals that it is about to occur (Glossary, pg. 566). Risk conditions are factors that affect or otherwise contribute to risk, such as project stakeholders. Risk implicitly retains some residual element of probability in it, or a value of less than 1.0 with risk that approaches a level of near certainty is termed "issues" or "realized risk" .(Op. Cit., pg 309). PMI also links risk to underlying variations in project outcomes. (Ibid.) Risk is based upon data and information which can be assessed as to its quality (Sec. 11.3.2.3). This analysis looks to determine the value of the information and examines the degree to which the risk information is understood as well as its " ... accuracy, quality, reliability and integrity ... " (Ibid.) Part of that is understanding the relationship between occurrence and impact as outlined in PMl's Figure 11-10 Risk Impact Matrix and developing a model for prioritizing risk products and setting the threshold for action.
 
====Commentary:====
In contrast, PMI provides an explicit definition of risk. Risk is defined as an uncertain event or condition that, if it occurs, has a positive or negative effect on one or more project objectives. Within the PMIBoK, risk is understood as a caused condition with identifiable triggers, multiple causes, and multiple impacts. Risk conditions are contextual factors that contribute to the likelihood or impact of risk events, including stakeholder behavior and project environment.
For defining and identifying risk, PMI notes in Sec. 11.2.2.4 that " ... Every project and its plan is conceived and developed based on a set of hypotheses, scenarios, or assumptions." Part of the risk analysis process is identifying risks to the project, such as inaccuracy, instability, inconsistency, or incompleteness of assumptions. Similarly, the quality of management plans, as well as their consistency with others and the project objectives and assumptions are 11 •• .indicators of risk in the project." (Sec. 11.2.2.1) <br>
 
Similarly, the role of engineering economics in risk is embedded or implied in the PMI definition of risk when the BoK discusses risk identification as a process of assessing which risks out of the total risk exposure for the project "may affect" the project and distilling their characteristics. Embedded in this statement is the concept that not all risks can cause economic impacts (positive and negative) to the project. Also embedded is the requirement to understand risk characteristics to identify project risk (Cost and schedule). Lastly, risk identification is an iterative process of incrementing project risk documentation, much like project scope, cost, and schedule documentation. <br>
PMI further distinguishes between potential risks and realized risks. Risks that approach certainty are no longer treated as risks but as issues requiring direct management. Risk therefore retains an implicit probabilistic character, with values strictly less than certainty.
Lastly, PMI acknowledges the complex constitution of risk aggregates or the "sum" of all risks in its material, but is it a sum? Risk information has descriptive and explanatory content. These are knowledge and meta-knowledge components. Understanding project assumptions is project-specific knowledge, but identifying risks from assumption inaccuracy, instability, inconsistency, or incompleteness requires professional or program meta-knowledge. <br>
 
'''Uncertainty exists in all projects, but risk, a subset of uncertainty with material economic impacts, is a key meta-knowledge element for civil engineering practice.'''
Risk analysis within the PMIBoK emphasizes the quality of underlying information. Risk data are evaluated in terms of accuracy, reliability, integrity, and completeness. Techniques such as influence diagrams and risk impact matrices are used to map causal relationships between events and outcomes and to prioritize responses based on likelihood and consequence.
===Software Development Process- Risk Focused===
 
The Unified Process requires the project team to focus on addressing the most critical risks early in the project life
====Commentary====
cycle. The deliverables of each iteration, especially in the Elaboration phase, must be selected to ensure that the greatest risks are addressed first. <ref> Booch, Grady, Ivar Jacobson, and James Rumbaugh. "The unified software development process."
PMI explicitly acknowledges that every project is conceived and planned based on assumptions, scenarios, and hypotheses. Risk identification therefore includes assessing the accuracy, stability, consistency, and completeness of those assumptions. Deficiencies in assumptions and plans are treated as indicators of project risk.
Reading: Addison Wesley (1999).</ref>
 
From an economic perspective, PMI embeds cost and schedule considerations within its risk framework by requiring practitioners to identify which risks may materially affect project objectives. Risk identification is an iterative process, evolving alongside scope, cost, and schedule development.
 
PMI also recognizes that total project risk is not merely the arithmetic sum of individual risks. Risk information has both descriptive and explanatory content. Understanding project assumptions represents project-specific knowledge, whereas identifying risks arising from assumption failure requires professional or program-level meta-knowledge.
 
Uncertainty exists in all projects, but risk, as a subset of uncertainty associated with material economic and performance impacts, functions as a key meta-knowledge element in civil engineering practice.
 
===Risk-focused software development processes===
Risk-focused development processes, such as the Unified Process, emphasize early identification and mitigation of critical risks. Project iterations are structured so that the highest-impact risks are addressed first, particularly during early phases when design flexibility is greatest.
 
This approach illustrates a general principle applicable to engineering projects: uncertainty reduction is most effective when it is integrated into project sequencing and decision-making rather than deferred to later stages.
 
===American Society of Civil Engineers (ASCE)===
===American Society of Civil Engineers (ASCE)===
ASCE does not provide an explicit definition of uncertainty in the Civil Engineering Body of Knowledge. The term is used to describe properties of engineering problems and design parameters, particularly variability and lack of determinacy.
ASCE does not define uncertainty, but the ASCE CE Body of Knowledge (CEBoK) uses the term in 22 places (uncertainty) and describes properties in 13 places (uncertainties). <br>
 
The CEBoK does not use the phrase "uncertainty and risk" as PMI and AACE do in their publication. ASCE reverses the two (Risk and uncertainty) in twelve places regarding technical outcomes (Outcome 12). A fundamental difference between PMI and ISO is that risk is considered a subset of uncertainty. ASCE does not define "risk" but uses the term 25 times in the same document. Almost all are in the context of variation of design parameters and not in the classical context of cost, schedule uncertainty, and risk.
The CE Body of Knowledge does not consistently use the paired phrase “uncertainty and risk” as found in PMI or AACE publications. In several instances, the ordering is reversed (“risk and uncertainty”), and references to risk primarily concern variation in technical parameters rather than cost, schedule, or project-level exposure.
====Commentary:====
 
...  
A fundamental distinction between ASCE and PMI frameworks is that PMI treats risk as a subset of uncertainty, whereas ASCE does not explicitly articulate this relationship. ASCE usage of risk is narrower and more closely aligned with technical variability and engineering judgment than with probabilistic project risk management.
=== American Association of Cost Engineers (AACE) ===
 
AACE defined uncertainty, risk, and other related terms in its Risk Management Dictionary. <ref>Risk Management Committee uRisk Management Dictionary, Cost Engineering Vol. 37/No. 10, OCTOBER 1995. </ref>
====Commentary====
AACE's overall strategy was to define risk and other terms that stem from base uncertainty. AACE first defined uncertainty as .... "(t)he total range of events that may happen and produce risks (including both threats and opportunities) affecting a project (see opportunities, events, conditions, risk, and threats" where the following sub-definitions apply:
The ASCE framework emphasizes the ability of engineers to recognize, analyze, and manage variability in design and performance. While uncertainty is acknowledged, it is not developed as an explicit conceptual foundation. Risk appears primarily as a technical consideration rather than as a comprehensive project or economic construct.
** Biases--A lack of objectivity based on the individual's position or perspective. Systematic and predictable relationships between a person's opinion or statement and his/her underlying knowledge or circumstances. Note: there may be "system biases" as well as "individual biases."
 
** Condition (Uncertain Condition)-Any specific identifiable circumstance (such as the rate of inflation or the quality of labor available) that might affect the outcome of the project
This emphasis reflects ASCE’s focus on professional competency and technical outcomes rather than on project governance or economic exposure.
** Event (Uncertain Condition)-is a specific identifiable action (such as a large government project being started in the same labor area as your project) or an act of nature that might happen and that (if it does happen) could affect the outcome of the project.
 
** Opportunities are Uncertain events that could improve the results or improve the probability that the desired outcome will happen
===American Association of Cost Engineers (AACE)===
** Threats are Uncertain events that are potentially negative or reduce the probability that the desired outcome will happen.
AACE provides explicit definitions of uncertainty, risk, and related terms through its Risk Management Dictionary. AACE defines uncertainty as the total range of events and conditions that may occur and affect a project, including both threats and opportunities.
*** AACE defines Risk as an "ambiguous term" (sic) that is synonymous with uncertainty or a negative subset such as "threats", or an overall negative impact of all possible uncertainties.
 
====Commentary:====
Within the AACE framework, uncertainty is decomposed into identifiable components:
...
* '''Bias''' refers to systematic lack of objectivity arising from individual or system-level perspectives.
* '''Uncertain conditions''' are identifiable circumstances, such as labor availability or inflation, that may affect project outcomes.
* '''Uncertain events''' are specific actions or occurrences, including external actions or natural phenomena, that may or may not occur.
* '''Opportunities''' are uncertain events that could improve outcomes or increase the probability of success.
* '''Threats''' are uncertain events that could negatively affect outcomes or reduce the probability of success.
 
AACE characterizes risk as an ambiguous term that may refer to uncertainty as a whole, to negative subsets such as threats, or to the aggregate negative impact of multiple uncertainties.
 
====Commentary====
AACE’s approach emphasizes comprehensive enumeration of uncertainty sources and their economic implications. By explicitly defining bias, conditions, events, opportunities, and threats, AACE provides a granular framework for cost and schedule risk analysis.
 
Unlike PMI, which maintains a clearer distinction between uncertainty and risk, AACE permits broader and more flexible usage of the term risk. This flexibility reflects the needs of cost engineering practice, where uncertainty is often aggregated into financial exposure metrics.
 
Together, PMI, ASCE, and AACE frameworks illustrate differing professional perspectives on uncertainty and risk. Civil engineering practice must navigate these differences, applying discipline-specific judgment to integrate technical, economic, and project-level uncertainty into coherent decision-making.
 
==Limitations of the definitions==
Any definition of uncertainty and risk used in civil engineering practice is necessarily limited in scope and purpose. The definitions presented here do not attempt to resolve longstanding philosophical debates regarding determinism, probability, or the nature of knowledge. Instead, they are constrained by the practical requirements of professional decision-making.
 
Several limitations are inherent:
 
* Definitions of uncertainty rely on epistemic assumptions about what is known, knowable, or measurable at a given point in time. These assumptions may change as information, models, or institutional contexts evolve.
* Taxonomies of uncertainty are abstractions that simplify complex interactions among epistemic, aleatory, and behavioral sources of uncertainty. In practice, these components often interact in ways that resist clean separation.
* Risk definitions depend on the ability to partition uncertainty into bounded subsets associated with material consequences. This partitioning involves judgment and may vary across projects, disciplines, and stakeholders.
* Existing frameworks are less effective when uncertainty arises from conflicting interpretations rather than incomplete information, particularly in multi-disciplinary or contested environments.
* No single definition adequately serves scientific inquiry, economic analysis, legal decision-making, and engineering practice simultaneously without qualification.
 
These limitations do not invalidate the definitions. Rather, they define the conditions under which the definitions are intended to be applied and interpreted.
 
==Working definitions==
For the purposes of civil engineering practice, the following working definitions are proposed.
 
'''Uncertainty''' 
Uncertainty is the condition arising from incomplete, inconsistent, or imperfect knowledge about physical, economic, or social phenomena relevant to decision-making. It reflects both a lack of information and an awareness of that lack, and it may arise from epistemic limitations, inherent variability, or behavioral factors.
 
Uncertainty exists on a continuum ranging from near ignorance to highly constrained and bounded conditions and is amenable to reduction, but not elimination, through disciplined inquiry, modeling, and experience.
 
'''Risk''' 
Risk is a bounded subset of uncertainty associated with the potential for material consequences when acting or choosing in the face of uncertainty. A condition of uncertainty constitutes a risk when it can be partitioned into identifiable events, conditions, or sequences of actions for which the likelihood of occurrence and the severity of consequences can be meaningfully characterized.
 
Risk retains an irreducible probabilistic element and exists only where uncertainty has been sufficiently structured to support prioritization, comparison, and decision-making.
 
'''Hazard''' 
A hazard is a source or condition with the inherent potential to cause harm or loss. A hazard becomes a risk when exposure, vulnerability, and uncertainty regarding occurrence or consequence are present and when those elements can be bounded and analyzed.
 
==Beneficial outcomes of structured uncertainty and risk frameworks==
Applying structured definitions of uncertainty and risk in civil engineering practice yields several practical benefits:
 
* Improved decision-making through explicit recognition of knowledge limitations and sources of error.
* Enhanced ability to prioritize actions by distinguishing bounded, material risks from broader background uncertainty.
* Greater transparency in communicating assumptions, models, and judgments to stakeholders, regulators, and the public.
* More effective allocation of resources toward uncertainty reduction efforts with the greatest potential impact.
* Increased consistency in integrating technical, economic, legal, and behavioral considerations across project phases.
* Stronger professional accountability through explicit articulation of the basis for decisions made under uncertainty.
 
These outcomes do not depend on eliminating uncertainty, but on managing it explicitly and coherently.


==Limitations of the definition==
...
==Working definition==
...
==Beneficial outcomes==
...
==See also==
==See also==
Project definition 
Wiki articles on the project.
Project life cycle and phase models 
Project delivery methods 
Technical outcomes for civil engineering: risk and uncertainty 


[[#top|Top of current page]]
[[#top|Top of current page]]
==Notes==
==Notes==
<references group="note" />
<references group="note" />
<li> Implicit in this definition of uncertainty as a "state of' is ... </li>
: " ... a conceptualization of uncertainty as a subjective, cognitive experience of people--a state of mind rather than a feature of the objective world. Furthermore, the defining feature of this state appears to be a lack of knowledge about some aspect of reality. Importantly, however, the concept of uncertainty also implies a subjective consciousness or awareness of one's lack of knowledge, without which one could not feel uncertain; '''uncertainty is a form of "meta-cognition" ... ( or alternatively, its main component, meta-knowledge) ... -a knowing about knowing.'''" (Han, 2011, op. cit., Emphasis added)
</ol>
<ol start="5">
<li> Cox wanted his system to satisfy the following conditions:</li>
: Divisibility and comparability- The plausibility of a statement is a real number and depends on the information we have related to the statement.
: Common sense - Plausibilities should vary sensibly with the assessment of plausibilities in the model.
: Consistency - If the plausibility of a statement can be derived in many ways, all the results must be equal.
Cox's theorem has come to be used as one of the justifications for the use of Bayesian probability theory. (For example, in Jaynes Jayne, Probability Theory: The Logic of Science, Cambridge University Press (2003). -preprint version (1996) at http://omega.albany.edu:8008/JaynesBook.html; Chapters 1 to 3 of published version at http://bayes.wustl.edu/etj/prob/book.pdf
</ol>
<ol start="6">
<li> The utility of existing taxonomies of uncertainty in civil engineering and, by extension, "risk" has been unsatisfactory for this very reason. This is particularly true in cases where the source of the uncertainty is conflicting versus incomplete information. See Regan, et. al.,"A taxonomy and treatment of uncertainty for ecology and conservation biology" (2002)
for a survey of scientific taxonomies for uncertainty.</li>
<li> Regan et al. argue that " ... genuine examples of this kind of uncertainty are hard to find. Even classic cases of random experiments like coin tosses and the throwing of dice are deterministic; it is just that we do not have enough information about the dynamic processes and initial conditions to make any sensible estimates about the outcomes. Such processes are, for all intents and purposes, inherently random, but they are not genuinely inherently random. For similar reasons, complex systems such as ecosystems and weather patterns are unlikely to be inherently random. Similarly, chaotic systems are entirely deterministic. They are unpredictable because the deterministic processes generating them and the relevant initial conditions are hard
to fully specify (see Stewart 1989, Sugihara et al. 1990)." (Regan (2002) </li>
<li> The CEBoK uses the phrase "uncertainty and risk" twice in reference to scheduling (Section 6.5,2) and cost estimating (Section 7.2,2) as well as reversing the two (Risk and Uncertainty) also in two places in discussing project life cycle (both in Section 2.4.1) </li>
</ol>


# Uncertainty as meta-knowledge
==References==
Implicit in the definition of uncertainty as a “state” is its characterization as a subjective cognitive condition rather than a purely objective feature of the world. Uncertainty involves awareness of incomplete knowledge and therefore functions as a form of meta-knowledge, or knowing about knowing.
<references />
 
# Probability and coherence
Cox’s theorem establishes conditions under which degrees of belief may be represented coherently as probability measures. These conditions include comparability, consistency, and alignment with common sense reasoning. The theorem provides one justification for Bayesian probability as a framework for reasoning under uncertainty.
 
# Limits of existing taxonomies
The utility of many existing uncertainty taxonomies in civil engineering practice has been limited, particularly where uncertainty arises from conflicting interpretations rather than incomplete data. Surveys of scientific taxonomies demonstrate both the diversity of approaches and the difficulty of producing exhaustive classification schemes.
 
# Determinism and apparent randomness
Arguments that aleatory uncertainty reflects inherent randomness remain contested. Many processes treated as random may be deterministic but practically unpredictable due to sensitivity to initial conditions and incomplete information.
 
# Usage in professional bodies
Professional frameworks differ in their treatment of uncertainty and risk. In some bodies of knowledge, the terms are used interchangeably or inconsistently, reflecting differing disciplinary priorities rather than conceptual agreement.

Latest revision as of 15:01, 10 August 2026

Restoration note (August 2026). This article restores the site's native revision of 24 November 2024 (revision 219). The 20 January 2026 rewrite remains available in the revision history. A proposed applied extension is under review at Civil Engineering Project Risk Taxonomy.

Life is short and the art long; the occasion instant, experiment perilous, decision difficult. (Hippocrates as quoted in Fox,)

See also Project Definition , Project Life Cycle and Phase Models , Project Delivery Methods
See also Technical Outcomes for Civil Engineering:Risk and Uncertainty

Basic Considerations

As human beings, ... being alive means seeking opportunities and taking risks. As knowledge professionals living in the 21st century, this means coping with an increasingly complex number of uncertainties for humans living in this environment. We seek to understand better how these uncertainties can be characterized and managed. The essence of this article and the experience for engineers in general and civil engineers in particular is that manageable uncertainty is, by definition, termed risk, and its kindred cousin is termed hazard. This causes us to experience the

" ... human dread of and fascination for risk and the increasingly important role of risk analysis within societies ... " [1] (Ibid.)

and, by extension, civil engineering. McDaniels et al. argue that risk management has been fundamental to our social and governance development for the past 10,000 years. The scale and shape of the uncertainties faced in this period shaped the societies that have developed today. The central thrust of this effort over the centuries has been to reshape and re-frame our understanding and conception of uncertainty from one of complete unknowing and simple acceptance as our fate in life to one of management (cf "Against the Gods" concept in Bernstein's book [2].

All the knowledge professions and disciplines have struggled with managing uncertainty, for it is impossible to manage unbounded uncertainty. [note 1]

As outlined below, professions such as civil engineering have successfully acted in the face of uncertainty. It lies in the profession's ability to reduce a wide variety of uncertainties into increasingly smaller and crucially bounded subsets that can be managed. These are called 'risks. More recently, this process has evolved, and individual disciplines such as Civil Engineering (CE) have developed their knowledge and models to perform risk analysis. Risk is also taught as a distinct discipline and specialty practice within civil engineering. Still, it has some unique features that set it apart from other more classical practices within CE. As such, it is one of the first of some very specialized CE practices that use knowledge about civil engineering knowledge, or meta-knowledge. Other examples of civil engineering metaknowledge are project controls and quality controls.

Semantic, Epistemic and Logical frameworks

The semantic, epistemic, and logical frameworks for uncertainty and risk have several dimensions and layers of logical frameworks. The semantics problems include interchangeable usages for risk and uncertainty and hazard, uncertain and imperfect, and a lack of definitional material or context. The semantical scheme for this article will be to proceed from the distinction between certainty and uncertainty through marginal refinements and reductions of uncertainty up to the point of causal uncertainties. Beyond this point of semantics will be the logic frameworks or the subject of taxonomies of professional knowledge. First, it is about simple, testable phenomena, and then, it moves on to complex taxonomy schemes for artificially constructed phenomena or engineering projects. [note 2]

Semantics framework

Certainty and Uncertainty

There is no such thing as absolute certainty, but there is assurance sufficient for the purposes of human life. (John Stuart Mill)
If you tried to doubt everything, you would not get as far as doubting anything. The game of doubting itself presupposes certainty. (Wittgenstein # 115 from On Certainty)
It is important to note that the references to epistemic or epidemiological knowledge in this article are assumed to relate to three forms of knowledge, namely:

Certainty has been defined as "an epistemic property" of knowledge in all its forms and the state of our beliefs about that knowledge. [3] Certainty about any belief about knowledge implies that it is not subject to doubt or skepticism. This immunity to criticism can be dogmatically based, emphasizing the importance of a propositional-based sense of truth over experiential, sensory perceptions. [4]

The demarcation line between dogmatic and non-dogmatic beliefs lies in the presence and recognition of specific criteria and information that would make the believer change their beliefs.

An empirical framework of testability and falsification is required to recognize this and limit dogmatism. For example, one could argue that people would change their minds if God asked them to. Similarly, one could construct a concept of epistemic as opposed to dogmatic belief certainty as the ability to know anything that one chooses to know and can be known or inherent omniscience.

A second kind of certainty is epistemic, when conviction reflects the highest possible support for a belief. In this sense, knowledge is separate from beliefs, although someone may have beliefs about a property, such as certainty of knowledge. Logically, it has been shown that there will be unprovable statements within the system for any such knowledge system. Secondly, the knowledge system cannot demonstrate its own consistency. (Gödel's incompleteness theorems)

Certainty, in real life, is useless or often damaging (the idea is that "total security from error" is impossible in practice, and a complete "lack of doubt" is undesirable) ([Physicist Carlo Rovelli])

Uncertainty, on the other hand, arises immediately in the slightest amount of doubt or criticism. [note 3] Implicit in this definition of uncertainty as a “state of” is ... "...a conceptualization of uncertainty as a subjective, cognitive experience of people—a state of mind rather than a feature of the objective world. Furthermore, the defining feature of this state appears to be a lack of knowledge about some aspect of reality. Importantly, however, the concept of uncertainty also implies a subjective consciousness or awareness of one’s lack of knowledge, without which one could not feel uncertain; uncertainty is a form of “meta-cognition” ...(or its main component, meta-knowledge)... —a knowing about knowing." (Han, 2011, op. cit., Emphasis added) Similarly, uncertainty could be defined as "...any departure from the unachievable goal of complete determinism." [5] Reasoning under uncertainty is very different than performing the same under certainty. In reasoning under certainty, one has complete knowledge and deduces without doubt and equally important, without limitation, thereby concluding free from error. Reasoning under uncertainty, one works in a state of incomplete, inconsistent, and limited knowledge; doubts cloud any statements or assertions and thereby taint any deductions/inferences resulting in the potential for error. [note 4]

Knowledge professions reason in a state of incomplete, inconsistent and limited knowledge with doubts that cloud any statements or assertions and taint any deductions/inferences resulting in the potential for error.
It is also important to note the semantical and logical correlation between 'reasoning under uncertainty' or 'acting in the face of uncertainty' with the 'potential for' or 'presence of' error. The presence of uncertainty is invariably linked to the potential presence of error. The contingent nature of uncertainty logically implies the contingent nature of error.
Knowledge Professions use error as a proxy for uncertainty such that within discipline knowledge frameworks, uncertainty can be managed. The rationale for this belief is that error can be reliably described, quantified, explained, and ultimately reduced in ways that uncertainty cannot.

Uncertainty implies a range of variation that is impossible in certainty. Concepts and definitions of uncertainty are unbounded and vast but start from the point of complete and total ignorance. In describing uncertainty, statements can range from complete ignorance to relatively high degrees of belief that there is less potential for error in our reasoning or action. The latter is based upon confidence in justified knowledge, favorable past experience, and reliable parameters/models. One can't make that statement about ranges in certainty. If certainty, by definition, precludes doubt of any type or nature, then how could that be graduated to any degree?
Uncertainty, on the other hand, can be reduced through disciplined efforts to acquire knowledge. In short, we can reduce or even manage uncertainty (to a degree); how can certainty be improved? Are there higher degrees of perfection? The answer is no. We reason from an uncertain starting point. Yet this effort presumes, as Mill and Wittgenstein postulated, that we can develop or acquire an increasing degree of belief or conviction that there is less potential for error in our reasoning or action. This position assumes that some way exists to identify what a lesser degree of uncertainty would look like.

Knowledge professions acquire an increasing belief or conviction that there is less potential for error in their reasoning or action based on justified knowledge, favorable past experience, and reliable parameters/models.

Uncertainty is, in some form, amenable to description and explanation through observation and analysis. It is explainable and predictable to such a degree that it interests professionals such as scientists and engineers. Professional knowledge of this type has explanatory or predictive power, albeit limited in scope and application to relevant subjects such as physical objects or phenomena and functionality.

The very act of reducing the scope of uncertainty to a limited set of phenomena implies choice and, ultimately, the decision to act in the face of such uncertainty, but acting or judging in this manner adds more value than doing the same under relative ignorance.

Uncertainty, as described above, implies a hybrid nature. Examples of this are economic or decision-theoretic applications. In economics, perfect information allows one within the limiting framework of perfect competition in economic games to make decisions with 'perfect knowledge.' The crucial difference here is the distinction between 'perfection,' broadly, a state of completeness and lawlessness, and 'perfect, which can be thought of as an analytical limit that is approachable but can never be attained. Arbitrarily delimiting the realm of knowledge into defined, finite boundaries allows the simulated production of perfect choice, assumed crucially, to be free from error. The hybrid nature of this form of 'simulated' certainty produced within boundaries defined by assumptions and, therefore, clouded by doubt is itself a form of uncertainty. The importance of this is the semantical and logical association that exists between certainty and perfection versus the hybrid concept of a perfect anything, whether knowledge, infraction, competition, etc., or in the case of engineering, elastic, permeable, conductive, etc., being contained within an admittedly imperfect matrix of uncertainty.

Simply put, a finite, heavily bounded piece of uncertain knowledge can be improved through the simulated use of assumedly perfect information, but the perfection of knowledge cannot be attained or simulated.

Engineering and Economics, for example, simulate finite elements of perfect knowledge or information, heavily bounded with assumptions and a range of applications. By doing so, these professions reduce the bounds and variability of uncertainty and thereby manage it. Using these hybrid models to acquire knowledge takes place in an economy (regulated or institutional) and environment (transparent and structured), which puts pressure on the various professions to recognize and use qualitative and quantitative knowledge better to reduce uncertainties in their activities. The challenges in this reflect the nature of the profession's or discipline's knowledge (e.g., scientific, engineering, or medical), the policies and structure of the relevant professional knowledge bodies, process objectives, constraints, and "the elusive demands of politics." [6] One common theme runs through all of these efforts to address the presence of uncertainty in professional activities.

"The available scientific information upon which a decision must be made is almost always a mixture of engineering knowledge and uncertainty. Regardless of the information or methodology, there is the potential for error. This is true regardless of the relevant science, whether archaeology or aeronautics, economics or engineering, pharmacology or toxicology or epidemiology. Achieving the best social decisions requires not only understanding and using what we know but also appreciating and weighing the extent of our uncertainty. In making the best use of ... information in ... decision-making, it is still true that the beginning of wisdom is knowing what it is we do not know." (Vern, Op. cit., Reformatted and engineering substituted for scientific)

Driven by practical objectives and benefiting from past experience, knowledge professions such as engineering start by reasoning from uncertainty to develop explanations, calculate, and make predictions. This professional knowledge converges on but never reaches certainty, producing a "legitimacy" from the fruitfulness of its use. [7]
Top of current page

Bias and Uncertainty

Up to this point, the concept of error, as outlined in uncertainty, could easily be simulated by a truly random variable. There should be no detectable differences around the unseen or specified statistical mean. However, several instances in experience point to a tendency towards one extreme or a pattern of error, a collective that is in itself an error of errors, namely bias.

Arguably, this could be part of the choice uncertainty discussion below, but it makes more sense to be looked at on its own. Acting in the face of uncertainty is an exercise of personal knowledge or experience. Whether using professional knowledge or individual experience, the potential is there to make a series of choices that, in some instances, make errors more likely than they would be if considered in the context of a statistical analysis.

This tendency for an individual to make the same error in a predictable or repeatable manner is termed bias. Personal experience, beliefs, knowledge, data, and models all have inherent built-in factors, errors, or defects that create predictable error patterns when applied in decision-making. Walker (1998) argues implicitly that such bias can also be considered systemic error. This type of uncertainty is difficult to identify except on theoretical grounds when the magnitude and direction of the bias are known. Most of these biases, whether systemic or knowledge-based, individual or practice-based, require disciplined efforts to "validate" such methods, models, and judgments at all layers while bounding the uncertainty.

This is the challenge to professional knowledge that must be overcome, namely, developing and validating models and methods for managing bounded uncertainty that minimize this tendency towards repeatable groups of error or bias. Therefore, from this point forward, the discussion will refer to 'uncertainty and its proxies, error, and bias.'

Propagating Error and Uncertainty

Partitioning uncertainty and its proxies, error, and bias into logically distinct subsets involves or is associated with multiple-step execution or choice frameworks. Combining those measurements or choices into single parameters or choices involves, in some cases, assembling the data/information in a unique or limited range of sequences. This implies that associated errors in observing, calculating, or choosing will have unequal impacts or consequences depending on where in the chain the error occurs. Also implied in this is the possibility that subsequent errors will be causally linked to some degree. (In statistical practice, this depends upon whether the errors are independent of each other or correlated, specifically, co-variant.)

Professions develop knowledge of how uncertainty and its proxies, error, and bias propagate through an ordered and normative series of observations or choices. This allows the profession to prioritize error and bias reduction to achieve an optimized reduction of uncertainty.

Top of current page

Cognition, Metacognition and Uncertainty

The concept of choice and the resultant error in uncertainty can be further delimited depending on the role of cognition, meta-cognition, and independent external elements. The rationale for this argument is that such choice activity in the face of uncertainty is a conscious, cognitive act.

An argument could be made that such cognition is a prerequisite for exercising choice and introducing error, as presented and discussed above. The counterfactual to this argument is the example of uninformed choice. Choices introduce as much as errors or more as informed choices could be made. (???) Choice, in this sense, is indifferent to knowledge. Purposeful choice in an environment of objectives requires knowledge, method, and experience, but uninformed, speculative choice does not.

" Cognition is the set of all mental abilities and processes related to knowledge, attention, memory and working memory, judgment and evaluation, reasoning and "computation," problem-solving and decision making, comprehension and production of language, etc. Human cognition is conscious and unconscious, concrete or abstract, as well as intuitive (like knowledge of a language) and conceptual (like a model of a language). Cognitive processes use existing knowledge and generate new knowledge." (Wikipedia)
"Metacognition is "cognition about cognition", or "knowing about knowing" and can take many forms. It includes knowledge about when and how to use particular strategies for learning or problem-solving. There are generally two aspects of metacognition: knowledge about cognition and regulation of cognition."

Some types of metacognition knowledge are:

Person knowledge (declarative knowledge), which is understanding one's own capabilities.
Task knowledge (procedural knowledge), which is how one perceives the difficulty of a task, which is the content, length, and type of assignment.
Strategic knowledge (conditional knowledge) is one's capability to use strategies to learn information. (Accessed at Wikipedia)

Like metacognitive knowledge, metacognitive regulation or "cognitive control" contains three essential skills.

Planning: refers to the appropriate selection of strategies and the correct allocation of resources that affect task performance.
Monitoring: refers to one's awareness of comprehension and task performance.
Evaluating: refers to appraising the final product of a task and the efficiency at which the task was performed. This can include re-evaluating strategies that were used. (Accessed at Wikipedia)

Nothing has been said up to this point that limits this structure to an individual, or a collective, or two entities making cognitive choices that are incompatible or inconsistent to varying degrees. Interpretations of this scheme include an individual professional exercising judgment in a decision that, in turn, relies upon the collective judgment and decision of the discipline as an underlying basis versus the decision of another individual to oppose/protest or otherwise contest that decision. Thus, the framework of cognitive/meta-cognitive applies to individuals, collectives, and controversies. In economic theory, this could be recast to cognitive/meta-cognitive roles in the theory of rational choice, economics of regulatory practice, and game theory.

By solving useful problems in the face of inherent uncertainty, discipline-specific frameworks of cognitive/meta-cognitive activity apply to individuals, collectives, and controversies. In economic theory, this could be recast to cognitive/meta-cognitive roles in the theory of rational choice, the economics of regulatory practice, and game theory.

Top of current page

Probability and Uncertainty

Probability is a coherent approach to uncertainty in the physical and mathematics or "classical" domains such as engineering. [8] and is the "...is certainly the best-known and most widely used formalism for quantifying uncertainty.[9] Cox’s theorem ("Any measure of belief is isomorphic (but not necessarily equal) to a probability measure") is a well-known argument for the validity of that argument. [note 5]

Another writer, Knight (1921,1956), presented the following taxonomy of probabilities: [10]

Classical 'a priori' probability: As an idealized model, numerical probabilities are computed based on generalized principles of assigning equal likelihoods and mutually exhaustive possible outcomes (Runde, 1998) to all set members. Such probabilities are assigned to "...outcomes based on a judgment of indifference between those outcomes, that is, based on the absence of any evidence of real influences in play that may render any one outcome more or less probable than any other." (Runde, op. cit.) This builds upon Knights's concept of an 'absolutely homogeneous classification of instances that are completely identical except for indeterminate factors. This judgment of probability or logical probability is on the same logical plane as the propositions of mathematics and ultimately inductions from experience.'(Knight, 1956, pg.225)
Bayesian 'a priori' probability: In contrast to interpreting probability as the "frequency" or "propensity" of some phenomenon, Bayesian probability is a quantity that we assign to represent a state of knowledge or a state of belief. In this view, probability is assigned to a hypothesis, often using the basis of past or prior experience. In contrast, under the frequentist view, a hypothesis is typically tested without being assigned a probability based on prior experience. The Bayesian interpretation of probability can be seen as an extension of propositional logic that enables reasoning with hypotheses, i.e., propositions whose truth or falsity is uncertain. Bayesian probability belongs to the category of evidential probabilities; to evaluate the probability of a hypothesis, the Bayesian probabilist specifies some prior probability, which is then updated in the light of new, relevant data (evidence). The Bayesian interpretation provides a standard set of procedures and formulae to perform this calculation. [11]
Statistical or 'a posterior probability: Empirical evaluation of the frequency of association between predicates, not analyzable into varying combinations of equally probable or logical, 'a priori' alternatives. Knight argued that any "high degree of confidence" that the judgment that experience will remain valid for future predictions is "...still based on an 'a priori" judgment of indeterminateness." (Knight, Op. Cit.) Knight's argument to support this is what will be discussed further below that first, "...the impossibility of eliminating all factors not really indeterminate; and, second, the impossibility of enumerating the equally probable alternatives involved and determining their mode of combination so as to evaluate the probability by a priori calculation." (Knight, Op. Cit.) Knight noted that the main difference between this form and that of logical or inductive probability was the presence of empirical information, which allowed the analyst to identify propensity and direction in the observed phenomena. In this case, 'a priori' probability values may be derived from first principles and "statistical probabilities are determined a posteriori by the empirical method of counting instances." (Runde [1998] quoting Knight, op. cit.)
Estimates: The distinction here is that there is no valid basis ('a priori' or 'a posteriori') for any classifying phenomena. For Knight, this form of probability presented the greatest logical difficulties of all ... but its distinction from the other types must be emphasized, and some of its complicated relations indicated..." (pp. 224-5, emphasis in the original)

Knight's concept of probability can be viewed as "..a continuum of probability situations, depending on the degree of homogeneity of the 'instances' in question" [12]; i.e. going from a logically distinct but equally likely set of elements to a unique set with one member with statistical frequency in the middle. Knight's main motivation for distinguishing between a priori probability and statistical probability underscores his opinion that "(i) the 'mathematical or a priori type of probability is practically never met with in business, while the second is extremely common'; and (ii) 'the statistical treatment never gives closely accurate quantitative results' (Runde quoting Knight pp. 215-16). Runde argues that Knight couldn't conceive of (empirically tabulated) occurrences that are used in daily commerce classes of instances that we have to make do within the course of everyday economic life could be divided into subclasses of instances that are sufficiently homogeneous to permit the determination of what he calls 'real' probability (p. 217).

In modeling degrees of uncertainty, any measure of belief is isomorphic but not necessarily equal to a probability or statistics measure.

Top of current page

Explanation, Prediction and Uncertainty

It should be clear that the general notion of uncertainty synonymous with complete ignorance must be bounded as part of a scheme to produce a useful concept of uncertainty in professional practice such as civil engineering.

The first principle that must be introduced is that such uncertainty must be bounded by reliable and valuable knowledge gained from past experience combined with analytical and computational capabilities to address an immediate and real problem of interest. This could be viewed as the economic interest argument. Only uncertainties associated with physical phenomena and economic scarcity will be addressed.
The second principle is that the knowledge model is capable of producing statements or assertions in the form of hypotheses that themselves are testable. Testability, in this sense, is defined as the property applying to an empirical hypothesis and involves two components:
The logical property that is variously described as contingency, defeasibility, or falsifiability, which means that counterexamples to the hypothesis are logically possible. Contrast this to a logical tautology, which is always true that is true in every possible interpretation. The practical feasibility of observing a reproducible series of such counterexamples if they do exist. In short, a hypothesis is testable if there is some real, non-zero expectation of deciding whether it is true or false of verifiable, reproducible experience. Upon this property of its constituent hypotheses rests the ability to decide whether a theory can be supported or falsified by actual experience data. (Source Wikipedia.)

Knowledge models must be capable of producing expressions that can explain phenomena (physical, economic, and social) that meet the testability criteria described above in 'reasoning under uncertainty' or 'in the face of uncertainty' with the 'potential for' or 'presence of' error and bias.

Variability and Aleatory Uncertainty

The discussion up to this point has focused on uncertainty associated with various forms of knowledge referred to as epistemic uncertainty. Acting in the face of epistemic uncertainty introduces choice uncertainty (discussed below) and results in the production of explanations and predictions. It is implied that there will be testable hypotheses in the form of outcomes of interest to the knowledge professions. Inherent in nature is a variation of results, which may appear to uncertain but isn't. Observations of phenomena will not be the same, and part of the experimental process is to narrow those results down to within an acceptable level of tolerance. Statistical measures seek to identify underlying and unobserved measures of central tendency. These parameters are not directly observed but are derived to a degree of confidence. In some cases, variation around a mean or within a statistical range may be perfectly acceptable to the knowledge profession. Examples of this are in the physical sciences and medicine. In Engineering and, to a lesser extent, economics, the process or phenomenon may be required to be more controlled to a narrower range than what a natural or "unmanaged" amount of variation would allow. Several courses of action present themselves.

The first would be to ignore the aleatory phenomenon and choice, which is rejected outright.
The second would be to assume that, in effect, such variation is itself a form of minimally managed uncertainty and treat it the same as epistemic uncertainty. This is not a desirable outcome as reducing Aleatory error and bias requires
A third approach would be to acknowledge that process variation is, in some forms, manageable. This means making choices and acting in a way that presumes that the natural occurrence of error can be reduced, or more importantly, bias can be reduced. There is ample precedent for the third approach in civil engineering design and project management. In this sense, the argument is made that the aleatory response to managed efforts results in an elastic variation range. Presumably, an effective management effort either "shifts" the central tendency of the process results or reduces the variation range of occurrence or some other population parameter. Choosing to act and accept that narrower range rather than the broader natural variation may result in an outcome that, while well within the bounds of the expected variation, is outside the arbitrary control limits established by the choice and action. While this phenomenon mimics the broader uncertainty and its proxy error, it is not an error. The information on the variation was known, and the ability to produce narrower results was an error, albeit a pseudo-error, when compared to the broader classes of uncertainty discussed above, such as total ignorance.
Looking at uncertainty using this third approach means that the error in choosing a new target parameter for this process may contain epistemic errors (our knowledge of the phenomenon may be erroneous, or the model flawed), aleatory uncertainties as discussed, or, more importantly, choice error or bias in thinking that we can move the process results to meet the requirements.
In civil engineering practice, this may mean applying professional judgment in developing partitioning schemes or allocating uncertainty between the three dimensions (Epistemic, Aleatory, and Behavioral) of uncertainty.

Lastly, raising the topic like this brings the questions of effectiveness and efficiency to the fore. Advancing knowledge models that reduce error and bias at first are largely choice models resulting in justifications and favorable experiences. At some point in the process, the knowledge profession advances explanations and predictions that require reliable mathematical or logical concepts that are reduced to models and parameters. The question of efficiency becomes important; the broader uncertainty may have been reduced, but the process is economically inefficient. The profession is urged to become more frugal or, for example, reduce the variability of the outcomes. Knowledge professions often operate under conditions that require them to acquire knowledge and reduce uncertainty effectively and efficiently. Doing so requires understanding both epistemic uncertainty, as discussed above, and statistical process variation or aleatory variation.

Knowledge professions manage and reduce uncertainty in the form of error and bias in an economically effective and efficient manner. This effort requires understanding both epistemic and aleatory uncertainty.

Top of current page

Choice and Behavioral Uncertainty

The discussion up to this point has focused on uncertainty associated with various forms of knowledge, referred to as epistemic uncertainty, as well as the inherent variations in results, or what was termed aleatory uncertainty. Acting in the face of that epistemic and aleatory uncertainty introduces yet another uncertainty into the process, namely choice uncertainty. This uncertainty reflects uncertainties associated with first-person and third-person choice. This is particularly relevant for engineering with project stakeholders.

Summary of Semantics Framework for Uncertainty

Professional disciplines have gradually re-framed their understanding of uncertainty and, thru experience and analysis, have arrived at the following meta-knowledge concepts of uncertainty:

  • Uncertainty and its proxy, error, have three components: epistemic uncertainty, aleatory uncertainty, and behavioral uncertainty.
  • Driven by practical objectives and benefiting from past experience, knowledge professions such as engineering start by reasoning from uncertainty using non-dogmatic beliefs, which recognize the existence of specific criteria and information that would make the believer change their beliefs using coherent approaches such as probability.
  • Knowledge professions develop knowledge of how uncertainty and its proxy, error, propagate through an ordered and normative series of observations or choices that meet testability criteria in 'reasoning under uncertainty' or 'in the face of uncertainty' with the 'potential for' or 'presence of' error. An error can then be described, explained, and reduced in ways that uncertainty cannot. This allows the professions to prioritize error reduction to achieve an optimized reduction of uncertainty and produce a "legitimacy" from the fruitfulness of its use.

Top of current page

Uncertainty versus Risk/Hazard

Up to this point, nothing has been said about risk or hazard. Now, risk can be defined. Simply put risk or hazard are finite, logically distinct subsets of the broader uncertainty. Risk and hazard are currently defined interchangeably. First and foremost, risk is a specific subset of general uncertainty. Any arbitrary subset of general uncertainty can be defined as a risk if it meets the following criteria:

  • Uncertainty is associated with the potential for material error when acting or choosing in the face of such uncertainty in an environment of physical, economic, and social phenomena.
  • Uncertainty and its proxy, error, can be partitioned into logically distinct subsets associated with multiple-step execution or choice frameworks in physical environments linked to a unique or limited range of sequences.
    • Subcriteria 1:Resulting errors will have varying impacts or consequences depending on where the error occurs and the degree of causal linkage or influence in the chain.
    • Subcriteria 2:Potential errors can be sequenced and prioritized to achieve an optimized reduction of error or bias and, by proxy, uncertainty over time.
  • Uncertainty and its proxies, error bias, and environments are isomorphic to coherent approaches such as probability.
  • Uncertainty and its proxies, error, and bias are isomorphic to coherent approaches such as knowledge models capable of producing expressions that can explain phenomena (physical, economic, and social) that meet the testability criteria in 'reasoning under uncertainty.'

This is a definition of general risk. There is no differentiation for engineering or economics, medicine or insurance. There is no difference between a 'good' risk consequence and a 'negative' one. Redefining general risk into simpler terms gives the following:

General Risk is a subset of general uncertainty that is associated with the potential for material errors and biases when sequentially acting or choosing in the face of such uncertainty in an environment of physical, economic, and social phenomena; isomorphic to probability measures and methods and capable of testability.

Top of current page

Logical Framework for Specific Risk Taxonomies

As noted above, at the most fundamental level, uncertainty is ".....the subjective perception of ignorance." [13] At this point in the discussion, the focus has moved from discussing uncertainty to its framed subset, risk.

Further, the discussion moves from general risk to a professional or discipline-specific risk taxonomy. Beyond this point, risk will be used in place of uncertainty.

Han et al. note that, in general, "(t) taxonomies are valuable not only in their comprehensiveness but in their coherent reduction of uncertainty to conceptually discrete elements." Uncertainty (and, by implication, risk or hazard) taxonomies offer an approach or tool to more precisely identify and define ontological uncertainty so that it can be quantified, analyzed, and communicated. Viewed this way, uncertainty is not a single, monolithic phenomenon but "...multi-dimensional with theoretically distinct domains and constructs that are potentially measurable and related to different outcomes, mechanisms of action, and management strategies." [13] Taxonomic schemes for classifying the different kinds of scientific and, by extension, engineering uncertainty require identifying the various kinds of potential error associated with descriptive scientific or engineering information and knowledge. An example of this is the following quote from a legal authority:

"I would especially stress the need for an agency to disclose the uncertainty that surrounds its determinations. And by uncertainty, I mean the agency's ignorance as well as its quantitative estimates of error." (Emphasis added)

[14] Given the necessity of acting in the face of enormous uncertainties [15], discipline taxonomies must offer a clearly coherent and probabilistic approach to uncertainty that is sufficiently general in nature, logically distinct and exhaustive in scope and "...provide decision-makers with a foundation for understanding the nature of discipline information..." [6]

Top of current page

Scientific Risk Taxonomies

The scientific method is a body of techniques for investigating phenomena in its environment, acquiring new knowledge, or correcting and integrating previous knowledge. Inherent in that process are uncertainties of many forms. Any one taxonomy of scientific uncertainty has largely been focused on statistical models used to assess and quantify sampling, errors, and parameters, although several different taxonomies are conceivable: note-24 [18]

Environment-specific, Phenomena oriented, model-centric taxonomy of uncertainties

    • Parameter uncertainty the source of which is model parameters that are inputs to the computer model (mathematical model) but whose exact values are unknown and cannot be controlled, or whose values cannot be exactly inferred by statistical methods. Subsets of this type of uncertainty include but are not limited to:
      • Experimental uncertainty is also known as observation error, which comes from the variability of experimental measurements. An example is repeating an experiment measurement several times using exactly the same settings for all inputs/variables and recording the variability. It is a subset of the larger uncertainty component, parameter uncertainty.
      • Parametric variability comes from the variability of the input variables of the phenomena model and is also a subset of the larger uncertainty component, parameter uncertainty.
    • Structural uncertainty, or model inadequacy, model bias or "systemic bias", or model discrepancy, which comes from the lack of knowledge of the underlying true state of the phenomenon or its environment. It depends on how accurately a mathematical model describes the true state of the phenomenon or what is termed "model fitness". Due to the inherent nature of uncertainty in any knowledge body (scientific or engineering), models are only an approximation to reality. Therefore, any conclusions drawn from the model can be very misleading when the underlying basis is not plausible or lacks validity. note-25 [19]]
      • What is missing in this context is any concept of output variability due to the model itself. Part of this is due to the lack of recognition of "process" in scientific investigation. The concept of the scientific method started with a single investigator, such as Galileo or Michael Faraday, working in their laboratories. It has grown into planet and solar system scale experiments such as data gathered on planetary flybys such as Mars, Pluto, and Ceres to the hunt for the Higgs Boson. Ultimately, science has become more like engineering in the scale and complexity of its investigations and theory aggregates, such as the "Unified theory" of particle physics. Subsets of this type of uncertainty include but are not limited to:
      • Algorithmic uncertainty, or numerical uncertainty, comes from numerical errors and numerical approximations per implementation of the computer model. Most models are too complicated to solve exactly. For example, the finite element method or finite difference method [may be used to approximate a solution partial differential equation, which introduces numerical errors. Other examples are numerical integration and infinite sum truncation, which are necessary approximations in numerical implementation.
      • Interpolation uncertainty comes from a lack of available data collected from computer model simulations or experimental measurements. For other input settings that don't have simulation data or experimental measurements, one must interpolate or extrapolate to predict the corresponding responses.

Top of current page

Commentary

A more comprehensive taxonomy of uncertainties that acknowledges knowledge, data, and linguistic uncertainties is:

  • Epistemic uncertainty -Epistemic uncertainty or systematic uncertainty, in contrast, reflects limitations in the current “state of knowledge” underlying models themselves, originates from competing theories or models, is not readily quantifiable, and is manifest by subjective confusion or indecision. It includes uncertainty due to measurement limitations, insufficient data, extrapolations and interpolations, and variability over time and space. Epistemic uncertainty is uncertainty about "...some determinate fact ... because of a lack of complete information. cite_note-26 [20]] Epistemic uncertainty can be classified into six main types:cite_note-27 [21]]
  • Measurement error - Measurement error is uncertainty that manifests itself as (apparently) random variation in the measurement of a quantity. Repeated measurements will vary and demonstrate classic statistical behavior.
  • Systematic error - Systematic error occurs due to bias in the measuring equipment, model, analysis, observation, or sampling procedure. It is formally defined as the difference between the true value of the quantity of interest and the value to which the mean of the results converges as sample or data sizes increase. Unlike measurement error, it is not (apparently) random, and therefore, results subject to systematic error alone do not vary about a true value. Systematic error can result from deliberate judgment to exclude (or include) data, parameters, or models that ought not to be excluded (or included).
    • "The only way to deal with systematic error is to recognize a bias in the process, model, or procedure and remove it. Systematic error, however, is notoriously difficult to recognize except on theoretical grounds. Corrections may only be applied when the magnitude and direction of the bias are known. Such corrections underlie the application of double-sampling methods in environmental science." (Regan, et. al., op. cit.)
  • Natural variation - Natural variation or underlying process variation occurs in systems that "...change (concerning time, space, or other variables) in ways that are difficult to predict...across the full range of temporal and spatial values (or other related variables)." note-28 [22]
    • This form of uncertainty is reduceable utilizing tools such as statistical process control and replication of experiments or observations.
  • Inherent randomness - randomness or aleatory uncertainty exists because the system is"...in principle, irreducible to a deterministic one (the most well-known case is described by Heisenberg’s uncertainty principle in quantum mechanics)." note-29 [23], note-30 [Note 7]
    • Even if the argument is accepted that it is unlikely that any given physical system at some level is inherently random, it is important for any taxonomy to distinguish between systems that appear random due to incomplete or inconsistent information and those that are intrinsically random. (Again, see Regan (2002)).
  • Model uncertainty - Model uncertainty occurs in the process of generating a model as a conceptual representation of a particular phenomenon to create a simplified reflection of reality. This selectivity of factors and variables creates uncertainty in at least three ways. (Regan (2002))
    • Variables and processes that are regarded as relevant often represent a trade-off between system knowledge and assumed states and model objectives;
    • Models depict observed processes using logical or mathematical constructs based on underlying theories about system states or dynamics using continuous equations to describe discrete processes.
    • Curve fitting (including interpolation and extrapolation) with mathematical expressions using model variables where inputs are discrete data points.
    • Regan (2002) argues that model uncertainty is "...notoriously difficult to quantify and impossible to eliminate ...(and)...(t)he only reliable way of determining how appropriate a model is for prediction is to perform validation studies."
    • Subjective judgment occurs due to the interpretation of scarce or error-prone data.
      • The only way to address this type of uncertainty is to "...assign a degree of belief about an event in the form of a subjective probability." (Regan (2002))
  • Linguistic uncertainty - Linguistic uncertainty, or "vagueness", is a source of uncertainty and includes uncertainties due to context dependence, ambiguity, and under-specificity. note-31 [24]], note-32 [25]]
    • Context dependence is uncertainty concerning the context in which a statement is to be understood;
    • Ambiguity occurs when words have multiple meanings, and further reduction to a single meaning is not logically possible in a given context.
    • Underspecificity occurs in the presence of "unwanted generality" or multiple interpretations, and reduction to a smaller set or even a single interpretation is not logically possible.
  • Stochastic or statistical uncertainty - Stochastic or statistical uncertainty, which is sometimes known as Aleatoric uncertainty as well as the subject of stochastic control pertains to the parameters of a risk model, originates from sampling or measurement error, and can be quantified and mathematically expressed (e.g., using confidence intervals).

Top of current page

Uncertainty Taxonomies in a Legal Environment

From a legal perspective, a definition of taxonomy is dictionary-based, such as "the systematic distinguishing, ordering, and naming of type groups within a subject field." given by Walker (op. cit.). Such legal concepts of scientific or engineering taxonomies are not required to be epistemically complete. Still, they must cover "the most significant aspects of ...(current, good discipline practices) ... and of the descriptive information commonly encountered by decision-makers" in a logically distinct manner. (Walker, 1991, p. 571) These taxonomies must be sufficient to catalog the types of uncertainty associated with descriptive assertion, including the critical subset of cause and effect assertions. This legal/decision-maker framework has presented descriptive uncertainty as having six components (Walker, 1991). Although not part of the Walker taxonomy, underlying the scheme is linguistic uncertainty, or "vagueness," as a source of uncertainty, including uncertainties due to context dependence, ambiguity, and under-specificity. note-33 [26]] Arguably, these uncertainties underlie the most basic element in the taxonomy.

  • Linguistic - or "vagueness", is a source of uncertainty and includes uncertainties due to context dependence, ambiguity, and under-specificity. (Regan, 2002)
  • Conceptual- the definition by choice and design of descriptive concepts or variables to be used as predicates where the subject of an assertion identifies what is being discussed and the predicate provides information about the topic or characterizations such as what the subject is, what the subject is doing, or what the subject is like (Wikipedia).
  • "Conceptual uncertainty, or the potential for conceptual error, arises whenever predication occurs. Whenever a concept is used to describe something, using certain concepts instead of others begins to structure how we understand the object, event, or instance under discussion. Predication or conceptualization generates useful information about things, but it also can inhibit our ability to think about those things with concepts other than those selected. The concepts used may not be the most fruitful or the best designed- either for scientific purposes or for making wise, fair, effective, and efficient decisions." (Edited for reading, Walker, 1991)
  • Similarly, choice and design of descriptive variables enhance and restrict data set membership, creating potentially incomplete, incompatible, or inconsistent data sets, "...the classification categories employed, and the relationships among those categories (nominal, ordinal or scalar)." note-34 [27]]
  • Concept uncertainty note-35 [28] like systematic error discussed above is notoriously difficult to recognize, except on theoretical grounds, and the magnitude and direction of the bias are known.

Both terms could be analogized to that of accuracy in ISO 5725 which looks at the ability of the concept or system's ability to produce results that are proximate to the "true" value or state of the phenomenon. Conceptual uncertainty and systemic bias are related to another measure of uncertainty: validity. Walker has defined validity as the ability of a concept to quantitatively describe and explain what the phenomenon objective "truly" is. Walker also ties the concepts together when he states, "Validity concerns the "accuracy" of the measurement data, not its precision." (Walker, 1998)
Additionally, conceptual uncertainty and associated validity issues could be propagated throughout this taxonomy. Every component of action and decision in the face of uncertainty raises validity issues. Walker recognized this when the author defined epistemic choice for concepts used throughout the other uncertainty components or layers.

  • Measurement uncertainty or Misclassification error- the application of the underlying concepts or variables to specific, individual cases and the uncertainty of the reliability (Walker, 1998) of the resultant data. (It is important to remember that assessment observation and measurement are used interchangeably in this analysis.) Thus, an assessment method or procedure is considered "reliable" or "precise" in the scientific terms of ISO 5715 if it repeatedly produces consistent results.
  • Measurement uncertainty is logically distinct from conceptual uncertainty, which can only occur after any conceptual uncertainty has been established. Still, misclassification can occur even when the conceptual uncertainty has been minimized. Conversely, underlying errors or errors made in measurement or classification propagate thru the reasoning chain and reduce the quality or value of the final result.
  • While uncertainties associated with quantitative measurements or assessments can be statistically evaluated and described, uncertainties related to qualitative assessments are more problematic.
    • Working through the taxonomic chain from base concept to causal explanation requires amassing and integrating qualitative information and quantitative data into input parameters for mathematical models. Developing procedures for producing consistent, repeatable sets of information from assessments that minimize conceptual error or systemic bias requires professional efforts to "validate" such methods, models, and judgments at all layers in the process. Validation as a process is something that civil engineering as a practice needs to embrace more frequently.
  • Sampling- in the classical statistics sense, is the selection of a limited subset of a larger population to use as a basis for making estimates about the population in the form of attributes, proprieties, or parameters. The resulting information would be determinative in making forecasts about future population sampling or possessing a desired amount of predictive power. The uncertainty about the ability of this information to correctly predict future samples is termed sampling error.
  • Modeling- Modeling uncertainty arises whenever a claim is made that out of a class of candidate relationships and variable pairings, one variable pairing inclusive of constants is chosen that possesses a particular or persistent mathematical relationship to another variable X. Modeling errors arise in selecting the wrong variable pair and constants or by incorrectly specifying its constants. (Walker, 1991, pg. 599)
    • Causal- In causal modeling and analysis, the relationship between causal variables is not strictly a mathematical function. Still, it makes testable predictions and explains "...how a system of variables works, why a system works the way it does, or why it makes sense to think of certain variables as a system" at all." (Walker, 1991, pg. 609)
    • Epistemic- the choice of interpretations for fundamental, logical concepts used throughout the other components or layers.

The components of this uncertainty taxonomy can combine in different ways to "...produce different aggregate uncertainties." note-36 [29]

Only the scientific and engineering professions possess the capacity to develop and validate procedures and models that combine the different kinds of qualitative note-37 [30] and quantitative information and their associated potential for error into an aggregate measure or "scalar variables" of uncertainty.note-38 [31]]

Scalar variables are quantitative variables whose categories are related by some measure of the relevant property's incremental frequency, degree, or amount. (Walker, 1991) Examples are Modulus of Elasticity, Compression stress in elastic materials, etc.

Top of current page

Economics Uncertainty Taxonomies

Like scientific concepts of uncertainty, economics is environment-specific (in this case, read sector of economy or markets), phenomenon-oriented (in this case, read human activity and manufactured phenomena such as firms and markets guided by human judgment and decision), and model-centric.

Economics is not interested in all forms of uncertainty, only specific, meaningful subsets possessing casual connections with material impacts, often labeled as 'risks'.

One of its earlier writers (Knight, 1921, 1948, 1957) attempted to define "uncertainty" as the presence of "defects of managerial knowledge" (or knightian uncertainty and thus risk centric) as risk that is immeasurable, not possible to calculate.(Wikipedia) Risk in this sense was defined as "the ordinary risks of business activity which can ... be reduced... by applying the insurance principle." Knight does acknowledge that risk is a specific and unambiguous subset of uncertainty. (Risk, Uncertainty and Profit, 1957, pg. 19) For Knight, measuring uncertainty meant measuring the probability of its occurrence and the severity of its consequences or economic impact, e.g., measurable risk of loss versus unmeasurable uncertainty consequences, which Knight referred to as "the imperfection of knowledge". (Risk, Uncertainty and Profit, 1957, pg. 197) One of Knight's many contributions to this analysis was recognizing information and knowledge's role in economic activity.

"(W)e are concerned only to emphasize the fact that knowledge is in a sense variable in degree and that the practical problem may relate to the degree of knowledge rather than to its presence or absence in toto. We live only by knowing something about the future, while the problems of life, or conduct at least, arise from knowing so little. This is as true of business as of other spheres of activity. The situation's essence is action according to opinion, of greater or less foundation and value, neither entire ignorance nor complete and perfect information, but partial knowledge. If we are to understand the workings of the economic system, we must examine the meaning and significance of uncertainty; and to this end, some inquiry into the nature and function of knowledge itself is necessary." (Knight, pg. 199) Emphasis added

Knight also reinforced the difficulties in classifying uncertainties when he analyzed life insurance. In this case, accidental death was an uncertain phenomenon compared to sickness and accident, where an "...objective description and classification of cases was impossible..." (Knight, pg. 248) Another factor that made uncertainties ineligible as risks and, therefore, uninsurable because they were unclassifiable was the exercise of judgment in making decisions by the businessman. (Knight, pg. 251) This is a simple classification of economic uncertainty and, as an idealization, is philosophically controversial. note-39 [32]

  • Uncertainty and information about the economic environment are distinct from uncertainty about others’ behavior or choices.
  • Risk as a specific subset of uncertainty implies that "...all possible acts are known, all possible outcomes arising from each act are known, and it is possible to assign probabilities to each act." note-40 [33]

Like the economic theory of the firm, an economic theory of uncertainty seeks to explain and predict the nature of a specific subset of uncertainty (in this case, risk relating to physical phenomena and human activity), including its behavior, structure, and relationship to the universal uncertainty of physical phenomena. In this sense, uncertainty, like firms and markets, can establish price equilibriums under the right circumstances different from those that might have occurred in either of the other two. Such a theory of uncertainty offers a partitioning scheme that decomposes uncertainty into distinct and meaningful subsets, of which risk is a significant one. It also explains how the presence and variability of knowledge cause or " drive" economic consequences. Unlike physical phenomena, economic activity creates artificial objects such as products, firms, mediums of exchange, markets, economies, and knowledge about those activities. The economics of uncertainty exists as an alternative to "certainty" models that assume away imperfect knowledge and unknown choice/judgment preferences when it is more efficient for economic decision-making. This also allows the introduction of the logical concept of "hazard" versus "risk". Frank used hazard extensively in Risk, Uncertainty, and Profit, but not to the extent that one could say it was interchangeable. An example of this is in the term "Moral hazard," where a firm could engage in "riskier" and potentially "uninsurable" behavior if the information were transparent, and, therefore, insurance coverage of losses is limited. note-41 [34]], note-42 [35]]

Top of current page

Uncertainty and Risk in Policy and Regulatory Environment

"Hume's 'just reasoner', when faced with a difficult public policy decision in current times, would probably commission a risk analysis. But how could they incorporate 'a degree of doubt, caution, and modesty?" note-43 [36]

The problem of "decision-making in the face of uncertainty" is how to regulate based on incomplete information that has the potential to be materially inaccurate. A contextual assumption is that we need to evaluate decision rules for dealing with uncertainty. As a social enterprise, risk regulation, whatever its substantive objectives, should be as effective, efficient, and equitable as practically possible. These "three E's" form a set of "process objectives" or "meta-goals." From the uncertainty standpoint, causal information can be usefully divided into two major categories: information about groups and information about individuals.

Each category, group, and individual has its distinctive types of inherent uncertainty. These are logically distinct, generally independent, and cumulative, contributing to (?????)

Top of current page

Engineering Uncertainty Taxonomies

Like scientific and economic concepts of uncertainty, engineering is environment-specific, phenomena-oriented, model-centric, external choice, and driven by decision-making in the face of uncertainty. Like economics and unlike science, engineering is not interested in all forms of uncertainty, only those with determinable and material consequences. Like economics, engineering conceives risk as a specific and unambiguous subset of uncertainty determined by measuring the probability of its occurrence and the severity of its consequences or economic impact, e.g., measurable risk of loss versus unmeasurable uncertainty consequences. Also, engineering recognizes the role information and, by extension, knowledge plays in constructing the built environment. note-44 [37]] Like economics, engineering differs from economics and scientific uncertainty in its interest in behavioral uncertainty.

  • "Behavioral or interaction uncertainty is how individuals or organizations act or interact. Behavioral uncertainty arises from four sources: design uncertainty, requirement uncertainty, volitional uncertainty, and human errors." note-45 [38]]
    • A design uncertainty is a choice among alternatives over which an individual or group of individuals exercises direct control but has not yet decided upon.
    • Requirement uncertainty includes parameters of interest to and determined by the stakeholder, independent of the engineer or designer.
    • Volitional uncertainty is uncertainty about what the subject him/herself will decide. Other people’s future actions and conduct are not entirely predictable, particularly when dealing with other organizations.
    • Human errors occur during the development of a system or project due to blunders or mistakes by an individual or individuals.

Top of current page

Practice Frameworks for Uncertainty and Risk in Civil Engineering Practice

PMIBoK

PMI does not define uncertainty, but the PMI Body of Knowledge uses the term in 45 places (uncertainty) and as describing properties in 8 places (uncertainties). [See Note 8] PMI does define "risk" and uses the term over 1,300 times in the same document. In its glossary, PMI also defines terms such as "threat" and "opportunity" but not events.[391 The BoK contextually defines uncertainty when it states that project risk has its origins in the uncertainty present in all projects. (Op. Cit., pg 309)
Uncertainty is contextually defined and taken as having the property of affecting project execution and the ability to meet stakeholder expectations. Uncertainty is more than the sum of all individual risks (known and unknown). The nature of this uncertainty is not defined, only its capacity to affect something else or its properties.
Risk is defined as " ... an uncertain event or condition that, if it occurs, has a positive or negative effect on one or more project objectives." (Ibid.) Beyond this formal definition, PMI adds context when, in its risk management section (Sec. 11 ), the BoK states that risk is a caused event or condition with multiple causes and impacts. The BoK even offers specific techniques for mapping cause-and-effect relationships and influence diagrams. (Sec. 11.2.2.5) Not as evident but equally important is the recognition that not only is risk caused but the impact is "triggered". The risk trigger is an event or situation that signals that it is about to occur (Glossary, pg. 566). Risk conditions are factors that affect or otherwise contribute to risk, such as project stakeholders. Risk implicitly retains some residual element of probability in it, or a value of less than 1.0 with risk that approaches a level of near certainty is termed "issues" or "realized risk" .(Op. Cit., pg 309). PMI also links risk to underlying variations in project outcomes. (Ibid.) Risk is based upon data and information which can be assessed as to its quality (Sec. 11.3.2.3). This analysis looks to determine the value of the information and examines the degree to which the risk information is understood as well as its " ... accuracy, quality, reliability and integrity ... " (Ibid.) Part of that is understanding the relationship between occurrence and impact as outlined in PMl's Figure 11-10 Risk Impact Matrix and developing a model for prioritizing risk products and setting the threshold for action.

Commentary:

For defining and identifying risk, PMI notes in Sec. 11.2.2.4 that " ... Every project and its plan is conceived and developed based on a set of hypotheses, scenarios, or assumptions." Part of the risk analysis process is identifying risks to the project, such as inaccuracy, instability, inconsistency, or incompleteness of assumptions. Similarly, the quality of management plans, as well as their consistency with others and the project objectives and assumptions are 11 •• .indicators of risk in the project." (Sec. 11.2.2.1)
Similarly, the role of engineering economics in risk is embedded or implied in the PMI definition of risk when the BoK discusses risk identification as a process of assessing which risks out of the total risk exposure for the project "may affect" the project and distilling their characteristics. Embedded in this statement is the concept that not all risks can cause economic impacts (positive and negative) to the project. Also embedded is the requirement to understand risk characteristics to identify project risk (Cost and schedule). Lastly, risk identification is an iterative process of incrementing project risk documentation, much like project scope, cost, and schedule documentation.
Lastly, PMI acknowledges the complex constitution of risk aggregates or the "sum" of all risks in its material, but is it a sum? Risk information has descriptive and explanatory content. These are knowledge and meta-knowledge components. Understanding project assumptions is project-specific knowledge, but identifying risks from assumption inaccuracy, instability, inconsistency, or incompleteness requires professional or program meta-knowledge.
Uncertainty exists in all projects, but risk, a subset of uncertainty with material economic impacts, is a key meta-knowledge element for civil engineering practice.

Software Development Process- Risk Focused

The Unified Process requires the project team to focus on addressing the most critical risks early in the project life cycle. The deliverables of each iteration, especially in the Elaboration phase, must be selected to ensure that the greatest risks are addressed first. [16]

American Society of Civil Engineers (ASCE)

ASCE does not define uncertainty, but the ASCE CE Body of Knowledge (CEBoK) uses the term in 22 places (uncertainty) and describes properties in 13 places (uncertainties).
The CEBoK does not use the phrase "uncertainty and risk" as PMI and AACE do in their publication. ASCE reverses the two (Risk and uncertainty) in twelve places regarding technical outcomes (Outcome 12). A fundamental difference between PMI and ISO is that risk is considered a subset of uncertainty. ASCE does not define "risk" but uses the term 25 times in the same document. Almost all are in the context of variation of design parameters and not in the classical context of cost, schedule uncertainty, and risk.

Commentary:

...

American Association of Cost Engineers (AACE)

AACE defined uncertainty, risk, and other related terms in its Risk Management Dictionary. [17] AACE's overall strategy was to define risk and other terms that stem from base uncertainty. AACE first defined uncertainty as .... "(t)he total range of events that may happen and produce risks (including both threats and opportunities) affecting a project (see opportunities, events, conditions, risk, and threats" where the following sub-definitions apply:

    • Biases--A lack of objectivity based on the individual's position or perspective. Systematic and predictable relationships between a person's opinion or statement and his/her underlying knowledge or circumstances. Note: there may be "system biases" as well as "individual biases."
    • Condition (Uncertain Condition)-Any specific identifiable circumstance (such as the rate of inflation or the quality of labor available) that might affect the outcome of the project
    • Event (Uncertain Condition)-is a specific identifiable action (such as a large government project being started in the same labor area as your project) or an act of nature that might happen and that (if it does happen) could affect the outcome of the project.
    • Opportunities are Uncertain events that could improve the results or improve the probability that the desired outcome will happen
    • Threats are Uncertain events that are potentially negative or reduce the probability that the desired outcome will happen.
      • AACE defines Risk as an "ambiguous term" (sic) that is synonymous with uncertainty or a negative subset such as "threats", or an overall negative impact of all possible uncertainties.

Commentary:

...

Limitations of the definition

...

Working definition

...

Beneficial outcomes

...

See also

Wiki articles on the project.

Top of current page

Notes

  1. See McDaniels et al. 2004 for an extensive discussion and bibliography on the historical development of Risk Analysis and some key milestones in risk analysis in the 20th century.
  2. TBD
  3. The Merriam-Webster dictionary defines uncertainty as “the quality or state of being uncertain,” which is something of a circular definition. Likewise, one could define uncertainty as the state of not being certain. Synonyms are distrust, doubt, misgiving, mistrust, reservation, skepticism, and suspicion. Another writer added indefinite, indeterminate, not certain to occur, problematical, unreliable, untrustworthy, unknown beyond doubt, dubious, doubtful, not clearly identified or defined, not constant, variable, and fitful to the list.
    (Han, Paul KJ, William MP Klein, and Neeraj K. Arora. "Varieties of Uncertainty in Health Care: A Conceptual Taxonomy." Medical Decision Making 31.6 (2011): 828-838.)
    Han et al. noted that any definition of uncertainty clearly encompasses "...numerous types, sources, and manifestations of uncertainty, and ...(any) ...useful working definition of uncertainty needs to specify the concept underlying these varied meanings of the term."
  4. Implicit in this definition of uncertainty as a “state of” is ... "...a conceptualization of uncertainty as a subjective, cognitive experience of people—a state of mind rather than a feature of the objective world. The defining feature of this state, furthermore, appears to be a lack of knowledge about some aspect of reality. Importantly, however, the concept of uncertainty also implies a subjective consciousness or awareness of one’s lack of knowledge, without which one could not feel uncertain; uncertainty is a form of “meta-cognition” ...(or alternatively, its main component, meta-knowledge)... —a knowing about knowing." (Han, 2011, op. cit., Emphasis added)
  5. Cox wanted his system to satisfy the following conditions:
    Divisibility and comparability – The plausibility of a statement is a real number and is dependent on the information we have related to the statement.
    Common sense – Plausibilities should vary sensibly with the assessment of plausibilities in the model.
    Consistency – If the plausibility of a statement can be derived in many ways, all the results must be equal.
    Cox's theorem has come to be used as one of the justifications for the use of Bayesian probability theory. (For example, in Jaynes Jayne, Probability Theory: The Logic of Science, Cambridge University Press (2003). — preprint version (1996) at http://omega.albany.edu:8008/JaynesBook.html; Chapters 1 to 3 of published version at http://bayes.wustl.edu/etj/prob/book.pdf
  • Implicit in this definition of uncertainty as a "state of' is ...
  • " ... a conceptualization of uncertainty as a subjective, cognitive experience of people--a state of mind rather than a feature of the objective world. Furthermore, the defining feature of this state appears to be a lack of knowledge about some aspect of reality. Importantly, however, the concept of uncertainty also implies a subjective consciousness or awareness of one's lack of knowledge, without which one could not feel uncertain; uncertainty is a form of "meta-cognition" ... ( or alternatively, its main component, meta-knowledge) ... -a knowing about knowing." (Han, 2011, op. cit., Emphasis added)
    1. Cox wanted his system to satisfy the following conditions:
    2. Divisibility and comparability- The plausibility of a statement is a real number and depends on the information we have related to the statement.
      Common sense - Plausibilities should vary sensibly with the assessment of plausibilities in the model.
      Consistency - If the plausibility of a statement can be derived in many ways, all the results must be equal.
      Cox's theorem has come to be used as one of the justifications for the use of Bayesian probability theory. (For example, in Jaynes Jayne, Probability Theory: The Logic of Science, Cambridge University Press (2003). -preprint version (1996) at http://omega.albany.edu:8008/JaynesBook.html; Chapters 1 to 3 of published version at http://bayes.wustl.edu/etj/prob/book.pdf
    1. The utility of existing taxonomies of uncertainty in civil engineering and, by extension, "risk" has been unsatisfactory for this very reason. This is particularly true in cases where the source of the uncertainty is conflicting versus incomplete information. See Regan, et. al.,"A taxonomy and treatment of uncertainty for ecology and conservation biology" (2002) for a survey of scientific taxonomies for uncertainty.
    2. Regan et al. argue that " ... genuine examples of this kind of uncertainty are hard to find. Even classic cases of random experiments like coin tosses and the throwing of dice are deterministic; it is just that we do not have enough information about the dynamic processes and initial conditions to make any sensible estimates about the outcomes. Such processes are, for all intents and purposes, inherently random, but they are not genuinely inherently random. For similar reasons, complex systems such as ecosystems and weather patterns are unlikely to be inherently random. Similarly, chaotic systems are entirely deterministic. They are unpredictable because the deterministic processes generating them and the relevant initial conditions are hard to fully specify (see Stewart 1989, Sugihara et al. 1990)." (Regan (2002)
    3. The CEBoK uses the phrase "uncertainty and risk" twice in reference to scheduling (Section 6.5,2) and cost estimating (Section 7.2,2) as well as reversing the two (Risk and Uncertainty) also in two places in discussing project life cycle (both in Section 2.4.1)

    References

    1. McDaniels, Timothy, and Mitchell Small. Risk analysis and society: an interdisciplinary characterization of the field. Cambridge University Press, 2004, page 1
    2. Bernstein, Peter L., and Jesse Boggs. Against the gods. Simon & Schuster 1997.
    3. Certainty, Stanford Encyclopedia of Philosophy, accessed on September 12, 2015, at http://plato.stanford.edu/entries/certainty/#ConCer
    4. Definition of Dogmatic theology or belief, accessed at Wikipedia
    5. Walker, W. E., Harremoës, P., Rotmans, J., Van Der Sluijs, J. P., Van Asselt, M. B., Janssen, P., & Krayer von Krauss, M. P. (2003). Defining uncertainty: a conceptual basis for uncertainty management in model-based decision support. Integrated assessment, 4(1), 5-17.
    6. 6.0 6.1 Walker, Vern R. "The siren songs of science: toward a taxonomy of scientific uncertainty for decision-makers." Conn. L. Rev. 23 (1990): 567.
    7. Randomness Is Unpredictability, Antony Eagle, The British Journal for the Philosophy of Science, Vol. 56, No. 4 (Dec., 2005), pp. 749-790
    8. See Colyvan for a critique of this claim, Colyvan Mark. "Is probability the only coherent approach to uncertainty?." Risk Analysis 28.3 (2008): 645-652.
    9. Morgan, Millett Granger, Max Henrion, and Mitchell Small. Uncertainty: a guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press, 1992.
    10. As presented and discussed in Runde, Jochen. "Clarifying Frank Knight's discussion of the meaning of risk and uncertainty." Cambridge Journal of Economics 22.5 (1998): 539-546.
    11. See also Larvor, B. "After Popper, Kuhn, and Feyerabend: Recent Issues in Theories of Scientific Method." Metascience (2002).
    12. Runde, Jochen. "Clarifying Frank Knight's discussion of the meaning of risk and uncertainty." Cambridge Journal of Economics 22.5 (1998): 539-546.
    13. 13.0 13.1 Han, Paul KJ, William MP Klein, and Neeraj K. Arora. "Varieties of Uncertainty in Health Care A Conceptual Taxonomy." Medical Decision Making 31.6 (2011): 828-838.
    14. Walker citing Bazelon, Science, and Uncertainty: A Jurist's View, 5 HARV. ENVTLt L. REv. 209, 212 (1981).
    15. Vern citing Ruckelshaus, Science. Risk, and Public Policy, 221 SCIENCE 1026, 1027 (1983)
    16. Booch, Grady, Ivar Jacobson, and James Rumbaugh. "The unified software development process." Reading: Addison Wesley (1999).
    17. Risk Management Committee uRisk Management Dictionary, Cost Engineering Vol. 37/No. 10, OCTOBER 1995.