Package 'softwareRisk'

Title: Computation of Node and Path-Level Risk Scores in Scientific Models
Description: It leverages the network-like architecture of scientific models together with software quality metrics to identify chains of function calls that are more prone to generating and propagating errors. It operates on tbl_graph objects representing call dependencies between functions (callers and callees) and computes risk scores for individual functions and for paths (sequences of function calls) based on cyclomatic complexity, in-degree and betweenness centrality. The package supports variance-based uncertainty and sensitivity analyses after Puy et al. (2022) <doi:10.18637/jss.v102.i05> to assess how risk scores change under alternative risk definitions.
Authors: Arnald Puy [aut, cre] (ORCID: <https://orcid.org/0000-0001-9469-2156>)
Maintainer: Arnald Puy <[email protected]>
License: GPL-3
Version: 0.3.0
Built: 2026-10-17 10:26:38 UTC
Source: https://github.com/arnaldpuy/softwarerisk

Help Index


Enumerate entry-to-sink call paths and compute risk metrics at the node and path level

Description

Given a directed call graph (tidygraph::tbl_graph) with a node attribute for cyclomatic complexity, this function:

  • computes node-level metrics (in-degree, out-degree, betweenness),

  • calculates a node risk score as a weighted combination of rescaled metrics,

  • enumerates all simple paths from entry nodes (in-degree = 0) to sink nodes (out-degree = 0),

  • computes path-level summaries and a path-level risk score.

  • calculates a gini index and the slope of risk at the path-level.

Usage

all_paths_fun(
  graph,
  alpha = 0.6,
  beta = 0.3,
  gamma = 0.1,
  p = 1,
  eps = 1e-12,
  complexity_col = "cyclo",
  weight_tol = 1e-08
)

Arguments

graph

A directed tidygraph::tbl_graph. Graph nodes must have a name attribute (i.e., igraph::V(as.igraph(graph))$name) and a numeric node attribute specified by complexity_col.

alpha, beta, gamma

Numeric non-negative weights for the risk score, constrained such that alpha + beta + gamma == 1 (within weight_tol).

p

Numeric scalar. Power parameter for the weighted power mean. Must be finite and lie in the interval [−1,2][-1, 2]. When p=1p = 1 the formula reduces to a weighted sum. Default 1.

eps

Numeric. Small positive constant ϵ\epsilon used for numerical stability in the p→0p \to 0 (geometric mean) case and when p<0p < 0, where zero-valued normalized metrics are replaced by ϵ\epsilon to avoid non-finite intermediate values. Default 1e-12.

complexity_col

Character scalar. Name of the node attribute containing cyclomatic complexity. Default "cyclo".

weight_tol

Numeric tolerance for enforcing the weight-sum constraint. Default 1e-8.

Details

The normalized node metrics are computed using scales::rescale() and denoted by a tilde ⋅~\tilde{\cdot}.

The risk score for node viv_i is computed as the weighted power mean of normalized metrics:

r(vi)=(α C~(vi)p+β d~(vi)in p+γ b~(vi)p)1/p ,r_{(v_i)} = \left(\alpha\,\tilde{C}_{(v_i)}^{p} + \beta\,\tilde{d}_{(v_i)}^{\mathrm{in}\,p} + \gamma\,\tilde{b}_{(v_i)}^{p}\right)^{1/p}\,,

where pp is the power-mean parameter. When p=1p = 1 this reduces to a weighted sum (additive). In the limit p→0p \to 0, this reduces to a weighted geometric mean, implemented with a small constant ϵ\epsilon to ensure numerical stability:

r(vi)=exp⁡(αlog⁡(max⁡(C~(vi),ϵ))+βlog⁡(max⁡(d~(vi)in,ϵ))+γlog⁡(max⁡(b~(vi),ϵ))) .r_{(v_i)} = \exp\left(\alpha\log(\max(\tilde{C}_{(v_i)}, \epsilon)) + \beta\log(\max(\tilde{d}_{(v_i)}^{\mathrm{in}}, \epsilon)) + \gamma\log(\max(\tilde{b}_{(v_i)}, \epsilon))\right)\,.

The path-level risk score is calculated as

Pk=1−∏i=1nk(1−rk(vi)) ,P_k = 1 - \prod_{i=1}^{n_k} (1 - r_{k(v_i)})\,,

where rk(vi)r_{k(v_i)} is the risk of the ii-th function in path kk and nkn_k is the number of functions in that path. The equation behaves like a saturating OR-operator: PkP_k is at least as large as the maximum individual function risk and monotonically increases as more functions on the path become risky, approaching 1 when several functions have high risk scores.

The Gini index of path kk is computed as

Gk=∑i∑j∣rk(vi)−rk(vj)∣2nk2rˉk ,G_k = \frac{\sum_i \sum_j |r_{k(v_i)} - r_{k(v_j)}|}{2 n_k^2 \bar{r}_k}\,,

where rˉk\bar{r}_k is the mean node risk in path kk.

Finally, the trend of risk is defined by the slope of the regression

rk(vi)=θ0k+θ1k i+ϵi ,r_{k(v_i)} = \theta_{0k} + \theta_{1k}\, i + \epsilon_i \,,

where rk(vi)r_{k(v_i)} is the risk score of the function at position ii along path kk (ordered from upstream to downstream execution) and ϵi\epsilon_i is a residual term.

The returned paths tibble includes path_cc, a list-column where each element is the vector of per-node cyclomatic complexity values along the path.

Value

A named list with two tibbles:

nodes

Node-level metrics with columns name, cyclomatic_complexity, indeg (in-degree), outdeg (out-degree), btw (betweenness), risk_score.

paths

Path-level metrics with columns path_id, path_nodes, path_str, hops, path_risk_score, path_cc, gini_node_risk, risk_slope, risk_mean, risk_sum

Examples

# synthetic_graph is a tidygraph::tbl_graph with node attribute "cyclo"
data(synthetic_graph)

# additive risk (p = 1, default)
out1 <- all_paths_fun(
  graph = synthetic_graph,
  alpha = 0.6, beta = 0.3, gamma = 0.1,
  p = 1,
  complexity_col = "cyclo"
)

# power-mean risk (p = 0 ~ weighted geometric mean)
out2 <- all_paths_fun(
  graph = synthetic_graph,
  alpha = 0.6, beta = 0.3, gamma = 0.1,
  p = 0,
  eps = 1e-12,
  complexity_col = "cyclo"
)

out1$nodes
out1$paths

Build a call graph from an R package or a directory of R scripts

Description

Constructs the directed call graph required by all_paths_fun() automatically, so that no manual preparation of edge lists or complexity spreadsheets is needed for R code. Each node is a function, each edge from -> to is a call from function from (caller) to function to (callee), and each node carries a cyclo attribute with its cyclomatic complexity.

Usage

call_graph_fun(pkg = NULL, dir = NULL, exclude = NULL, keep_self_loops = FALSE)

Arguments

pkg

Character scalar. Name of an installed package whose namespace functions (exported and internal) are analyzed. Exactly one of pkg or dir must be supplied.

dir

Character scalar. Path to a directory containing .R files. Files are parsed (searched recursively) and all top-level ⁠name <- function(...)⁠ definitions (also with = or ⁠<<-⁠) are collected. The code is never executed: function literals are only parsed and turned into closures.

exclude

Optional character vector of function names to drop from the graph (e.g., generated or vendored code).

keep_self_loops

Logical. Keep self-recursion edges (a function calling itself)? These edges do not affect the simple-path enumeration of all_paths_fun() but change the in-degree. Default FALSE.

Details

Call detection relies on codetools::findGlobals(), i.e., on static analysis of each function body. Two limitations follow: (i) calls built at run time (e.g., do.call(paste0("f", i), ...), get(), method dispatch) cannot be detected; (ii) a function of the set that is merely referenced (e.g., passed to lapply()) is treated as called, since in a dependency sense the caller relies on it.

Cyclomatic complexity is computed internally as 11 plus one unit per decision point (if, for, while, repeat, &&, ||, and each switch() alternative beyond the first), following McCabe (1976).

Value

A directed tidygraph::tbl_graph with node attributes name and cyclo, ready to be passed to all_paths_fun().

References

McCabe, T. J. (1976). A Complexity Measure. IEEE Transactions on Software Engineering, SE-2(4), 308–320. doi:10.1109/TSE.1976.233837

See Also

read_call_graph() to import a call graph prepared outside R (e.g., for Fortran, C or Python models).

Examples

# build the call graph of a directory of R scripts
td <- file.path(tempdir(), "cg_example")
dir.create(td, showWarnings = FALSE)
writeLines(c(
  "load_data <- function(x) x",
  "clean_data <- function(x) load_data(x)",
  "calc_scores <- function(x) if (length(x) > 0) mean(x) else 0",
  "compute_risk <- function(x) calc_scores(clean_data(x))"
), file.path(td, "model.R"))

g <- call_graph_fun(dir = td)
g

# the result feeds directly into the pipeline
out <- all_paths_fun(g, alpha = 0.6, beta = 0.3, gamma = 0.1)
out$paths

# build the call graph of an installed package

g_pkg <- call_graph_fun(pkg = "softwareRisk")
g_pkg

Greedy selection of the most risk-reducing node fixes

Description

Selects, under a budget of budget refactoring interventions, the set of nodes whose fixing (risk set to 0) most reduces the path-level risk of the system. Whereas path_fix_heatmap() shows the effect of fixing single nodes on single paths, this function answers the budgeted question directly: given resources to refactor kk functions, which kk?

Usage

fix_portfolio_fun(
  all_paths_out,
  budget = 5,
  objective = c("total", "max"),
  tol = 1e-12
)

Arguments

all_paths_out

A list produced by all_paths_fun() with elements nodes and paths. nodes must contain name and risk_score; paths must contain path_nodes and path_risk_score.

budget

Integer. Maximum number of nodes to fix. Default 5.

objective

Character scalar, "total" (default) or "max". See Details.

tol

Numeric. Minimum improvement in the objective required to continue selecting nodes. Default 1e-12.

Details

At each step the algorithm evaluates, for every remaining candidate node, the objective obtained by adding that node to the already-selected set, fixes the best node, and repeats. Path risk is recomputed under the independence assumption used throughout the package:

Pk=1−∏i=1nk(1−rk(vi)) ,P_k = 1 - \prod_{i=1}^{n_k} (1 - r_{k(v_i)})\,,

with r=0r = 0 for fixed nodes. Two objectives are available:

  • "total": minimize ∑kPk\sum_k P_k, the total path risk. This objective is monotone submodular in the set of fixed nodes, so the greedy solution is guaranteed to achieve at least 1−1/e≈63%1 - 1/e \approx 63\% of the reduction of the optimal set of the same size (Nemhauser et al. 1978).

  • "max": minimize max⁡kPk\max_k P_k, the risk of the riskiest path.

The greedy search stops early if no remaining node yields an improvement larger than tol.

Value

A list with two elements:

  • portfolio: a tibble with one row per selected node, in selection order, with columns step, node, objective_after (value of the objective once the node is fixed), delta (improvement contributed by the node) and cum_reduction (cumulative fraction of the initial objective removed).

  • plot: a ggplot2 object showing the objective as a function of the number of fixed nodes, with the selected nodes labelled.

References

Nemhauser, G. L., Wolsey, L. A., and Fisher, M. L. (1978). An analysis of approximations for maximizing submodular set functions–I. Mathematical Programming, 14(1), 265–294. doi:10.1007/BF01588971

See Also

path_fix_heatmap() for the node-by-path improvement matrix and node_exposure_fun() for path-aware node criticality.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
                     gamma = 0.1, complexity_col = "cyclo")
res <- fix_portfolio_fun(out, budget = 5)
res$portfolio
res$plot

Compute the Gini index of a numeric vector

Description

Computes the Gini index (a measure of inequality) for a numeric vector. Non-finite (NA, NaN, Inf) values are removed prior to computation. If fewer than two finite values remain, or if all finite values are zero (no inequality is measurable), the function returns 0.

Usage

gini_index_fun(x)

Arguments

x

Numeric vector.

Details

The Gini index ranges from 0 (perfect equality) to 1 (maximal inequality).

Value

A numeric scalar giving the Gini index of x.

Examples

gini_index_fun(c(1, 1, 1, 1))
gini_index_fun(c(1, 2, 3, 4))
gini_index_fun(c(NA, 1, 2, Inf, 3))

Path-aware node criticality (risk load)

Description

Summarizes, for each node, its participation in the entry-to-sink paths enumerated by all_paths_fun(). Whereas the node risk score captures how error-prone a function is in isolation, the risk load captures how many risky execution chains depend on it: a function of moderate complexity can still be critical if most high-risk paths route through it.

Usage

node_exposure_fun(all_paths_out)

Arguments

all_paths_out

A list produced by all_paths_fun() with elements nodes and paths. nodes must contain name and risk_score; paths must contain path_nodes and path_risk_score.

Details

For node vv the function computes:

  • n_paths: the number of paths that contain vv,

  • path_share: n_paths divided by the total number of paths,

  • risk_load: ∑k:v∈kPk\sum_{k : v \in k} P_k, the sum of path_risk_score over the paths containing vv,

  • risk_load_share: risk_load divided by ∑kPk\sum_k P_k,

  • mean_path_risk: the mean path_risk_score of the paths containing vv.

The output also reports the rank of each node by risk_load and by its standalone risk_score, so that structurally exposed functions can be told apart from merely complex ones: a node ranking much higher on risk_load than on risk_score is a chokepoint rather than a hotspot.

Value

A tibble with one row per node appearing on at least one path, sorted by decreasing risk_load, with columns name, risk_score, n_paths, path_share, risk_load, risk_load_share, mean_path_risk, rank_risk_load and rank_risk_score. Nodes on no path (e.g., disconnected helpers) are omitted. If all_paths_out$paths is empty, an empty tibble with these columns is returned.

See Also

path_fix_heatmap() for the per-path effect of fixing single nodes, and fix_portfolio_fun() for a budgeted selection of fixes.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
                     gamma = 0.1, complexity_col = "cyclo")
node_exposure_fun(out)

Path-level improvement from fixing high-risk nodes

Description

Compute how much the risk score of the riskiest paths would decrease if selected high-risk nodes were made perfectly reliable (risk fixed to 0), and visualise the result as a heatmap.

Usage

path_fix_heatmap(all_paths_out, n_nodes = 20, k_paths = 20)

Arguments

all_paths_out

A list returned by all_paths_fun(), with elements nodes and paths. nodes must contain at least the columns name and risk_score. paths must contain at least the columns path_id, path_nodes (list-column of node names) and path_risk_score.

n_nodes

Integer, number of top-risk nodes (by risk_score) to include as rows in the heatmap. Defaults to 20.

k_paths

Integer, number of top-risk paths (by path_risk_score) to include as columns in the heatmap. Defaults to 20.

Details

For each of the top n_nodes nodes ranked by risk_score and the top k_paths paths ranked by path_risk_score, the function sets the risk of that node to 0 along the path (for all its occurrences) and recomputes the path risk score under the independence assumption, using

Pk=1−∏i=1nk(1−rk(vi))P_k = 1 - \prod_{i=1}^{n_k} (1 - r_{k(v_i)})

The improvement

ΔPk=Rorig−Rfix\Delta P_k = R_{\mathrm{orig}} - R_{\mathrm{fix}}

is used as the fill value in the heatmap cells.

Bright cells indicate nodes that act as chokepoints for a given path. Rows with many bright cells correspond to nodes whose refactoring would improve many risky paths (global chokepoints), while columns with a few very bright cells correspond to paths dominated by a single risky node.

Value

A list with two elements:

  • delta_tbl: a tibble with columns node, path_id and deltaR, containing the reduction in path risk score when fixing the node in that path.

  • plot: a ggplot2 object containing the heatmap.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
gamma = 0.1, complexity_col = "cyclo")
res <- path_fix_heatmap(all_paths_out = out, n_nodes = 20, k_paths = 20)
res

Plot path-level uncertainty for the top-risk paths

Description

Plot the top n_paths paths ranked by their mean risk score, with horizontal error bars representing the uncertainty range (minimum and maximum risk) computed from the Monte Carlo samples stored in uncertainty_analysis.

Usage

path_uncertainty_plot(ua_sa_out, n_paths = 20)

Arguments

ua_sa_out

A list returned by uncertainty_fun() containing at least an element $paths, which must be a data frame with columns path_id and uncertainty_analysis. The column uncertainty_analysis is expected to be a list-column where each element is a numeric vector of path risk values obtained from Monte Carlo sampling.

n_paths

Integer, number of top paths (by mean risk) to include in the plot. Defaults to 20.

Details

This function is designed to work with the paths component of the output of uncertainty_fun(). For each path, it summarises the vector of path risk values by computing the mean, minimum and maximum values, and then displays these summaries for the n_paths most risky paths.

Value

A ggplot2 object.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
gamma = 0.1, complexity_col = "cyclo")
results <- uncertainty_fun(all_paths_out = out, N = 2^10, order = "first")
path_uncertainty_plot(ua_sa_out = results, n_paths = 20)

Plot the top risky call paths on a Sugiyama layout

Description

Visualizes the most risky entry-to-sink paths (by decreasing path_risk_score) computed by all_paths_fun(). Edges that occur on the top paths are highlighted, with edge colour mapped to the mean path risk and edge width mapped to the number of top paths using that edge. Nodes on the top paths are emphasized, with node size mapped to in-degree and node fill mapped to binned cyclomatic complexity.

Usage

plot_top_paths_fun(
  graph,
  all_paths_out,
  model.name = "",
  language = "",
  top_n = 10,
  alpha_non_top = 0.05
)

Arguments

graph

A directed tidygraph::tbl_graph representing the call graph to plot (typically the same graph used as input to all_paths_fun()).

all_paths_out

Output from all_paths_fun(), i.e. a list with elements nodes and paths.

model.name

Character scalar used in the plot title (e.g., model name).

language

Character scalar used in the plot title (e.g., language name).

top_n

Integer. Number of highest-risk paths to display (default 10).

alpha_non_top

Numeric between 0 and 1. Alpha (transparency) for edges that are not on the top-risk paths. Smaller values fade background edges more.

Details

The function selects the top_n paths by sorting paths_tbl on path_risk_score (descending). For those paths, it:

  • builds an edge list from path_nodes,

  • marks graph edges that appear on at least one top path,

  • computes path_freq (how many top paths include each edge),

  • computes risk_mean_path (mean of risk_sum across top paths that include each edge),

  • highlights nodes that appear on any top path.

Node fills are based on cyclomatic_complexity using breaks ⁠(-Inf, 10]⁠, ⁠(10, 20]⁠, ⁠(20, 50]⁠, ⁠(50, Inf]⁠ as per Watson & McCabe (1996).

Value

A ggplot object (invisibly). The plot is also printed as a side effect.

References

Watson, A. H. and McCabe, T. J. (1996). Structured Testing: A Testing Methodology Using the Cyclomatic Complexity Metric. NIST Special Publication 500-235, National Institute of Standards and Technology, Gaithersburg, MD. doi:10.6028/NIST.SP.500-235

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
gamma = 0.1, complexity_col = "cyclo")
p <- plot_top_paths_fun(synthetic_graph, out, model.name = "MyModel", language = "R", top_n = 10)
p

Robustness of the risk ranking under uncertainty

Description

Quantifies how stable the identification of the top-kk riskiest paths (or nodes) is across the uncertainty draws produced by uncertainty_fun(). Every draw corresponds to one plausible definition of risk (one sampled combination of the weights α,β,γ\alpha, \beta, \gamma and the exponent pp); ranking the paths within each draw therefore shows which paths are flagged as risky regardless of how risk is weighted and which ones enter the top-kk only under specific assumptions.

Usage

rank_robustness_fun(ua_sa_out, top_k = 10, what = c("paths", "nodes"))

Arguments

ua_sa_out

A list returned by uncertainty_fun() with elements nodes and paths, each containing an uncertainty_analysis list-column of numeric draws.

top_k

Integer. Size of the top set whose membership is tracked. Clamped to the number of items with a message if larger. Default 10.

what

Character scalar, "paths" (default) or "nodes".

Details

For each item (path or node) the function reports the probability of belonging to the top-kk across draws and the median and the 5th and 95th percentiles of its rank (rank 1 = riskiest; ties share the minimum rank). As a global summary it also reports the mean Spearman correlation between the risk values of each draw and the consensus (mean across draws) risk values: values close to 1 indicate that the ranking barely responds to the risk definition, values well below 1 that conclusions depend on it.

Draws that are NA for an item are treated as never placing that item in the top-kk.

Value

A list with:

  • summary: a tibble with one row per item, sorted by decreasing top_k_prob, with columns id (path path_id or node name), path_str (paths only), mean_risk, top_k_prob, rank_median, rank_q05 and rank_q95.

  • consensus_correlation: mean Spearman correlation between each draw and the consensus risk values.

  • top_k, what: the settings used.

See Also

rank_robustness_plot() to visualize the result and uncertainty_fun() to generate the draws.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
                     gamma = 0.1, complexity_col = "cyclo")
results <- uncertainty_fun(all_paths_out = out, N = 2^7, order = "first")

rr <- rank_robustness_fun(results, top_k = 10, what = "paths")
rr$summary
rr$consensus_correlation

Plot the robustness of the risk ranking

Description

Displays, for the items most often ranked in the top-kk, the probability of top-kk membership across the uncertainty draws computed by rank_robustness_fun(). Items with probability close to 1 are flagged as risky under essentially any risk definition; intermediate probabilities identify items whose criticality depends on how the risk score is weighted.

Usage

rank_robustness_plot(rank_out, top_n = 20)

Arguments

rank_out

A list returned by rank_robustness_fun().

top_n

Integer. Number of items (by decreasing top_k_prob) to display. Default 20.

Value

A ggplot2 object.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
                     gamma = 0.1, complexity_col = "cyclo")
results <- uncertainty_fun(all_paths_out = out, N = 2^7, order = "first")
rr <- rank_robustness_fun(results, top_k = 10, what = "paths")
rank_robustness_plot(rr, top_n = 20)

Import a call graph from edge-list and complexity tables

Description

Builds the directed call graph required by all_paths_fun() from the two datasets described in the package vignette: an edge list of function calls and a table of per-function cyclomatic complexity. The input is validated so that common preparation errors (misspelled columns, functions missing from the complexity table, duplicated or non-numeric entries) fail early with an informative message. This is the recommended entry point for models written in languages other than R (e.g., Fortran, C, Python), whose edge lists and complexity values are extracted with external tools.

Usage

read_call_graph(
  edges,
  metrics,
  from_col = "from",
  to_col = "to",
  name_col = "name",
  complexity_col = "cyclo"
)

Arguments

edges

A data.frame (or path to a .csv file) with one row per function call. Must contain the columns given by from_col (caller) and to_col (callee).

metrics

A data.frame (or path to a .csv file) with one row per function. Must contain the columns given by name_col (function name) and complexity_col (cyclomatic complexity).

from_col, to_col

Character scalars. Names of the caller and callee columns in edges. Defaults "from" and "to".

name_col

Character scalar. Name of the function-name column in metrics. Default "name".

complexity_col

Character scalar. Name of the complexity column in metrics. Default "cyclo". The column keeps this name in the returned graph, matching the default of all_paths_fun().

Value

A directed tidygraph::tbl_graph with node attributes name and complexity_col, ready to be passed to all_paths_fun().

See Also

call_graph_fun() to build the graph automatically from R source code.

Examples

calls_df <- data.frame(
  from = c("clean_data", "compute_risk", "compute_risk", "calc_scores"),
  to   = c("load_data", "clean_data", "calc_scores", "trim_mean")
)
cyclo_df <- data.frame(
  name  = c("clean_data", "load_data", "compute_risk", "calc_scores",
            "trim_mean"),
  cyclo = c(6, 3, 12, 5, 2)
)

g <- read_call_graph(edges = calls_df, metrics = cyclo_df)
g

Plot Sobol' sensitivity indices of the node risk scores

Description

Visualizes the Sobol' indices stored in the sensitivity_analysis list-column returned by uncertainty_fun(), showing how much of the variance in the node risk scores is driven by each parameter of the risk definition (the weights α\alpha, β\beta, γ\gamma and the power-mean exponent pp).

Usage

sensitivity_plot_fun(ua_sa_out, nodes = NULL, index = c("both", "Si", "Ti"))

Arguments

ua_sa_out

A list returned by uncertainty_fun() with element nodes containing a sensitivity_analysis list-column.

nodes

Optional character vector of node names to display individually. Default NULL (aggregate view across all nodes).

index

Character scalar: "both" (default), "Si" (first-order) or "Ti" (total-order). Which indices to display.

Details

Two displays are available:

  • With nodes = NULL (default), the distribution of the indices across all nodes is shown as one boxplot per parameter, answering the system-level question of which assumption dominates the risk ranking overall.

  • With nodes set to a character vector of node names, the indices of those nodes are shown as dodged bars with their confidence intervals, one panel per node.

Nodes whose risk score does not vary across draws (e.g., all metrics zero) yield non-finite indices; these are dropped with a message.

Value

A ggplot2 object.

References

Puy, A., Lo Piano, S., Saltelli, A., and Levin, S. A. (2022). sensobol: An R Package to Compute Variance-Based Sensitivity Indices. Journal of Statistical Software, 102(5), 1–37. doi:10.18637/jss.v102.i05

See Also

uncertainty_fun() to generate the indices and the sensobol package (Puy et al. 2022) for their estimation.

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
                     gamma = 0.1, complexity_col = "cyclo")
results <- uncertainty_fun(all_paths_out = out, N = 2^7, order = "first")

# system-level view: which assumption drives the risk scores?
sensitivity_plot_fun(results)

# node-level view
sensitivity_plot_fun(results, nodes = results$nodes$name[1:4])

Compute the linear slope of a numeric sequence

Description

Computes the slope of a simple linear regression of a numeric vector against its index (seq_along(x)). Non-finite (NA, NaN, Inf) values are removed prior to computation, but the remaining values keep their original positions as the regressor, so removing values does not distort the trend. If fewer than two finite values remain, the function returns 0.

Usage

slope_fun(x)

Arguments

x

Numeric vector.

Details

The slope is estimated from the model xi=β0+β1i+εix_i = \beta_0 + \beta_1 i + \varepsilon_i, where i=1,…,ni = 1, \dots, n. The function returns the estimated slope β1\beta_1.

This summary is useful for characterizing monotonic trends in ordered risk values along a path.

Value

A numeric scalar giving the slope of the fitted linear trend.

Examples

slope_fun(c(1, 2, 3, 4))
slope_fun(c(4, 3, 2, 1))
slope_fun(c(NA, 1, 2, Inf, 3))

Synthetic citation graph for software risk examples

Description

A synthetic directed graph with cyclomatic complexity values to illustrate the functions of the package.

Usage

data(synthetic_graph)

Format

A tbl_graph with:

nodes

55 nodes

edges

122 directed edges

Details

The graph is stored as a tbl_graph object with:

  • Node attributes: name, cyclo

  • Directed edges defined by from → to


A clean, publication-oriented ggplot2 theme

Description

theme_AP() provides a minimalist, publication-ready theme based on ggplot2::theme_bw(), with grid lines removed, compact legends, and harmonized text sizes. It is designed for dense network and path-visualization plots (e.g. call graphs, risk paths).

Usage

theme_AP()

Details

The theme:

  • removes major and minor grid lines,

  • uses transparent legend backgrounds and keys,

  • standardizes text sizes for axes, legends, strips, and titles,

  • reduces legend spacing for compact layouts.

This theme is intended to be composable: it should be added to a ggplot object using + theme_AP().

Value

A ggplot2::theme object.

Examples

ggplot2::ggplot(mtcars, ggplot2::aes(mpg, wt)) +
  ggplot2::geom_point() +
  theme_AP()

Uncertainty and sensitivity analysis of node and path risk

Description

Runs a full variance-based uncertainty and sensitivity analysis (UA/SA) for node risk scores using the results returned by all_paths_fun() and the functions provided by the sensobol package (Puy et al. 2022).

Usage

uncertainty_fun(all_paths_out, N, order, eps = 1e-12)

Arguments

all_paths_out

A list produced by all_paths_fun() with elements nodes and paths. nodes must contain columns name, cyclomatic_complexity, indeg, btw; paths must contain path_id, path_nodes, path_str, and hops.

N

Integer. Base sample size used for Sobol' matrices.

order

Passed to sensobol::sobol_matrices() and sensobol::sobol_indices() to control which Sobol indices are computed (e.g., first/total/second order), depending on your implementation.

eps

Numeric. Small positive constant ϵ\epsilon used for numerical stability in the p→0p \to 0 evaluation and when p<0p < 0, where zero-valued rescaled metrics are replaced by ϵ\epsilon to avoid non-finite intermediate values. Default 1e-12.

Details

Uncertainty is induced by jointly sampling the weights (α,β,γ)(\alpha, \beta, \gamma) (renormalized to sum to 1) and the power parameter p∈[−1,2]p \in [-1, 2] used in the node-risk definition:

r=(α C~p+β (d~in)p+γ b~p)1/p .r = \left(\alpha\,\tilde{C}^{p} + \beta\,(\tilde{d}^{\mathrm{in}})^{p} + \gamma\,\tilde{b}^{p}\right)^{1/p}\,.

For each node, risk scores are repeatedly recalculated using the sampled parameter combinations, producing a distribution of possible outcomes. Sobol' first-order and/or total-order sensitivity indices are then computed for all four parameters (α\alpha, β\beta, γ\gamma, and pp), quantifying how much of the variance in the node risk score is attributable to each parameter.

Parameter labels and the Sobol' design. Internally the design samples four independent U(0,1)U(0,1) values (a_raw, b_raw, c_raw, p_raw) because the Sobol' quasi-random sequence requires independent uniform inputs. Before evaluating the risk model, the raw draws are transformed: the three weight draws are normalised to sum to one, yielding α\alpha, β\beta, γ\gamma; and p_raw is mapped linearly to p∈[−1,2]p \in [-1, 2]. The sensitivity indices are then attributed to the transformed parameters and the output labels them as alpha, beta, gamma, and p rather than the internal raw names, so the results are directly interpretable in terms of the model parameters.

Path-level uncertainty is obtained by propagating node-level uncertainty draws through the path aggregation function:

Pk=1−∏i=1nk(1−rk(vi)) ,P_k = 1 - \prod_{i=1}^{n_k} (1 - r_{k(v_i)})\,,

where rk(vi)r_{k(v_i)} are node risks along path kk.

All uncertainty metrics are computed from the first N Sobol draws (matrix A), while sensitivity indices use the full Sobol' design.

For more information about the uncertainty and sensitivity analysis and the output of this function, see the sensobol package (Puy et al. 2022).

The returned node table includes the following columns:

  • name: name of the node.

  • uncertainty_analysis: numeric vector of length NN giving the uncertainty draws in the node risk score (from Sobol matrix A).

  • sensitivity_analysis: object returned by sensobol::sobol_indices() for that node, containing Sobol' indices labelled alpha, beta, gamma, and p. These correspond to the normalised weights and the power-mean exponent respectively. The indices are computed on the transformed parameters (see Details).

The returned paths table includes:

  • path_id: path identifier.

  • path_str: sequence of function calls for each path.

  • hops: number of edges.

  • uncertainty_analysis: numeric vector giving the uncertainty draws in the path risk score.

  • gini_index: numeric vector giving the uncertainty draws in the gini index.

  • risk_trend: numeric vector giving the uncertainty draws in the risk trend.

Value

A named list with:

nodes

A tibble of node results.

paths

A tibble of path results. If all_paths_out$paths is empty (e.g., the graph has no entry-to-sink paths), an empty tibble with the same columns is returned.

References

Puy, A., Lo Piano, S., Saltelli, A., and Levin, S. A. (2022). sensobol: An R Package to Compute Variance-Based Sensitivity Indices. Journal of Statistical Software, 102(5), 1–37. doi:10.18637/jss.v102.i05

Examples

data(synthetic_graph)
out <- all_paths_fun(graph = synthetic_graph, alpha = 0.6, beta = 0.3,
                     gamma = 0.1, complexity_col = "cyclo")

# Power-mean risk (increase N to at least 2^10 for a proper UA/SA)
results <- uncertainty_fun(all_paths_out = out, N = 2^2, order = "first")

results$nodes
results$paths