Categories for RE
DRAFT - to be populated from knowledge sources licenses as CC BY or with new knowledge to which you own the IP
Consistency (repeatability),
Robustness (stability under perturbation),
Predictability (calibrated failure),
Safety (bounded error severity)
Reliability Decay (performance vs. task duration), Variance Amplification (stochastic failure scaling), Graceful Degradation (avoiding "meltdowns").
Robustness of internal truth representations
Auditability (governance, model, and application layers)
Ethical Standards
Temporal Accuracy (continuous learning/updating)
Fairness, Universality, Traceability, Usability, Robustness, and Explainability
Semantic Convergence (consistency of themes)
Syntactic Complexity (structural standardization of output).
Operational vs. Ethical Reliability: Newer frameworks, such as the FUTURE-AI guidelines, distinguish between technical "Robustness" (system stability) and socio-technical "Fairness" (equal performance across groups) Agentic Reliability: Research specifically targeting AI "agents" (models that take multi-step actions) has introduced dimensions like Consistency (getting the same result on repeated runs)
Predictability, which are often ignored in standard "accuracy" benchmarks
Knowledge Brittleness: Recent findings suggest that a model's "knowledge" is often tied to the surface form of a prompt; minor reformulations can cause internal "truthfulness" representations to collapse, indicating a lack of deep, reliable reasoning
"Reliability Decay."
- sources: Literature - MORE TO FOLLOW
Probability & Distributions (the mathematical foundations: Weibull, normal, Poisson, etc.)
Reliability Fundamentals (failure rate, hazard function, mean lifetime, etc.)
System Configurations (series, parallel, redundancy types, switching) Availability & Maintainability (availability types, Markov chains, effectiveness)
Statistical Methods (estimation, hypothesis testing, parametric/non-parametric analysis)
Design & Optimization (allocation methods, sampling plans, reliability enhancement)