User requirements should form the criteria for a structured evaluation. Focus on the extent to which the user requirements were met (fully, partially, not met) would form the basis of a reflective ...

Evaluation allows us to consider the solution to a problem, make sure that it meets the original design criteria, produces the correct solution and is fit for purpose - before programming begins.

Such phenomena, often called hallucinations, contain inherent risk, and should be carefully considered when evaluating generative AI solutions. Another thing to consider is whether vendor-based AI ...