AMTSO’s Sandbox Evaluation Framework is being made available for public review. The framework was developed by AMTSO’s Sandbox Working Group from an initial draft by sandboxing expert Jan Miller of OPSWAT, who has driven the project. After absorbing comment from the Working Group and AMTSO members, the near-final draft is being made available as a “preprint” for public review.
Sandbox creators and vendors are invited to provide their comments on the draft as we work on the final version, which we aim to put forward for formal approval by AMTSO members by the end of the year. The comment period will remain open until the end of October 2024.
An introduction to the framework was presented at our recent Dublin member meeting (recording and slide deck available to AMTSO members via the member website).
The framework aims to provide a structured approach to evaluating sandboxes and similar technologies on a matrix of major factors, allowing evaluation and benchmarking according to a variety of use-cases. Independent testers and internal evaluators will be enabled to set their own weightings to provide simple insight into the strengths and weaknesses of different technologies in different settings and for different purposes.
Individual companies active in the sandbox space but outside the AMTSO membership are now being actively contacted for their input, but we welcome feedback from anyone with an interest in and knowledge of the evaluation, implementation, and use of sandbox technologies. We also anticipate some trial testing projects using the current draft of the framework to test it out in real-world implementations.
Any comments on the draft should be sent to [email protected], by the October 31st 2024 cutoff.