Run untrusted code in an isolated environment
Sandkasten is a code execution engine for running arbitrary untrusted/harmful code in a sandbox, isolating it from both the host system and other Sandkasten jobs. A simple REST API allows uploading and executing arbitrary programs, while also enabling the user to specify resource limits and providing feedback on the actual resources used. This project was partly inspired by Piston and aims to solve some problems with it.
Sandkasten uses nsjail to run programs in restricted environments and to enforce the specified resource limits. Additionally GNU Time is used for reporting the resources used by the program. Programs are always run in a chroot environment using nsjail, which contains only the following directories:
/nix/store
(ro mount from host)/program
(rw in compile steps, ro in run steps) contains the compiled program/box
(ro) current working directory which contains the specified files for compile/run steps/tmp
(rw, tmpfs)/dev
and /etc
which are needed for some packages to work properlyPrograms are uniquely identified using the hash value of their source files and selected environments. If a program has been uploaded and compiled before and is then uploaded again, the same program id is used and the existing compilation results can be used without having to recompile the program.
On a running Sandkasten instance, the API documentation is available on <instance>/docs
and
<instance>/redoc
. There is also an OpenAPI specification available on <instance>/openapi.json
.
Not available (yet).
nix
{
inputs.sandkasten.url = "github:Defelo/sandkasten";
}
nix
{
imports = [sandkasten.nixosModules.sandkasten];
}
nix
{
services.sandkasten = {
enable = true;
# example config:
host = "0.0.0.0";
port = 8080;
max_concurrent_jobs = 16;
run_limits.time = 10;
# for a full list of configuration options, see `config.toml`
};
}
bash
CONFIG_PATH=config.toml nix run github:Defelo/sandkasten
bash
docker compose up -d
The following components are needed for a working development environment:
If you also have direnv installed, you can just use
direnv allow
to setup your shell for development. Otherwise you can also use nix develop
to enter a development shell. This will add some tools to your PATH
and set a few environment
variables that are needed by Sandkasten and some of the integration tests. In the development shell
you can just use cargo run
to start the application.
To run the unit tests, you can just use cargo test
. This only requires you to have a working rust
toolchain, but you should not need to setup nix for this.
To run the integration tests, you can use cargo test -F nix -- --ignored
. For this to work you
need to have a Sandkasten instance running on 127.0.0.1:8000
. You can also specify a different
instance via the TARGET
environment variable. If you only want to run the integration tests that
do not require a nix development shell, you can omit the -F nix
. In the development shell you can
also run the integration-tests
command to automatically start a temporary sandkasten instance and
run the integration tests against it. There is also a cov
command that runs the integration tests
and writes an html coverage report to lcov_html/index.html
.
All packages are defined using nix expressions in nix/packages. Each package has a unique id, a human-readable name, a version, optionally a script to compile a program, a script to run a program and a test program that is executed as part of the integration tests to ensure that the package is working. When creating a new package, don't forget to add it to nix/packages/default.nix.
The compile script of a package is executed whenever a new program has been uploaded. When this
script is run, the current working directory (/box
) contains all the source files and the command
line arguments contain the names of the source files in the same order as they were specified by
the client. It is assumed that the first file always provides the entrypoint into the program. The
purpose of the compile script is to compile the provided program and store the result (plus any
files that may be needed to run the program) in /program
.
If a package does not have a compile script, the source files are instead copied directly into the program directory.
The run script of a package is executed whenever a program is executed. When this script is run, the
current working directory (/box
) contains the files that have been specified in the run step (if
any) and /program
contains the files that have been produced by the corresponding compile script
previously (or the source files if the packages does not have a compile script). The first command
line argument is always the name of the first source file (which is assumed to be the entrypoint
into the program). In most cases, this is only relevant for interpreted languages (like Python) and
can be ignored for most compiled languages. All other command line arguments are the ones specified
by the client and should be forwarded to the actual program.
Every package should provide a test program that checks the following:
first_file.py
can import second_file.py
)stdin
is read from
stdin.foo
, bar
and baz
.test.txt
in the current working
directory contains the string hello world
.If any of these checks fails, the program should exit with a non-zero exit code. Otherwise, if all
checks passed, it should exit with exit code zero and print OK
to stdout.