aboutsummaryrefslogtreecommitdiffstats
path: root/scripts/protoc.py (unfollow)
Commit message (Collapse)AuthorLines
2021-12-07Log cgroup version at startupGravatar Matteo Bertucci-2/+4
2021-12-07Add the --use_cgroupv2 flag when relevantGravatar Matteo Bertucci-1/+18
According to https://github.com/google/nsjail/pull/119, the flag should be passed for NsJail to try to use cgroupv2. This commit will use the /sys/fs/cgroup structure to guess the installed version, and depending on the version add that flag.
2021-12-02update arrow to most recent versionGravatar aru-1/+1
2021-11-11Update deployment.yamlGravatar Joe Banks-0/+1
2021-10-11Bumps Coverage VersionGravatar Hassan Abouelela-58/+39
Signed-off-by: Hassan Abouelela <[email protected]>
2021-10-11Updates Runtime Modules For 3.10Gravatar Hassan Abouelela-6/+4
Signed-off-by: Hassan Abouelela <[email protected]>
2021-10-11Bumps Python Version To 3.10Gravatar Hassan Abouelela-122/+170
Signed-off-by: Hassan Abouelela <[email protected]>
2021-07-17test: add test_multiprocess_resource_limits to test memory limit sharingGravatar Joe Banks-0/+28
This test ensures that spawned child processes inherit the same resource group as the parent by spawning 2 child processes which each allocate a 40MB object, it then verifies that one of the child processes was killed with SIGKILL for violating the resource quota.
2021-07-17test: update pid limit tests to account for new increased limitGravatar Joe Banks-1/+10
2021-07-17chore: increase 3rd party thread limit environment variablesGravatar Joe Banks-5/+5
We define a few environment variables to stop third party libraries trying to default to spawning more processes, with the PID limit modification we can increase these values.
2021-07-17feat: increased PID limitsGravatar Joe Banks-1/+1
Processes spawned in snekbox now have up to 5 PIDs available, each sharing the same memory limits and environment as the parent python process. As far as I could see in testing this does appear safe and processes behave as expected even when detatching from the parent or exceeding memory limits.
2021-07-07add anyioGravatar Thomas Grainger-0/+1
2021-06-19Env deps: add tzdataGravatar Matteo Bertucci-0/+1
Snekbox is lacking an IANA timezone database, this first-party `tzdata` package will provide them. It can be tested by running the following script: ```py import zoneinfo if len(zoneinfo.available_timezones()) == 0: print("The environment doesn't have a valid IANA database.") ```
2021-06-01Bump urllib3 from 1.26.4 to 1.26.5Gravatar dependabot[bot]-33/+33
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.4 to 1.26.5. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](https://github.com/urllib3/urllib3/compare/1.26.4...1.26.5) --- updated-dependencies: - dependency-name: urllib3 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]>
2021-05-19chore: Use TestCase.subTestGravatar ToxicKidz-12/+12
2021-05-19chore: Apply suggestions to improve documentationGravatar ToxicKidz-3/+5
Co-authored-by: Mark <[email protected]>
2021-05-19chore: Update the Nsjail.python3 docstring to use nsjail_argsGravatar ToxicKidz-1/+1
2021-05-18Add a step to lint-test to show pre-commit logsGravatar ToxicKidz-1/+8
2021-05-18chore: Fix some typosGravatar ToxicKidz-2/+2
2021-05-18chore: Add tests for py_args and ns_jail argsGravatar ToxicKidz-1/+32
2021-05-18chore: Improve documentation for arguments in /evalGravatar ToxicKidz-8/+16
2021-05-17feat: Allow custom arguments to be passed to evalGravatar ToxicKidz-3/+14
2021-04-08Clarify documentation of None return codeGravatar Mark-1/+1
2021-04-08Note new return case in eval api fileGravatar Bast-1/+1
2021-04-08Match new unicode eval tests and output to the format and functions of othersGravatar Bast-13/+9
2021-04-06Use PYTHONIOENCODING to enable utf-8 stdout for the nsjail pipe, and handle ↵Gravatar Bast-1/+31
the potential case where this is bypassable Since snekbox does not run with a tty, stdout is technically raw bytes, and thus incomplete surrogate pairs can be printed without the client application erroring, and instead fail within _consume_stdout when we attempt to decode it to a str. This commit sets the PYTHONIOENCODING environment variable to inform python to open the pipe in utf-8 mode. However, clever use of execl and os.unsetenv() can unset this environment variable, so we add a safety check to _consume_stdout to fail out of parsing output if it contains invalid unicode. This should only happen in deliberate cases, or significant bugs in python or a c library where output is printed to stdout ignoring the python stdout encoding.
2021-04-06Bump urllib3 from 1.26.3 to 1.26.4Gravatar dependabot[bot]-6/+6
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.3 to 1.26.4. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](https://github.com/urllib3/urllib3/compare/1.26.3...1.26.4) Signed-off-by: dependabot[bot] <[email protected]>
2021-04-05Move from GHCR_TOKEN to GITHUB_TOKEN in Docker publish stageGravatar Joe Banks-1/+1
2021-04-01Update policy documentsGravatar Matteo Bertucci-121/+8
2021-03-23Remove binarytree packageGravatar Mark-1/+0
It needs setuptools which requires --ignore-installed to be used. That causes all dependencies to be re-installed and therefore always invalidates the cache. Not worth it.
2021-03-23Add binarytree package to eval environmentGravatar Mark-0/+1
2021-03-19Bump urllib3 from 1.26.2 to 1.26.3Gravatar dependabot[bot]-39/+44
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.2 to 1.26.3. - [Release notes](https://github.com/urllib3/urllib3/releases) - [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst) - [Commits](https://github.com/urllib3/urllib3/compare/1.26.2...1.26.3) Signed-off-by: dependabot[bot] <[email protected]>
2021-03-16Update flooding test to expect code 143Gravatar Joe Banks-1/+1
Test was relying on 137 which is SIGKILL, when instead it would receive 143, or SIGTERM.
2021-03-16Remove logic for removing remnant cgroupsGravatar Joe Banks-12/+0
This should be addressed by sending SIGTERM to nsjail instead of SIGKILL, since nsjail then gets an opportunity to run clean-up logic which includes removing cgroups.
2021-03-16Change SIGKILL to SIGTERMGravatar Joe Banks-3/+4
2021-03-13Remove the mixed line endings pre-commit hook because it is obsolete.Gravatar MarkKoz-2/+1
Relying on git to handle line endings means contributors have more flexibility with which line endings they want to use on check-out. The settings in .gitattributes only impose which line endings will be used upon check-in (LF), which should not impact local development; git will still respect the core.eol and core.autocrlf settings.
2021-03-13master => mainGravatar Joe Banks-14/+14
2021-03-07Docker: improve caching & install numpy in containerGravatar MarkKoz-9/+15
CI was building the image twice: once with dev dependencies and again without. Separating the pipenv command into separate layers allows the second build in CI to take advantage of the cache for the base dependencies that it will share across both builds. Install numpy along with the dev dependencies within the container. Previously it was installed in CI only, but this meant extra work for those running tests locally. Install numpy to the correct site.
2021-02-26Remove all child cgroups before removing parentsGravatar Joe Banks-0/+12
2021-02-04Fix patch for DEBUG value during testingGravatar MarkKoz-1/+1
2021-02-04Fix the memory limit test and the import errorGravatar MarkKoz-2/+2
2021-02-04Close file descriptors when subprocess endsGravatar MarkKoz-15/+14
2021-02-04Suppress NsJail info logs during testsGravatar MarkKoz-0/+1
The logs clutter up the test output way too much.
2021-02-04CI: fix test step not failing when tests failGravatar MarkKoz-3/+6
Generating the report in the same step resulted in the report exit code overriding the exit code of the test runner.
2021-02-04CI: use Docker Compose to run the containerGravatar MarkKoz-19/+10
Avoid redundant specification of Docker settings. The compose file is set up to build all stages. This makes sense for local development; both an interactive shell and running the webserver are useful. Therefore, the image built is tagged "snekbox:dev". However, CI does not need to run a webserver. It is therefore sufficient for it to only build to the venv stage, and it does exactly that. The image in CI is tagged as "snekbox-venv:<git sha>". To facilitate the discrepancy in image tags, the suffix for the image tag can be set with the new IMAGE_SUFFIX environment variable. Docker Compose will use this to determine the image from which to create a container. A TTY needs to be allocated to prevent the container from exiting immediately after starting. This is probably because the entrypoint is Python (inherited from the base image), and the REPL relies on a TTY.
2021-02-04Document configuration thoroughlyGravatar MarkKoz-1/+41
2021-02-04Fix coverage ownership when running testsGravatar MarkKoz-1/+2
2021-02-04Document how to update NsJailGravatar MarkKoz-0/+10
2021-02-04Replace protoc shell script with a Python oneGravatar MarkKoz-15/+63
2021-02-04Rename "snekbox" script to "webserver" in PipfileGravatar MarkKoz-1/+1
The new name better conveys what the script does.
generated by cgit v1.2.3 (git 2.39.1) at 2025-10-20 14:09:03 +0000