Benchmark for interpreted languages implementations.

Most programs from benchmarks game. All programs are chosen to be simplest, single-thread and without any low-level hacks. Also, the code for all languages trying to be implemented with one algorithm, use the same language constructs and containers, and be semantically similar to each other. The goal of the benchmark is to find the most successful JIT solutions. My other benchmarks: Benchmarks, Crystal Benchmarks Game.

Compare:

	* Ruby (Ruby2.7, Ruby3, Graal, Topaz, JRuby, Rbx)
	* Python (Cpython, Graal, Pypy, Cython, Jython, Nuitka, Mypyc, Codon)
	* Lua (JIT)
	* Javascript (Node, Graal)
	* PHP8.1 (JIT)
	* C, Crystal as a basis

Running on AMD Ryzen 7 3800X, 80Gb DDR-4 3200 Mghz, docker on Ubuntu 22.10.

Update: 2023-02-28 (round 1)

binarytrees

brainfuck

brainfuck2

fannkuchredux

fasta

knucleotide

mandelbrot

matmul

nbody

pidigits

regexdna

revcomp

spectralnorm

Versions

Run

Currently possible to run on x86_64 and aarch64. Tested Ubuntu x86_64 and Apple M1.

Install docker-compose-plugin v2 and Ruby, on your local machine.

Run control script for more info:

	./dc

Example build and run binarytrees benchmark for ruby and crystal:

	./dc init crystal,ruby
	./dc up crystal,ruby
	./dc versions crystal,ruby
	./dc build binarytrees crystal,ruby
	./dc check binarytrees crystal,ruby
	./dc run binarytrees crystal,ruby
	./dc down
	./dc readme binarytrees crystal,ruby

Add new language XXX

Create file docker/XXX and add it to docker-compose.yml. Add language XXX into tools/languages.rb. Check that its intalled ok ./dc init XXX.

Create benchmark file: BENCH/test.EXT (BENCH is specific benchmark name, EXT language extension)

To work in benchmark suite, required some special marks in the benchmark file:

• at the start of benchmark write to stderr: started\tPID\n (PID current process pid)
• at the end of benchmark write to stderr: time(TIME)\n (TIME time spended by benchmark in seconds, measure in language itself).

Check that it worked.

./dc up XXX
./dc versions XXX
./dc shell XXX
./dc build BENCH XXX
./dc check BENCH XXX
./dc run BENCH XXX