nio and busted?

[HiPhish]

Continuing the discussion from #349. I am currently writing an adapter for busted and I want to write tests for it in busted as well. I can run tests in general without issue following this blog post. The issue is when executing asynchronous functions like neotest.lib.treesitter.parse_positions.

Here is a simple test file:

local nio = require 'nio'

describe('Discovery of test positions', function()
	local tempfile

	before_each(function()
		-- Create temporary file
		tempfile = vim.fn.tempname()
	end)

	after_each(function()
		-- Delete temporary file
		if vim.fn.filereadable(tempfile) ~= 0 then
			vim.fn.delete(tempfile)
		end
	end)

	it('Always succeeds', function()
		assert.is_true(vim.endswith('abc', 'c'))
	end)
end)

As you can see this busted test is able to call into Neovim's vim module. Other than that it is a regular busted test. Now let's adding an actial test.

A naive attempt

	it('Discovers nothing in an empty file', function()
		local result = adapter.discover_positions(tempfile)
		print(vim.inspect(result))
	end)

This fails because discover_positions calls lib.treesitter.parse_positions without asynchronous context. The return values of lib.treesitter.parse_positions are wrong and the file descriptor will be returned as the error. Issue #349 describes the same behaviour.

Using nio.tests.it

	nio.tests.it('Discovers nothing in an empty file', function()
		vim.fn.writefile({''}, tempfile, 's')
		local result = adapter.discover_positions(tempfile)
		print(vim.inspect(result))
	end)

This throws another error about it being nil inside to body of nio.tests.it.

Error → ./test/unit/discover_positions_spec.lua @ 4
Discovery of test positions
...e/nvim/site/pack/testing/start/neotest/lua/nio/tests.lua:35: attempt to call global 'it' (a nil value)

Replicate nio.tests.it

If the global it only exists within the test, how about we replicate the entire function inside the test?

	it('Does something async', function()
		local success, err
		local task = nio.tasks.run(function()
				assert.is_true(true)
				assert.equal('x', 'y')
				return 'Yay!'
			end,
			function(success_, err_)
				success = success_
				if not success_ then
					err = err_
				end
			end)
		vim.wait(2000, function()
			return success ~= nil
		end, 20, false)

		if success == nil then
			error(string.format("Test task timed out\n%s", task.trace()))
		elseif not success then
			error(string.format("Test task failed with message:\n%s", err))
		end
	end)

This raises a validation error inside vim.startswith.

Error → ./test/unit/discover_positions_spec.lua @ 23
Discovery of test positions Does something async
vim/shared.lua:610: prefix: expected string, got table

This error is raised by the failing assertion. If the test function does not raise any errors then the test works fine.