mycroft-core icon indicating copy to clipboard operation
mycroft-core copied to clipboard

Lng: Add cs-cz noise words

Open Tony763 opened this issue 3 years ago • 8 comments

Description

Hi, PR contain Czech version of noise words.

Contributor license agreement signed?

CLA [x] (Whether you have signed a CLA - Contributor Licensing Agreement

Tony763 avatar Oct 13 '22 20:10 Tony763

Voight Kampff Integration Test Failed (Results). Mycroft logs are also available: skills.log, audio.log, voice.log, bus.log, enclosure.log

devops-mycroft avatar Oct 13 '22 21:10 devops-mycroft

Hi, VK for Wiki failed, what about adding Github action to it (same as in HA skill)?

Tony763 avatar Oct 13 '22 21:10 Tony763

I think the latest version of wiki doesn't have the issue but is held back waiting for a mycroft release.

The wiki-skill is a bit troublesome, the problem is due to wikipedia returning a new answer for a question. It was working on last release of the wiki-skill but has since changed. I think using something like betamax in VK providing a set of stable data from the web might be one way to go. The problem is that it means that the tests won't tell the devs whether the skill is actually working alright with real world data.

That said, per skill unit/integrationtests is a great idea :)

forslund avatar Oct 14 '22 12:10 forslund

I think the latest version of wiki doesn't have the issue but is held back waiting for a mycroft release.

The wiki-skill is a bit troublesome, the problem is due to wikipedia returning a new answer for a question. It was working on last release of the wiki-skill but has since changed. I think using something like betamax in VK providing a set of stable data from the web might be one way to go. The problem is that it means that the tests won't tell the devs whether the skill is actually working alright with real world data.

That said, per skill unit/integrationtests is a great idea :)

Testing against real integration is always better than just testing against fixed data. That is why I use real Home Assistant installation and not just mocked subset. Also, CI per repo give you instant feedback when doing changes.

If you want it for wiki skill, let me know and I will prepare it.

Tony763 avatar Oct 14 '22 17:10 Tony763

In ovos and neon we have unittests per skill, i agree it is the way to go and way more useful than VK imho

Eg https://github.com/OpenVoiceOS/skill-ovos-wikipedia/tree/dev/tests/unittests

JarbasAl avatar Oct 14 '22 17:10 JarbasAl

With HA skill, I run both VK and unittest (allure report is generated).

Tony763 avatar Oct 14 '22 17:10 Tony763

I think using vk in core is valid, even with fixed data. It helps to ensure that a change in core doesn't break. I think both unit tests and the high level tests vk provides are needed to guard against regressions.

For validating skills functionality during (skill) development unittest are probably more valuable.

forslund avatar Oct 14 '22 18:10 forslund

To wrap it, should I prepare PR with GitHub Action?

Tony763 avatar Oct 14 '22 19:10 Tony763