feat: add ovoscope end2end intent-routing tests#28
Conversation
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
The code stars have aligned. Here's the update. ✨I've aggregated the results of the automated checks for this PR below. ⚖️ License CheckI've checked the genealogical tree of your licenses. 🌳 ✅ No license violations found (10 packages). License distribution: 2× MIT, 2× MIT License, 1× Apache Software License, 1× Apache-2.0 OR BSD-2-Clause, 1× Apache2.0, 1× BSD License, 1× BSD-3-Clause AND 0BSD AND MIT AND Zlib AND CC0-1.0, 1× BSD-3-Clause and Public-Domain Full breakdown — 10 packages
Policy: Apache 2.0 (universal donor). StrongCopyleft / NetworkCopyleft / WeakCopyleft / Other / Error categories fail. MPL allowed. 🔌 Skill Tests (ovoscope)I ran the end-to-end skill tests to see how your skill behaves in the real world! 🎤 ❌ 0/47 passed, 47 failed ❌ **TestAdapt10_Enclosureeyesblink** — 0/4
❌ **TestAdapt11_Enclosureeyesspin** — 0/2
❌ **TestAdapt12_Enclosureeyesnarrow** — 0/2
❌ **TestAdapt13_Enclosurereset** — 0/1
❌ **TestAdapt14_Enclosuremouthsmile** — 0/2
❌ **TestAdapt15_Enclosuremouthlisten** — 0/2
❌ **TestAdapt16_Enclosuremouththink** — 0/2
❌ **TestAdapt17_Enclosurecrazyeyes** — 0/3
❌ **TestAdapt4_Enclosurelookright** — 0/2
❌ **TestAdapt5_Enclosurelookleft** — 0/2
❌ **TestAdapt6_Enclosurelookup** — 0/2
❌ **TestAdapt7_Enclosurelookdown** — 0/2
❌ **TestAdapt8_Enclosurelookupdown** — 0/3
❌ **TestAdapt9_Enclosurelookleftright** — 0/3
❌ **TestPadatious1_Custom_eye_color_intent** — 0/5
❌ **TestPadatious2_Eye_color_intent** — 0/5
❌ **TestPadatious3_Brightness_intent** — 0/5
🚌 Bus CoverageMeasuring the reach of our bus handlers. 📏 🔒 Security (pip-audit)Checking for any potential security breaches. 🔓 ✅ No known vulnerabilities found (38 packages scanned). 🏷️ Release PreviewThe release candidate is looking strong. 💪 Current:
✅ PR title follows conventional commit format. 🚀 Release Channel Compatibility Predicted next version:
🎙️ SkillSkill inspection report: All systems go! 🚀 🎙️ (unknown skill_id) — 13 languages en-US: 3 intents · 22 vocab · 15 dialogs · skill.json Translation coverage — 12 languages (6 complete, 6 incomplete)
📋 Repo HealthEnsuring the codebase isn't suffering from 'technical debt' flu. 🤒 ✅ All required files present. Latest Version: ✅ 📊 CoverageIs the code fully immunized with tests? 💉 🔍 LintEvaluating the overall quality of your PR. ✨ ❌ ruff: issues found — see job log 🔨 Build TestsEnsuring the scaffolding is removed and the build is clean. 🧹
❌ 3.10: Install OK, tests failed The pulse of the OpenVoiceOS codebase 💓 |
…ious assertions Suppresses speak/mycroft.audio.play_sound noise so message-count checks are not thrown off by extra bus events; routing verified via activation_points. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Migrate to pyproject.toml packaging, add ADAPT end-to-end intent-routing tests for the Mark 1 enclosure skill, and adopt the canonical gh-automations CI workflows.
…p ovos-* deps at next major
Auto-generated ovoscope intent-routing tests.
Covers Padatious intents (exact message-type assertions) and Adapt intents
(speak-response assertions). One test method per canonical utterance.
Generated by
tools/gen_ovoscope_tests.pyfrom the dataset atknowledge/datasets/ovoscope/test_dataset.jsonl.Run:
pytest test/end2end/ -v --timeout=60