Agent-S
Agent-S copied to clipboard
feat(grounding): add mixture-of-grounding fallback to generate_coords
- Introduce
mixture_generate_coordsthat first tries LLM-based grounding and falls back to OCR on failure for more robust coordinate lookup - Update
assign_coordinatesto use the new mixture method for click and drag-and-drop actions
This improves resilience when the primary grounding model cannot locate elements.