Add support for LSP to provide enhanced information to LLMs

[simonsickle]

Summary

Language Server Protocol (LSP) helps LLMs interact with a codebase. It also uses diagnostics to provide feedback to the LLM.

Type of Change

• [x] Feature
• [ ] Bug fix
• [ ] Refactor / Code quality
• [x] Performance improvement
• [ ] Documentation
• [ ] Tests
• [ ] Security fix
• [ ] Build / Release
• [ ] Other (specify below)

Testing

Manual testing with databricks provider

Related Issues

Relates to #ISSUE_ID
Discussion: LINK (if any)

Screenshots/Demos (for UX changes)

After:

[DOsinga]

as discussed: thanks for implementing this and I like the direction, but I don't think this should be integrated into the core of goose if that makes sense. can we try this again with just an MCP server?