enable meghanada-mode break the company completion in other major modes

[DogLooksGood]

Here's my configuration for Java

(defun user/java-setup ()
  (meghanada-mode t)
  (flycheck-mode 1)
  (smartparens-mode)
  (sp-local-pair 'rust-mode "<" ">")
  (setq c-basic-offset 4))

(use-package meghanada
  :bind
  (:map meghanada-mode-map
        ("C-c C-c C-r" . 'meghanada-exec-main))
  :init
  (setq flycheck-idle-change-delay 2)
  (add-hook 'java-mode-hook 'user/java-setup))

When I open an java file, meghanada works without problem. However then I switch to other languages, (for example, elisp), the company completion won't work. Looks like company-backends is affected.