Add automatic device shifting decorator and soft device handling functions

[bipinKrishnan]

Adds automatic device shifting functionality like in tensorflow and a soft device variable to control this behaviour.

The PR is related to the task here: https://trello.com/c/TDEyHdDe

[ivy-leaves]

If you are working on an open task, please edit the PR description to link to the issue you've created.

For more information, please check ToDo List Issues Guide.

Thank you :hugs:

[vedpatwardhan]

Hey @bipinKrishnan, could you please pull from master and resolve the conflicts to see if the fix pushed by @MahmoudAshraf97 resolves the paddle gpu issue? Also it would be great if you could run a few gpu tests locally, just to confirm that we aren't breaking anything (given that there aren't any gpu tests on PRs at the moment 😅)? We could get the PR merged today if everything works fine, thanks 🙂

ivy-gardener

[vedpatwardhan]

ivy-gardener :white_check_mark: Ivy gardener has formatted your code. If changes are requested, don't forget to pull your fork.

[bipinKrishnan]

Hey @vedpatwardhan, the device shifting is working as expected on gpu and cpu device with the latest changes made by @MahmoudAshraf97 :slightly_smiling_face:

[bipinKrishnan]

As discussed, I'm working on a separate PR for the device shifting deep dive @vedpatwardhan