aws-virtual-gpu-device-plugin
aws-virtual-gpu-device-plugin copied to clipboard
awslabs
AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads
Setting per_process_gpu_memory_fraction seems to work for our tensorflow models, but doesn't seem to work for our pytorch and spacy models. So we consistently run into Out of memory errors since...
*Issue #, if available:* #15 *Description of changes:* As "latest" tag has been deprecated, need to specify a version instead of "latest" By submitting this pull request, I confirm that...
Hello. I've looking some 'virtualized gpu' framework things. but I cannot solve some questions. 1. If I've allocated some **"virtualized gpus"** in the instances. How can I solve CUDA Core...
as can seen from the image, nvidia no longer keeps image with tag latest, thus creating a problem while trying to run a init container as speciied here ``` 38...
Does this support p4dn instances out of the box or are there any changes needed?
``` apiVersion: apps/v1 kind: Deployment metadata: name: objectdetection-deployment namespace: iinumbers labels: deployment: objectdetection-deployment spec: replicas: 2 selector: matchLabels: app: objectdetection-server template: metadata: labels: app: objectdetection-server spec: # hostIPC is required...
remove warnings in k8s 1.16+ *Issue #, if available:* *Description of changes:* When applying it to AWS EKS 1.16+ its hit. warning, the lines are removed so it's not sending...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.24.0 to 1.53.0. Release notes Sourced from google.golang.org/grpc's releases. Release 1.53.0 API Changes balancer: support injection of per-call metadata from LB policies (#5853) resolver: remove deprecated field...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
Tried running `$ kubectl create -f https://raw.githubusercontent.com/awslabs/aws-virtual-gpu-device-plugin/v0.1.1/manifests/device-plugin.yml` and kept getting an image pull error. Took a look at the Docker Hub [link](https://hub.docker.com/r/nvidia/cuda) and looks like the latest tag is deprecated.
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.0.0-20201021035429-f5854403a974 to 0.7.0. Commits See full diff in compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter...