serve icon indicating copy to clipboard operation
serve copied to clipboard

Published 20 hours ago • verified publisher icon pytorch

model config gpu count support

Open lxning opened this issue 3 years ago • 12 comments

Description

Please include a summary of the feature or issue being fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes #(issue) #1407

Type of change

Please delete options that are not relevant.

  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [x] New feature (non-breaking change which adds functionality)
  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [ ] This change requires a documentation update

Feature/Issue validation/testing

Please describe the tests [UT/IT] that you ran to verify your changes and relevent result summary. Provide instructions so it can be reproduced. Please also list any relevant details for your test configuration.

  • [ ] Test A

  • [ ] Test B

  • UT/IT execution results

  • Logs

Pass build, sanity test and regression test (except profiler regress test).

Checklist:

  1. Add properties in config.properties
  • rpc_master_address=localhost
  • rpc_master_port=5678

  1. Add gpuCount in model level config ref

  2. pass properties from frontend to backend via context ref

  • "gpu_count": gpu_cpunt,

  • "rpc_master_address": rpc_master_address,

  • "rpc_master_port": rpc_master_port,

  • [ ] Have you added tests that prove your fix is effective or that this feature works?

  • [ ] New and existing unit tests pass locally with these changes?

  • [ ] Has code been commented, particularly in hard-to-understand areas?

  • [ ] Have you made corresponding changes to the documentation?

lxning avatar Jan 31 '22 17:01 lxning

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-win
  • Commit ID: 18e422dc25d741fc31fe5f72aa5a0493d9cdb5f5
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 18:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-gpu
  • Commit ID: 18e422dc25d741fc31fe5f72aa5a0493d9cdb5f5
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 18:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-gpu
  • Commit ID: b71893044cfa7d09f5ebb93c8ea1bd14ed02328f
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 18:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-win
  • Commit ID: b71893044cfa7d09f5ebb93c8ea1bd14ed02328f
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 18:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-cpu
  • Commit ID: 18e422dc25d741fc31fe5f72aa5a0493d9cdb5f5
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 18:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-cpu
  • Commit ID: b71893044cfa7d09f5ebb93c8ea1bd14ed02328f
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 18:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-win
  • Commit ID: 399724f4088b90003bbadb89cf181830c090800f
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 19:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-gpu
  • Commit ID: 399724f4088b90003bbadb89cf181830c090800f
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 19:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-cpu
  • Commit ID: 399724f4088b90003bbadb89cf181830c090800f
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 20:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-win
  • Commit ID: 48c4785488b02d20d1cbb7451c3d9df712a883c7
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 20:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-gpu
  • Commit ID: 48c4785488b02d20d1cbb7451c3d9df712a883c7
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 20:01 sagemaker-neo-ci-bot

AWS CodeBuild CI Report

  • CodeBuild project: torch-serve-build-cpu
  • Commit ID: 48c4785488b02d20d1cbb7451c3d9df712a883c7
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-neo-ci-bot avatar Jan 31 '22 20:01 sagemaker-neo-ci-bot

@lxning gonna close this PR since it seems stale, please reopen if you're still working on it

msaroufim avatar Jul 21 '23 21:07 msaroufim