tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

fill_template.py and gpu_device_ids

Open Alireza3242 opened this issue 1 year ago • 0 comments

System Info

3090

Who can help?

@juney-nvidia @byshiue @schetlur-nv

Information

  • [ ] The official example scripts
  • [X] My own modified scripts

Tasks

  • [X] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • [ ] My own task or dataset (give details below)

Reproduction

I want to use both gpu_device_ids 0 and 1:

python3 fill_template.py --in_place config.pbtxt gpu_device_ids:0,1

Expected behavior

work

actual behavior

Traceback (most recent call last):
  File "/app/src/config_modifier/../tools/fill_template.py", line 38, in <module>
    main(**vars(args))
  File "/app/src/config_modifier/../tools/fill_template.py", line 12, in main
    key, value = sub.split(":")
ValueError: not enough values to unpack (expected 2, got 1)
Traceback (most recent call last):
  File "/app/src/config_modifier/../tools/fill_template.py", line 38, in <module>
    main(**vars(args))
  File "/app/src/config_modifier/../tools/fill_template.py", line 12, in main
    key, value = sub.split(":")
ValueError: not enough values to unpack (expected 2, got 1)
Traceback (most recent call last):
  File "/app/src/config_modifier/../tools/fill_template.py", line 38, in <module>
    main(**vars(args))
  File "/app/src/config_modifier/../tools/fill_template.py", line 12, in main
    key, value = sub.split(":")
ValueError: not enough values to unpack (expected 2, got 1)
Traceback (most recent call last):
  File "/app/src/config_modifier/../tools/fill_template.py", line 38, in <module>
    main(**vars(args))
  File "/app/src/config_modifier/../tools/fill_template.py", line 12, in main
    key, value = sub.split(":")
ValueError: not enough values to unpack (expected 2, got 1)
Traceback (most recent call last):
  File "/app/src/config_modifier/../tools/fill_template.py", line 38, in <module>
    main(**vars(args))
  File "/app/src/config_modifier/../tools/fill_template.py", line 12, in main
    key, value = sub.split(":")
ValueError: not enough values to unpack (expected 2, got 1)

additional notes

the problem is "," in "0,1"

Alireza3242 avatar Oct 12 '24 11:10 Alireza3242