shards icon indicating copy to clipboard operation
shards copied to clipboard

shards build --mcpu causes lookup of CPU arch as a target incorrectly

Open ziggythehamster opened this issue 2 years ago • 3 comments

Problem

shards build incorrectly treats --mcpu as if you specified --target (also, separately, --target on shards build makes --target on crystal build not available directly).

Reproduce

As an example, if you were trying to optimize the build for Graviton2:

$ shards build --production --no-debug --release --stats --verbose --mcpu neoverse-n1 --mattr +crc,+fp16,+rcpc,+dotprod,+crypto
Dependencies are satisfied
Error target neoverse-n1 was not found in shard.yml.

Workaround

There is a workaround (which also permits you to set --target):

CRYSTAL_OPTS="--target aarch64-linux-gnu --mcpu neoverse-n1 --mattr +crc,+fp16,+rcpc,+dotprod,+crypto" shards build --production --no-debug --release --stats --verbose

ziggythehamster avatar Apr 22 '22 19:04 ziggythehamster

The bug is caused here: https://github.com/crystal-lang/shards/blob/85b30b5755b5aad8e5b4bd94cc94610c6a617bea/src/cli.cr#L132-L142

All arguments that don't start with a dash are considered a target.

A simple workaround is to write flag and value as a single argument: --mcpu neoverse-n1. Or just use crystal build directly.

Related: crystal-lang/crystal#11136

straight-shoota avatar Apr 22 '22 20:04 straight-shoota

For a proper fix, I think it doesn't make sense to expect targets at arbitrary positions. Everything after the first flag argument (starting with dash) should simply be forwarded to crystal build. There could also be a -- to separate targets from forwarding options. Example: shards build mytarget othertarget -- --mcpu neoverse-n1. This should definitely be allowed, maybe even required.

straight-shoota avatar Apr 22 '22 20:04 straight-shoota

A simple workaround is to write flag and value as a single argument: --mcpu neoverse-n1

Did you mean --mcpu=neoverse-n1?

Example: shards build mytarget othertarget -- --mcpu neoverse-n1

I agree that this is how it should behave, because shards build --production target1 target2 -- --release --no-debug --some-other-args-which-shards-doesnt-care-about has a logical behavior that other CLI commands (e.g., git) follow. The "flags are forwarded to crystal build and don't show up in help" thing is a bit surprising, whereas stating that anything after -- is passed directly to crystal build isn't.

It also allows for Crystal to change without Shards having to. e.g., if Crystal added a --split-debug filename option so that debugging symbols can be generated as a separate file for dropping into /usr/lib/debug or whatever the OS prefers, then Shards doesn't have to know that.

ziggythehamster avatar Apr 22 '22 21:04 ziggythehamster