lexer confused by 1<<bar()

[jhi]

Using this simple round-tripper:

use PPI; print PPI::Document->new($ARGV[0]), "\n";

the following trivial code fails:

sub foo { 1<<bar(); }

I am guessing it thinks the << is a heredoc, when it should be a bit shift.

The original line was

$num |= (1<<index($D_flags, $_)) for split //, $on;

which comes from this in the standard Devel/Peek.pm:

sub debug_flags (;$) { my $out = ""; for my $i (0 .. length($D_flags)-1) { $out .= substr $D_flags, $i, 1 if $^D & (1<<$i); } my $arg = shift; my $num = $arg; if (defined $arg and $arg =~ /\D/) { die "unknown flags in debug_flags()" if $arg =~ /[^-$D_flags]/; my ($on,$off) = split /-/, "$arg-"; $num = $^D; $num |= (1<<index($D_flags, $)) for split //, $on; $num &= ~(1<<index($D_flags, $)) for split //, $off; } $^D = $num if defined $arg; $out }

[h3xx]

I've been investigating a related issue, whereby stringifying the PPI::Document object (same as calling ->content() on it) strips out the content of heredocs, giving back an un-parseable document.

See #288 for a full description of the bug I found.

A workaround I've found in the mean time is to call ->serialize() instead of using the automatic stringification.

To fix your code, replace:

 print PPI::Document->new($ARGV[0]), "\n";

with:

print PPI::Document->new($ARGV[0])->serialize;