Problem with chunked content

[cognominal]

The following program called mine returns the following error :

Type check failed in binding $str; expected 'Str' but got 'Array' in sub unbase at src/gen/m-CORE.setting:6857 in block at lib/HTTP/Client/Response.pm6:113 in method dechunk at lib/HTTP/Client/Response.pm6:106 in method contents at lib/HTTP/Client/Response.pm6:140 in method content at lib/HTTP/Client/Response.pm6:146 in sub slurp at mine:9 in block at mine:15

use HTTP::Client; proto sub slurp(|) { * }

multi sub slurp($filename, :$bin = False, :$enc = 'utf8') { if $filename.index: '://' -> $i {

require HTTP::Client;

   my $client = HTTP::Client.new;
   my $response = $client.get($filename);
   return  $response.content if $response.success ;
   fail;
} 
$filename.IO.slurp(:$bin, :$enc);

} say slurp("http://paris.mongueurs.net");

For info, the page acceded with wget with the header printed

wget -S mongueurs.net --2014-06-16 11:48:03-- http://mongueurs.net/ Resolving mongueurs.net... 91.216.186.189 Connecting to mongueurs.net|91.216.186.189|:80... connected. HTTP request sent, awaiting response... HTTP/1.1 200 OK Server: Apache/1.3.42 (Unix) Last-Modified: Mon, 16 Jun 2014 09:45:05 GMT ETag: "1bc3f8b-3e95-539ebca1" Content-Type: text/html; charset=UTF-8 Transfer-Encoding: chunked Date: Mon, 16 Jun 2014 09:48:01 GMT X-Varnish: 768907453 Age: 0 Via: 1.1 varnish Connection: keep-alive Length: unspecified [text/html] Saving to: ‘index.html.2’

[  <=>                                  ] 16,021      70.7KB/s   in 0.2s   

2014-06-16 11:48:04 (70.7 KB/s) - ‘index.html.’ saved [16021]

[avalenn]

There is several problems with "Transfer-Encoding: chunked" management with this library:

• method content() insert erroneous CRLF in result of chunked encoding
• method dechunk() erase @!content impeding to get content a second time
• if there is CRLF in the chunked content itself we're screwed
• working with Str and chars() method is a recipe for more subtle and complex error in certain cases

My opinion is that as chunked Transfer-Encoding is a MUST in RFC7230 (A recipient MUST be able to parse the chunked transfer coding) and is really used in the Internet, HTTP::Client not suitable for use anymore.

I would like to modify the README to add a message prescribing use of HTTP::UserAgent instead.