From talexb at gmail.com  Mon Jan 20 06:57:11 2014
From: talexb at gmail.com (Alex Beamish)
Date: Mon, 20 Jan 2014 09:57:11 -0500
Subject: [tpm] Meeting this week?
Message-ID: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>

Hi guys,

The calendar's rolling around, and the last Thursday on January is in three
days.

Do we have a talk lined up? I don't see anything on the to.pm.org web site.

Cheers,

Alex
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140120/fdb0b7af/attachment.html>

From olaf.alders at gmail.com  Mon Jan 20 07:01:20 2014
From: olaf.alders at gmail.com (Olaf Alders)
Date: Mon, 20 Jan 2014 10:01:20 -0500
Subject: [tpm] Meeting this week?
In-Reply-To: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
References: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
Message-ID: <1E947A29-5A19-49E6-B629-AC2FA850E925@gmail.com>

Hi Alex,

On 2014-01-20, at 9:57 AM, Alex Beamish wrote:

> Hi guys,
> 
> The calendar's rolling around, and the last Thursday on January is in three days.

It looks like it's actually next week Thursday (Jan 30).  :)

> 
> Do we have a talk lined up? I don't see anything on the to.pm.org web site.

I'm going to talk about working with the MetaCPAN VM as a follow-up to my October talk.  We do need that posted on meetup.com, though.  The other thing we'll need to do next week is set the calendar for the next 6 months or so.  I think we can be flexible, but the advance planning seemed to work out really well last time.  So, bring your talk ideas so that we can discuss and make plans.  Guest speakers are more than welcome.  After ingy's talk, I think we know we can do remote speakers quite nicely.

Best,

Olaf
--
Olaf Alders
olaf.alders at gmail.com

http://www.wundercounter.com
http://twitter.com/wundercounter

866 503 2204 (Toll free - North America)
416 944 8306 (direct)


From dave.s.doyle at gmail.com  Mon Jan 20 07:01:59 2014
From: dave.s.doyle at gmail.com (Dave Doyle)
Date: Mon, 20 Jan 2014 10:01:59 -0500
Subject: [tpm] Meeting this week?
In-Reply-To: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
References: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
Message-ID: <CAAyyWE_w-bJj+hCP=SVUWe+nUxkhcvNB9=4AWqsn8PwhBACgGA@mail.gmail.com>

Hi Alex,

Whoops. This is partially my bad.  I think Olaf tried to contact me last
week and I missed it.  Thursday next week is actually the last though.

Olaf, you in for your talk?

Thanks,
D

--
dave.s.doyle at gmail.com


On 20 January 2014 09:57, Alex Beamish <talexb at gmail.com> wrote:

> Hi guys,
>
> The calendar's rolling around, and the last Thursday on January is in
> three days.
>
> Do we have a talk lined up? I don't see anything on the to.pm.org web
> site.
>
> Cheers,
>
> Alex
>
>
>
> _______________________________________________
> toronto-pm mailing list
> toronto-pm at pm.org
> http://mail.pm.org/mailman/listinfo/toronto-pm
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140120/e3e9aae0/attachment.html>

From dave.s.doyle at gmail.com  Mon Jan 20 07:03:44 2014
From: dave.s.doyle at gmail.com (Dave Doyle)
Date: Mon, 20 Jan 2014 10:03:44 -0500
Subject: [tpm] Meeting this week?
In-Reply-To: <1E947A29-5A19-49E6-B629-AC2FA850E925@gmail.com>
References: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
	<1E947A29-5A19-49E6-B629-AC2FA850E925@gmail.com>
Message-ID: <CAAyyWE99VvOh+cdi1R+kB0Hz=Oj3_-obfNXO21zp25c5V=G=jQ@mail.gmail.com>

On 20 January 2014 10:01, Olaf Alders <olaf.alders at gmail.com> wrote:

>
> I'm going to talk about working with the MetaCPAN VM as a follow-up to my
> October talk.  We do need that posted on meetup.com, though.  The other
> thing we'll need to do next week is set the calendar for the next 6 months
> or so.  I think we can be flexible, but the advance planning seemed to work
> out really well last time.  So, bring your talk ideas so that we can
> discuss and make plans.  Guest speakers are more than welcome.  After
> ingy's talk, I think we know we can do remote speakers quite nicely.
>

Oops.  Can I use the summary for the November talk on to.pm.org for the
summary? http://to.pm.org/meetings/46/

Thanks,
D
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140120/32a3043a/attachment.html>

From olaf.alders at gmail.com  Mon Jan 20 07:05:05 2014
From: olaf.alders at gmail.com (Olaf Alders)
Date: Mon, 20 Jan 2014 10:05:05 -0500
Subject: [tpm] Meeting this week?
In-Reply-To: <CAAyyWE99VvOh+cdi1R+kB0Hz=Oj3_-obfNXO21zp25c5V=G=jQ@mail.gmail.com>
References: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
	<1E947A29-5A19-49E6-B629-AC2FA850E925@gmail.com>
	<CAAyyWE99VvOh+cdi1R+kB0Hz=Oj3_-obfNXO21zp25c5V=G=jQ@mail.gmail.com>
Message-ID: <9AC1198B-22A2-4101-B3E7-82FEB4487528@gmail.com>


On 2014-01-20, at 10:03 AM, Dave Doyle wrote:

> On 20 January 2014 10:01, Olaf Alders <olaf.alders at gmail.com> wrote:
> 
> I'm going to talk about working with the MetaCPAN VM as a follow-up to my October talk.  We do need that posted on meetup.com, though.  The other thing we'll need to do next week is set the calendar for the next 6 months or so.  I think we can be flexible, but the advance planning seemed to work out really well last time.  So, bring your talk ideas so that we can discuss and make plans.  Guest speakers are more than welcome.  After ingy's talk, I think we know we can do remote speakers quite nicely.
> 
> Oops.  Can I use the summary for the November talk on to.pm.org for the summary? http://to.pm.org/meetings/46/
> 

That would be perfect.  Thanks for doing that.  :)

Olaf

--
Olaf Alders
olaf.alders at gmail.com

http://www.wundercounter.com
http://twitter.com/wundercounter

866 503 2204 (Toll free - North America)
416 944 8306 (direct)


From dave.s.doyle at gmail.com  Mon Jan 20 07:12:59 2014
From: dave.s.doyle at gmail.com (Dave Doyle)
Date: Mon, 20 Jan 2014 10:12:59 -0500
Subject: [tpm] Meeting this week?
In-Reply-To: <9AC1198B-22A2-4101-B3E7-82FEB4487528@gmail.com>
References: <CANgc-ax-Dw1BWAGoEJ2aVPmzNOQ1yRydutRZyo5VYkCQ2K=1oQ@mail.gmail.com>
	<1E947A29-5A19-49E6-B629-AC2FA850E925@gmail.com>
	<CAAyyWE99VvOh+cdi1R+kB0Hz=Oj3_-obfNXO21zp25c5V=G=jQ@mail.gmail.com>
	<9AC1198B-22A2-4101-B3E7-82FEB4487528@gmail.com>
Message-ID: <CAAyyWE_or71Fcj0JGXhYhNLXZ7zg6mLO_wNpvT6wE6S4i660yg@mail.gmail.com>

Announced!

--
dave.s.doyle at gmail.com


On 20 January 2014 10:05, Olaf Alders <olaf.alders at gmail.com> wrote:

>
> On 2014-01-20, at 10:03 AM, Dave Doyle wrote:
>
> > On 20 January 2014 10:01, Olaf Alders <olaf.alders at gmail.com> wrote:
> >
> > I'm going to talk about working with the MetaCPAN VM as a follow-up to
> my October talk.  We do need that posted on meetup.com, though.  The
> other thing we'll need to do next week is set the calendar for the next 6
> months or so.  I think we can be flexible, but the advance planning seemed
> to work out really well last time.  So, bring your talk ideas so that we
> can discuss and make plans.  Guest speakers are more than welcome.  After
> ingy's talk, I think we know we can do remote speakers quite nicely.
> >
> > Oops.  Can I use the summary for the November talk on to.pm.org for the
> summary? http://to.pm.org/meetings/46/
> >
>
> That would be perfect.  Thanks for doing that.  :)
>
> Olaf
>
> --
> Olaf Alders
> olaf.alders at gmail.com
>
> http://www.wundercounter.com
> http://twitter.com/wundercounter
>
> 866 503 2204 (Toll free - North America)
> 416 944 8306 (direct)
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140120/347602e2/attachment.html>

From tpm.ats at spamgourmet.com  Tue Jan 21 09:29:43 2014
From: tpm.ats at spamgourmet.com (Antonio Sun)
Date: Tue, 21 Jan 2014 12:29:43 -0500
Subject: [tpm] How to pipe variable content to shell scripts
Message-ID: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>

Hi,

I have a script that works on xml content. A thousand time simplified
version is:

 xml_output | perl -n000e 's,(?<=">)(.*?)(?=</HttpBody>),`echo $1 | wc
-c`,eg; print'

I.e., I need to pipe the matching string ($1, content between tag HttpBody)
to an external program via shell. As you can tell, if the matching content is
too big for shell parameter length, my script will fail.

I *have to* process the matching string via the external program. Is there
any way I can get around this?

Thanks

Antonio
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140121/a917419a/attachment.html>

From fulko.hew at gmail.com  Tue Jan 21 10:19:25 2014
From: fulko.hew at gmail.com (Fulko Hew)
Date: Tue, 21 Jan 2014 13:19:25 -0500
Subject: [tpm] How to pipe variable content to shell scripts
In-Reply-To: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>
References: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>
Message-ID: <CAGuV3hNfeXF1fiUtO8H9V_tZEEpxXoq17zFLpeawsg1uAXcX=Q@mail.gmail.com>

On Tue, Jan 21, 2014 at 12:29 PM, Antonio Sun <tpm.ats at spamgourmet.com> wrote:
>
> Hi,
>
> I have a script that works on xml content. A thousand time simplified version is:
>
>  xml_output | perl -n000e 's,(?<=">)(.*?)(?=</HttpBody>),`echo $1 | wc -c`,eg; print'
>
> I.e., I need to pipe the matching string ($1, content between tag HttpBody) to an external program via shell. As you can tell, if the matching content is too big for shell parameter length, my script will fail.
>
> I *have to* process the matching string via the external program. Is there any way I can get around this?

Why not just print the extracted $1 to stdout ... that gets piped into wc ?

From mattp at cpan.org  Tue Jan 21 10:21:21 2014
From: mattp at cpan.org (Matthew Phillips)
Date: Tue, 21 Jan 2014 13:21:21 -0500
Subject: [tpm] How to pipe variable content to shell scripts
In-Reply-To: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>
References: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>
Message-ID: <CAFWy7AZ9GHDKB3oP9TdEYnNc9dfQzhewE+6bWoXG7m8g6R+8wg@mail.gmail.com>

Take a look at perldoc perlipc (search for Using open() for IPC)
Alternatively, use IO::All and something like this
perl -MIO::All -e'my $i = io(q{rev})->pipe;  $i->print(qq{foo\nbar\n});'
oof
rab

Cheers,
Matt


On Tue, Jan 21, 2014 at 12:29 PM, Antonio Sun <tpm.ats at spamgourmet.com>wrote:

> Hi,
>
> I have a script that works on xml content. A thousand time simplified
> version is:
>
>  xml_output | perl -n000e 's,(?<=">)(.*?)(?=</HttpBody>),`echo $1 | wc
> -c`,eg; print'
>
> I.e., I need to pipe the matching string ($1, content between tag HttpBody)
> to an external program via shell. As you can tell, if the matching content is
> too big for shell parameter length, my script will fail.
>
> I *have to* process the matching string via the external program. Is
> there any way I can get around this?
>
> Thanks
>
> Antonio
>
>
>
>
>
> _______________________________________________
> toronto-pm mailing list
> toronto-pm at pm.org
> http://mail.pm.org/mailman/listinfo/toronto-pm
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140121/21a22474/attachment.html>

From shlomif at shlomifish.org  Tue Jan 21 10:42:28 2014
From: shlomif at shlomifish.org (Shlomi Fish)
Date: Tue, 21 Jan 2014 20:42:28 +0200
Subject: [tpm] How to pipe variable content to shell scripts
In-Reply-To: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>
References: <CAKczvCbASHZeQDBMaDOmn-2VnW3PSv9kN3GB1v5Xao-7JgjJ0Q@mail.gmail.com>
Message-ID: <20140121204228.10119505@telaviv1.shlomifish.org>

Hi Antonio,

On Tue, 21 Jan 2014 12:29:43 -0500
Antonio Sun <tpm.ats at spamgourmet.com> wrote:

> Hi,
> 
> I have a script that works on xml content. A thousand time simplified
> version is:
> 
>  xml_output | perl -n000e 's,(?<=">)(.*?)(?=</HttpBody>),`echo $1 | wc
> -c`,eg; print'
> 

why are you doing `echo $1 | wc -c` instead of simply doing ?length($1)??
Also see http://perl-begin.org/topics/security/code-markup-injection/ and
http://perl-begin.org/tutorials/bad-elements/#calling-the-shell-too-much .

> I.e., I need to pipe the matching string ($1, content between tag HttpBody)
> to an external program via shell. As you can tell, if the matching content is
> too big for shell parameter length, my script will fail.
> 
> I *have to* process the matching string via the external program. Is there
> any way I can get around this?

If you need to do so use https://metacpan.org/pod/IPC::Run or
https://metacpan.org/pod/String::ShellQuote or
https://metacpan.org/pod/IPC::System::Simple .

Regards,

	Shlomi Fish

-- 
-----------------------------------------------------------------
Shlomi Fish       http://www.shlomifish.org/
Best Introductory Programming Language - http://shlom.in/intro-lang

Chuck Norris has actually been using Perl 6 since 1987, and has been waiting
for Larry to play catch?up.
    ? dukeleto ; http://www.shlomifish.org/humour/bits/facts/Chuck-Norris/

Please reply to list if it's a mailing list post - http://shlom.in/reply .

From tpm.ats at spamgourmet.com  Tue Jan 21 12:12:42 2014
From: tpm.ats at spamgourmet.com (Antonio Sun)
Date: Tue, 21 Jan 2014 15:12:42 -0500
Subject: [tpm] How to pipe variable content to shell scripts
Message-ID: <CAKczvCbNaFOXVXmrOHxct2bUM2NgRfO_LBhOrpnnKbadK-CyQg@mail.gmail.com>

Hi,

Thanks everyone for your replies.

On Tue, Jan 21, 2014 at 1:21 PM, Matthew Phillips wrote:

>
> On Tue, Jan 21, 2014 at 12:29 PM, Antonio Sun <tpm.ats at spamgourmet.com>wrote:
>
>> Hi,
>>
>> I have a script that works on xml content. A thousand time simplified
>> version is:
>>
>>  xml_output | perl -n000e 's,(?<=">)(.*?)(?=</HttpBody>),`echo $1 | wc
>> -c`,eg; print'
>>
>>
why are you doing `echo $1 | wc -c` instead of simply doing ?length($1)??


As said before, this is only thousand time simplified version, to stress
out what the problems is, instead of distract you with unrelated code.


> I.e., I need to pipe the matching string ($1, content between tag HttpBody)
>> to an external program via shell. As you can tell, if the matching
>> content is too big for shell parameter length, my script will fail.
>>
>

Take a look at perldoc perlipc (search for Using open() for IPC)
> Alternatively, use IO::All and something like ...
>

Previously, I thought the last resort would be bring in the big gun and do
something like the following,


   1.     open <http://perldoc.perl.org/functions/open.html>(SPOOLER,
"| cat -v | lpr -h 2>/dev/null")
   2.                         || die
<http://perldoc.perl.org/functions/die.html> "can't fork: $!";
   3.     local <http://perldoc.perl.org/functions/local.html>
$SIG{PIPE} = sub <http://perldoc.perl.org/functions/sub.html> { die
<http://perldoc.perl.org/functions/die.html> "spooler pipe broke" };
   4.     print <http://perldoc.perl.org/functions/print.html> SPOOLER
"stuff\n";
   5.     close <http://perldoc.perl.org/functions/close.html> SPOOLER
      || die <http://perldoc.perl.org/functions/die.html> "bad spool:
$! $?";
   6.

I.e, instead of using shell's "echo $1 | ", I'll write to my own file
descriptor opened by Perl just like above.

However, after trying that, I realized that it is not working.


> I *have to* process the matching string via the external program. Is
>> there any way I can get around this?
>>
>
Why not just print the extracted $1 to stdout ... that gets piped into wc ?


See below.

The problem is  that I not only need to process the matching string
via the external
program, but I also need to replace the matching string with the result of
the external process. Putting two together is where the problem is.

This is my previous code:

 perl -n000e 's,(?<=">)(.*?)(?=</HttpBody>),`echo $1 | wc -c`,eg; print'

This is what I tried just now:

  perl -n000e 'BEGIN { open(SPOOLER, "| tee /dev/tty | wc -c") || die
"cannot fork: $!"; local $SIG{PIPE} = sub { die "spooler pipe broke" }; sub
process { print SPOOLER "$_[0]"; }; };
s,(?<=">)(.*?)(?=</HttpBody>),process $1,eg; print'

Can you see what's wrong? -- the replacement would not be the result of "wc
-c", but all are 1.

So to recap,

I need to pick out a big chunk of input string (>200K), feed it to external
program (which is pipe after pipe after pipe), then replace the matching
string with the processed result. what's the proper way to do it (for big
matching chunks)?

Thanks
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140121/887613ab/attachment.html>

From tpm.ats at spamgourmet.com  Tue Jan 21 15:20:05 2014
From: tpm.ats at spamgourmet.com (Antonio Sun)
Date: Tue, 21 Jan 2014 18:20:05 -0500
Subject: [tpm] sys call length limitation
Message-ID: <CAKczvCauc4y_xCBBvDD44nbWY9LMvL70S9kAuOsXCO9aOvou_A@mail.gmail.com>

On Tue, Jan 21, 2014 at 3:12 PM, Antonio Sun wrote:

I.e., I need to pipe the matching string ($1, content between tag HttpBody)
> to an external program via shell. As you can tell, if the matching content is
> too big for shell parameter length, my script will fail.


Found out that the limitation is actually how much characters one can stuff
in between ``:

  $ echo "`cat HttpBody`" | wc -c
  238566

  $ cat HttpBody | perl -e '$s = <>; print length $s; print `echo $s`'
  238566

I.e., the echo works fine in my shell, but not ok under Perl.

Any way to increase the sys call length limitation, ie the limitation how
much characters one can stuff in between ``?

Thanks

Antonio
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140121/1860b3e9/attachment.html>

From legrady at gmail.com  Tue Jan 21 15:44:03 2014
From: legrady at gmail.com (Tom Legrady)
Date: Tue, 21 Jan 2014 18:44:03 -0500
Subject: [tpm] sys call length limitation
In-Reply-To: <CAKczvCauc4y_xCBBvDD44nbWY9LMvL70S9kAuOsXCO9aOvou_A@mail.gmail.com>
References: <CAKczvCauc4y_xCBBvDD44nbWY9LMvL70S9kAuOsXCO9aOvou_A@mail.gmail.com>
Message-ID: <CAG0DXd5D6kAh5tCnH0BrwvLZfh_EywnchFseXRY+EPeFmYGvzg@mail.gmail.com>

How about opening it as a file, and feeding the input a line at a time?
Make it a subroutine or a module, and the pain is localized.


Tom


On Tue, Jan 21, 2014 at 6:20 PM, Antonio Sun <tpm.ats at spamgourmet.com>wrote:

>
> On Tue, Jan 21, 2014 at 3:12 PM, Antonio Sun wrote:
>
> I.e., I need to pipe the matching string ($1, content between tag HttpBody)
>> to an external program via shell. As you can tell, if the matching
>> content is too big for shell parameter length, my script will fail.
>
>
> Found out that the limitation is actually how much characters one can
> stuff in between ``:
>
>   $ echo "`cat HttpBody`" | wc -c
>   238566
>
>   $ cat HttpBody | perl -e '$s = <>; print length $s; print `echo $s`'
>   238566
>
> I.e., the echo works fine in my shell, but not ok under Perl.
>
> Any way to increase the sys call length limitation, ie the limitation how
> much characters one can stuff in between ``?
>
> Thanks
>
> Antonio
>
> _______________________________________________
> toronto-pm mailing list
> toronto-pm at pm.org
> http://mail.pm.org/mailman/listinfo/toronto-pm
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140121/1d3a9a3f/attachment-0001.html>

From tpm.ats at spamgourmet.com  Tue Jan 21 15:55:37 2014
From: tpm.ats at spamgourmet.com (Antonio Sun)
Date: Tue, 21 Jan 2014 18:55:37 -0500
Subject: [tpm] sys call length limitation
Message-ID: <CAKczvCZLEApfY1SfSLDg-tFBHapqA_iznJBwP-uCHvNjtbr25A@mail.gmail.com>

No luck, the matched string is actually one big base64 encoded string
in only one line.

thanks though Tom

On Tue, Jan 21, 2014 at 6:44 PM, Tom Legrady - legrady at gmail.com <
tpm.ats.248ddc40cb.legrady#gmail.com at ob.0sg.net> wrote:

> How about opening it as a file, and feeding the input a line at a time?
> Make it a subroutine or a module, and the pain is localized.
>
>
> Tom
>
>
> On Tue, Jan 21, 2014 at 6:20 PM, Antonio Sun <tpm.ats at spamgourmet.com>wrote:
>
>>
>> On Tue, Jan 21, 2014 at 3:12 PM, Antonio Sun wrote:
>>
>> I.e., I need to pipe the matching string ($1, content between tag HttpBody)
>>> to an external program via shell. As you can tell, if the matching
>>> content is too big for shell parameter length, my script will fail.
>>
>>
>> Found out that the limitation is actually how much characters one can
>> stuff in between ``:
>>
>>   $ echo "`cat HttpBody`" | wc -c
>>   238566
>>
>>   $ cat HttpBody | perl -e '$s = <>; print length $s; print `echo $s`'
>>   238566
>>
>> I.e., the echo works fine in my shell, but not ok under Perl.
>>
>> Any way to increase the sys call length limitation, ie the limitation how
>> much characters one can stuff in between ``?
>>
>> Thanks
>>
>> Antonio
>>
>> _______________________________________________
>> toronto-pm mailing list
>> toronto-pm at pm.org
>> http://mail.pm.org/mailman/listinfo/toronto-pm
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140121/dfdbdcaa/attachment.html>

From liam at holoweb.net  Tue Jan 21 16:39:35 2014
From: liam at holoweb.net (Liam R E Quin)
Date: Tue, 21 Jan 2014 19:39:35 -0500
Subject: [tpm] sys call length limitation
In-Reply-To: <CAKczvCZLEApfY1SfSLDg-tFBHapqA_iznJBwP-uCHvNjtbr25A@mail.gmail.com>
References: <CAKczvCZLEApfY1SfSLDg-tFBHapqA_iznJBwP-uCHvNjtbr25A@mail.gmail.com>
Message-ID: <1390351175.32334.276.camel@slave.barefootcomputing.com>

On Tue, 2014-01-21 at 18:55 -0500, Antonio Sun wrote:
> No luck, the matched string is actually one big base64 encoded string
> in only one line.

So send it in one megabyte chunks.


-- 
Liam Quin - XML Activity Lead, W3C, http://www.w3.org/People/Quin/
Pictures from old books: http://fromoldbooks.org/
Ankh: irc.sorcery.net irc.gnome.org freenode/#xml


From shlomif at shlomifish.org  Tue Jan 21 21:54:41 2014
From: shlomif at shlomifish.org (Shlomi Fish)
Date: Wed, 22 Jan 2014 07:54:41 +0200
Subject: [tpm] sys call length limitation
In-Reply-To: <1390351175.32334.276.camel@slave.barefootcomputing.com>
References: <CAKczvCZLEApfY1SfSLDg-tFBHapqA_iznJBwP-uCHvNjtbr25A@mail.gmail.com>
	<1390351175.32334.276.camel@slave.barefootcomputing.com>
Message-ID: <20140122075441.58283307@telaviv1.shlomifish.org>

On Tue, 21 Jan 2014 19:39:35 -0500
Liam R E Quin <liam at holoweb.net> wrote:

> On Tue, 2014-01-21 at 18:55 -0500, Antonio Sun wrote:
> > No luck, the matched string is actually one big base64 encoded string
> > in only one line.
> 
> So send it in one megabyte chunks.
> 
> 

Yes, and one can use IPC::Run for that as I noted -
https://metacpan.org/release/IPC-Run - just open a process to accept its STDIN
and pipe it to it, and then get its STDOUT.

Regards,

	Shlomi Fish

-- 
-----------------------------------------------------------------
Shlomi Fish       http://www.shlomifish.org/
Freecell Solver - http://fc-solve.shlomifish.org/

Why can?t we ever attempt to solve a problem in this country without having
a ?War? on it? -- Rich Thomson, talk.politics.misc

Please reply to list if it's a mailing list post - http://shlom.in/reply .

From tpm.ats at spamgourmet.com  Wed Jan 22 07:25:48 2014
From: tpm.ats at spamgourmet.com (Antonio Sun)
Date: Wed, 22 Jan 2014 10:25:48 -0500
Subject: [tpm] sys call length limitation
In-Reply-To: <20140122075441.58283307@telaviv1.shlomifish.org>
References: <CAKczvCZLEApfY1SfSLDg-tFBHapqA_iznJBwP-uCHvNjtbr25A@mail.gmail.com>
	<1390351175.32334.276.camel@slave.barefootcomputing.com>
	<20140122075441.58283307@telaviv1.shlomifish.org>
Message-ID: <CAKczvCZDPhxu0yrPMXHZTrocw3Bh7OzQJHrcf_o3eNZz60QUJA@mail.gmail.com>

On Wed, Jan 22, 2014 at 12:54 AM, Shlomi Fish wrote:

> > > No luck, the matched string is actually one big base64 encoded string
> > > in only one line.
> >
> > So send it in one megabyte chunks.
>

My one line file is only 238566 bytes in size. See OP for details.

Yes, and one can use IPC::Run for that as I noted -
> https://metacpan.org/release/IPC-Run - just open a process to accept its
> STDIN
> and pipe it to it, and then get its STDOUT.
>

For a process to accept STDIN and can get its STDOUT, the answer
is IPC::Open2, because it is in the standard distribution and IPC::Run is
not (Just learnt it myself when investigating the solution). Anyway, here
is my IPC::Open2 version:

perl -MFileHandle -MIPC::Open2 -n000e 'BEGIN { sub process { $pid =
open2(*Reader, *Writer, "cat | wc -c"); print Writer $_[0]; waitpid( $pid,
0 ); $got = <Reader>; }; }; s,(?<=">)(.*?)(?=</HttpBody>),process $1,eg;
print'

And it just stops there forever, with or without the waitpid.

The problem is the big s///g loop. Standalone IPC::Open2 read/write tested
fine.

Thanks for the input.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140122/11464601/attachment.html>

From legrady at gmail.com  Wed Jan 22 08:05:30 2014
From: legrady at gmail.com (Tom Legrady)
Date: Wed, 22 Jan 2014 11:05:30 -0500
Subject: [tpm] sys call length limitation
In-Reply-To: <CAKczvCZDPhxu0yrPMXHZTrocw3Bh7OzQJHrcf_o3eNZz60QUJA@mail.gmail.com>
References: <CAKczvCZLEApfY1SfSLDg-tFBHapqA_iznJBwP-uCHvNjtbr25A@mail.gmail.com>
	<1390351175.32334.276.camel@slave.barefootcomputing.com>
	<20140122075441.58283307@telaviv1.shlomifish.org>
	<CAKczvCZDPhxu0yrPMXHZTrocw3Bh7OzQJHrcf_o3eNZz60QUJA@mail.gmail.com>
Message-ID: <CAG0DXd6x0KDh-aa4Tv2cSHJ_YE7T6oq1CX5UVoxweBw+BmtLZw@mail.gmail.com>

If you're sure the problem is in the s///, replace it with index() and
substr().


On Wed, Jan 22, 2014 at 10:25 AM, Antonio Sun <tpm.ats at spamgourmet.com>wrote:

>
> On Wed, Jan 22, 2014 at 12:54 AM, Shlomi Fish wrote:
>
> > > No luck, the matched string is actually one big base64 encoded string
>> > > in only one line.
>> >
>> > So send it in one megabyte chunks.
>>
>
> My one line file is only 238566 bytes in size. See OP for details.
>
> Yes, and one can use IPC::Run for that as I noted -
>> https://metacpan.org/release/IPC-Run - just open a process to accept its
>> STDIN
>> and pipe it to it, and then get its STDOUT.
>>
>
> For a process to accept STDIN and can get its STDOUT, the answer
> is IPC::Open2, because it is in the standard distribution and IPC::Run is
> not (Just learnt it myself when investigating the solution). Anyway, here
> is my IPC::Open2 version:
>
> perl -MFileHandle -MIPC::Open2 -n000e 'BEGIN { sub process { $pid =
> open2(*Reader, *Writer, "cat | wc -c"); print Writer $_[0]; waitpid( $pid,
> 0 ); $got = <Reader>; }; }; s,(?<=">)(.*?)(?=</HttpBody>),process $1,eg;
> print'
>
> And it just stops there forever, with or without the waitpid.
>
> The problem is the big s///g loop. Standalone IPC::Open2 read/write tested
> fine.
>
> Thanks for the input.
>
>
> _______________________________________________
> toronto-pm mailing list
> toronto-pm at pm.org
> http://mail.pm.org/mailman/listinfo/toronto-pm
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140122/bf20459c/attachment-0001.html>

From vvp at cogeco.ca  Wed Jan 22 11:04:32 2014
From: vvp at cogeco.ca (Viktor Pavlenko)
Date: Wed, 22 Jan 2014 14:04:32 -0500
Subject: [tpm] sys call length limitation
In-Reply-To: <CAKczvCauc4y_xCBBvDD44nbWY9LMvL70S9kAuOsXCO9aOvou_A@mail.gmail.com>
References: <CAKczvCauc4y_xCBBvDD44nbWY9LMvL70S9kAuOsXCO9aOvou_A@mail.gmail.com>
Message-ID: <21216.5696.794730.614130@cogeco.ca>

>>>>> "AS" == Antonio Sun <tpm.ats at spamgourmet.com> writes:

    AS> Found out that the limitation is actually how much characters
    AS> one can stuff in between ``:

    AS> ? $ echo "`cat?HttpBody`" | wc -c
    AS> ? 238566

    AS> ? $ cat?HttpBody?| perl -e '$s = <>; print length $s; print `echo $s`'
    AS> ? 238566

    AS> I.e., the echo works fine in my shell, but not ok under Perl.?

`string` (or system('string')) call in perl exec-s a shell process
passing the 'string' as argument. There is a limit on how long an
argument to exec can be, to see your current limit type:

$ getconf ARG_MAX
131072

$ grep ARG_MAX /usr/include/linux/limits.h
#define ARG_MAX       131072    /* # bytes of args + environ for exec() */

    AS> Any way to increase the sys call length limitation, ie the
    AS> limitation how much characters one can stuff in between ``??

Change limits.h in your kernel source and recompile the kernel.

HTH

-- 
Viktor

From tpm.ats at spamgourmet.com  Wed Jan 22 21:19:14 2014
From: tpm.ats at spamgourmet.com (Antonio Sun)
Date: Thu, 23 Jan 2014 00:19:14 -0500
Subject: [tpm] sys call length limitation
Message-ID: <CAKczvCYM86vegguRDkGq1kG+KJFA5mep9zs9miGjpL9aOYGWTw@mail.gmail.com>

BINGO. THANKS.

On Wed, Jan 22, 2014 at 2:04 PM, Viktor Pavlenko wrote:

> `string` (or system('string')) call in perl exec-s a shell process
> passing the 'string' as argument. There is a limit on how long an
> argument to exec can be, to see your current limit type:
>
> $ getconf ARG_MAX
> 131072
>
> $ grep ARG_MAX /usr/include/linux/limits.h
> #define ARG_MAX       131072    /* # bytes of args + environ for exec() */
>
>     AS> Any way to increase the sys call length limitation, ie the
>     AS> limitation how much characters one can stuff in between ``?
>
> Change limits.h in your kernel source and recompile the kernel.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140123/b780325f/attachment.html>

From arocker at Vex.Net  Thu Jan 23 09:34:39 2014
From: arocker at Vex.Net (arocker at Vex.Net)
Date: Thu, 23 Jan 2014 12:34:39 -0500
Subject: [tpm] blogs.perl.org cracked:
Message-ID: <5281d2411f9e020afba3f667743d715a.squirrel@mail.vex.net>


http://hackersnewsbulletin.com/2014/01/perl-official-blog-hacked-defaced-3000-users-info-leaked.html

If you used the site, you might want to do something about your password.


From olaf.alders at gmail.com  Wed Jan 29 11:04:57 2014
From: olaf.alders at gmail.com (Olaf Alders)
Date: Wed, 29 Jan 2014 14:04:57 -0500
Subject: [tpm] Hacking the MetaCPAN VM
Message-ID: <2FCFD867-5AA4-4525-95EA-607A74855634@gmail.com>

Hi Everyone,

So for tomorrow's meeting, I'll be showing you how to hack on MetaCPAN once you have the VM installed.  If you haven't got it installed and would like to have it for the meeting, the instructions are in these slides:

http://www.slideshare.net/oalders/the-metacpan-vm-for-dummies-part-one-installation

Once you have vagrant and VirtualBox installed, it's pretty easy.  I tested it this morning and "vagrant up" took me about 23 minutes on my laptop.  That includes downloading the VM, running puppet, installing some CPAN modules etc.  After that you can run "vagrant up" and your VM should start in a minute or so.

So, best to try this *before* the meeting rather than killing the hangout bandwidth by downloading stuff.

I'll have a short presentation, where we'll talk about how best to work with the VM.  Once that is finished, we can either break out into smaller groups and work on some simple bug fixes, or we can work through one as a group using the projector.

Before the social part of the evening, we should make a plan for speakers for the next 6 months.  So, please bring your ideas and wish list items.

Olaf
--
Olaf Alders
olaf.alders at gmail.com

http://www.wundercounter.com
http://twitter.com/wundercounter

866 503 2204 (Toll free - North America)
416 944 8306 (direct)


From olaf.alders at gmail.com  Wed Jan 29 14:48:32 2014
From: olaf.alders at gmail.com (Olaf Alders)
Date: Wed, 29 Jan 2014 17:48:32 -0500
Subject: [tpm] dollars for Stok
Message-ID: <824B396F-1C5E-4411-97C8-FB04A8937B76@gmail.com>

Hi Everyone,

I think I actually never brought this up before, but Mike Stok was kind enough, earlier last year to purchase the wireless router that we've been using for our meetings.  The cost of the router was about $100.  I've given him $20 to offset the cost.  So, tomorrow, if a few other people want to give him $20 or even $10 (PWYC) then we can distribute the cost evenly.  Mike is currently the keeper of the router, since we don't actually have a space where we can keep our gear locked up, so a special thanks to him for (hopefully) remembering to bring it tomorrow as well.

Olaf
--
Olaf Alders
olaf.alders at gmail.com

http://www.wundercounter.com
http://twitter.com/wundercounter

866 503 2204 (Toll free - North America)
416 944 8306 (direct)


From jztam at yahoo.com  Thu Jan 30 16:06:48 2014
From: jztam at yahoo.com (J Z Tam)
Date: Thu, 30 Jan 2014 16:06:48 -0800 (PST)
Subject: [tpm] Hacking the MetaCPAN VM
In-Reply-To: <2FCFD867-5AA4-4525-95EA-607A74855634@gmail.com>
Message-ID: <1391126808.1968.YahooMailBasic@web140305.mail.bf1.yahoo.com>

Is this going to be shared via Hangout?    Running late, and wondering if I should commute downtown now.
/jordan


--------------------------------------------
On Wed, 1/29/14, Olaf Alders <olaf.alders at gmail.com> wrote:

 Subject: [tpm] Hacking the MetaCPAN VM
 To: toronto-pm at pm.org
 Received: Wednesday, January 29, 2014, 2:04 PM
 
 Hi Everyone,
 
 So for tomorrow's meeting, I'll be showing you how to hack
 on MetaCPAN once you have the VM installed.? If you
 haven't got it installed and would like to have it for the
 meeting, the instructions are in these slides:
 
 http://www.slideshare.net/oalders/the-metacpan-vm-for-dummies-part-one-installation
 
 Once you have vagrant and VirtualBox installed, it's pretty
 easy.? I tested it this morning and "vagrant up" took
 me about 23 minutes on my laptop.? That includes
 downloading the VM, running puppet, installing some CPAN
 modules etc.? After that you can run "vagrant up" and
 your VM should start in a minute or so.
 
 So, best to try this *before* the meeting rather than
 killing the hangout bandwidth by downloading stuff.
 
 I'll have a short presentation, where we'll talk about how
 best to work with the VM.? Once that is finished, we
 can either break out into smaller groups and work on some
 simple bug fixes, or we can work through one as a group
 using the projector.
 
 Before the social part of the evening, we should make a plan
 for speakers for the next 6 months.? So, please bring
 your ideas and wish list items.
 
 Olaf
 --
 Olaf Alders
 olaf.alders at gmail.com
 
 http://www.wundercounter.com
 http://twitter.com/wundercounter
 
 866 503 2204 (Toll free - North America)
 416 944 8306 (direct)
 
 _______________________________________________
 toronto-pm mailing list
 toronto-pm at pm.org
 http://mail.pm.org/mailman/listinfo/toronto-pm
 

From mike at stok.ca  Fri Jan 31 07:47:38 2014
From: mike at stok.ca (Mike Stok)
Date: Fri, 31 Jan 2014 10:47:38 -0500
Subject: [tpm] My git prompt
Message-ID: <0D0621D4-A51F-4C6C-9089-67683A547B1F@stok.ca>

Chris commented on my prompt last night at the meeting. I'm playing with https://github.com/arialdomartini/oh-my-git and it seems to work pretty well for me so far. The meaning of the symbols can be deduced from https://github.com/arialdomartini/oh-my-git/blob/master/prompt.sh

Mike

-- 

Mike Stok <mike at stok.ca>
http://www.stok.ca/~mike/

The "`Stok' disclaimers" apply.






-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140131/8b85ae92/attachment.html>

From ioncache at gmail.com  Fri Jan 31 08:45:10 2014
From: ioncache at gmail.com (Mark Jubenville)
Date: Fri, 31 Jan 2014 11:45:10 -0500
Subject: [tpm] dollars for Stok
In-Reply-To: <824B396F-1C5E-4411-97C8-FB04A8937B76@gmail.com>
References: <824B396F-1C5E-4411-97C8-FB04A8937B76@gmail.com>
Message-ID: <52EBD316.1090108@gmail.com>

Bah I didn't see this email until just now.

I'll put up some money next meeting.

On 1/29/2014, 5:48 PM, Olaf Alders wrote:
> Hi Everyone,
>
> I think I actually never brought this up before, but Mike Stok was kind enough, earlier last year to purchase the wireless router that we've been using for our meetings.  The cost of the router was about $100.  I've given him $20 to offset the cost.  So, tomorrow, if a few other people want to give him $20 or even $10 (PWYC) then we can distribute the cost evenly.  Mike is currently the keeper of the router, since we don't actually have a space where we can keep our gear locked up, so a special thanks to him for (hopefully) remembering to bring it tomorrow as well.
>
> Olaf
> --
> Olaf Alders
> olaf.alders at gmail.com
>
> http://www.wundercounter.com
> http://twitter.com/wundercounter
>
> 866 503 2204 (Toll free - North America)
> 416 944 8306 (direct)
>
> _______________________________________________
> toronto-pm mailing list
> toronto-pm at pm.org
> http://mail.pm.org/mailman/listinfo/toronto-pm

-- 

Mark Jubenville | ioncache at gmail.com


From olaf.alders at gmail.com  Fri Jan 31 08:52:23 2014
From: olaf.alders at gmail.com (Olaf Alders)
Date: Fri, 31 Jan 2014 11:52:23 -0500
Subject: [tpm] My git prompt
In-Reply-To: <0D0621D4-A51F-4C6C-9089-67683A547B1F@stok.ca>
References: <0D0621D4-A51F-4C6C-9089-67683A547B1F@stok.ca>
Message-ID: <AA5EA2D6-5E61-4057-95A0-65449546E6A1@gmail.com>


On 2014-01-31, at 10:47 AM, Mike Stok wrote:

> Chris commented on my prompt last night at the meeting. I'm playing with https://github.com/arialdomartini/oh-my-git and it seems to work pretty well for me so far. The meaning of the symbols can be deduced from https://github.com/arialdomartini/oh-my-git/blob/master/prompt.sh

I'll have to try that out.  That's one of the nice things about shoulder surfing.  Lots of things that you would otherwise miss if you're just watching the presenter.  There was also a question about the tool I was using to track my various git repositories:  https://metacpan.org/pod/App::GitGot

Olaf

--
Olaf Alders
olaf.alders at gmail.com

http://www.wundercounter.com
http://twitter.com/wundercounter

866 503 2204 (Toll free - North America)
416 944 8306 (direct)


From jbl at jbldata.com  Fri Jan 31 09:01:56 2014
From: jbl at jbldata.com (J. Bobby Lopez)
Date: Fri, 31 Jan 2014 12:01:56 -0500
Subject: [tpm] dollars for Stok
In-Reply-To: <52EBD316.1090108@gmail.com>
References: <824B396F-1C5E-4411-97C8-FB04A8937B76@gmail.com>
	<52EBD316.1090108@gmail.com>
Message-ID: <CAGcmr9YvTmmRQwFrLak_pmW=eus66=nzwHmmca8jo6BKG3-aqw@mail.gmail.com>

I'm sending Mike $20 now via e-mail money transfer.


On Fri, Jan 31, 2014 at 11:45 AM, Mark Jubenville <ioncache at gmail.com>wrote:

> Bah I didn't see this email until just now.
>
> I'll put up some money next meeting.
>
> On 1/29/2014, 5:48 PM, Olaf Alders wrote:
>
>> Hi Everyone,
>>
>> I think I actually never brought this up before, but Mike Stok was kind
>> enough, earlier last year to purchase the wireless router that we've been
>> using for our meetings.  The cost of the router was about $100.  I've given
>> him $20 to offset the cost.  So, tomorrow, if a few other people want to
>> give him $20 or even $10 (PWYC) then we can distribute the cost evenly.
>>  Mike is currently the keeper of the router, since we don't actually have a
>> space where we can keep our gear locked up, so a special thanks to him for
>> (hopefully) remembering to bring it tomorrow as well.
>>
>> Olaf
>> --
>> Olaf Alders
>> olaf.alders at gmail.com
>>
>> http://www.wundercounter.com
>> http://twitter.com/wundercounter
>>
>> 866 503 2204 (Toll free - North America)
>> 416 944 8306 (direct)
>>
>> _______________________________________________
>> toronto-pm mailing list
>> toronto-pm at pm.org
>> http://mail.pm.org/mailman/listinfo/toronto-pm
>>
>
> --
>
> Mark Jubenville | ioncache at gmail.com
>
> _______________________________________________
> toronto-pm mailing list
> toronto-pm at pm.org
> http://mail.pm.org/mailman/listinfo/toronto-pm
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.pm.org/pipermail/toronto-pm/attachments/20140131/98b64031/attachment-0001.html>