From wiggins at danconia.org Thu May 20 19:02:41 2010 From: wiggins at danconia.org (Brian J. Miller) Date: Thu, 20 May 2010 22:02:41 -0400 Subject: [Boulder.pm] Multi-process caching In-Reply-To: <19386.29391.564786.221342@r1.bivio.biz> References: <19386.29391.564786.221342@r1.bivio.biz> Message-ID: <4BF5E9C1.5090100@danconia.org> Rob Nagler wrote: > We are having some performance issues for some of our larger apps. We > have a Postgres table (Bivio::Biz::Model::RealmRole) which needs to > get access frequently, and is written relatively infrequently. We > need some sort of in memory cache. > > I took a look at the IPC::* modules, and none of them seems so > brilliant. Before I go diving into performance testing each of them, > I was wondering if anybody on this list had opinions about which is > the most reliable. > > We need to get to <100ms for accessing the data, which for our larger > apps, is about 500KB serialized with Data::Dumper. Deserialization is > too expensive (250ms). > > We are also thinking about going with a *dbm module or perhaps > Berkeley DB. There are about 800K rows, which is really a two-level > tree (realm, role), which is why the serialization is so compact. I > don't know how dbm/DB work with this size of data. > > So I'm looking for experience with these technologies from a > reliability (first) and performance (second) standpoint. > > Thanks, > Rob > Only 1.5 months later, but looked at memcached? -- Brian J. Miller End Point Corp. http://www.endpoint.com/ brian at endpoint.com From nagler at bivio.biz Mon May 24 12:27:10 2010 From: nagler at bivio.biz (Rob Nagler) Date: Mon, 24 May 2010 13:27:10 -0600 Subject: [Boulder.pm] Multi-process caching In-Reply-To: <4BF5E9C1.5090100@danconia.org> References: <19386.29391.564786.221342@r1.bivio.biz> <4BF5E9C1.5090100@danconia.org> Message-ID: <19450.54030.640829.643087@r1.bivio.biz> > Only 1.5 months later, but looked at memcached? That would be interesting if we had a multi-process problem. At this stage we don't so we went with Storable which has improved performance dramatically. Rob From wpiencia at thunderdome.ieee.org Mon May 24 14:22:24 2010 From: wpiencia at thunderdome.ieee.org (Walter Pienciak) Date: Mon, 24 May 2010 15:22:24 -0600 Subject: [Boulder.pm] [szabgab@gmail.com: [pm_groups] The Perl Survey 2010 is now live] Message-ID: <20100524212224.GA28553@thunderdome.ieee.org> For those so inclined. Walter -------------- next part -------------- An embedded message was scrubbed... From: Gabor Szabo Subject: [pm_groups] The Perl Survey 2010 is now live Date: Thu, 20 May 2010 08:34:37 +0300 Size: 5019 URL: