Home | Forum | Unread | Sign in | Sign in | Beta? | Wiki
The Phoenyx
your roleplaying community

news > managers > main

Discussion, mostly technical, about running Phoenyx groups goes here. Hypotheticals and wishlists go in stakeholders.
Subscribe | Unread | Recent | Group options | Topic options | Post
RobertKnop
Robert A. Knop Jr.

Sun

Jan 6
2002

02:33Z

MGR: Perl/MySQL/CGI

Karen (and Carl, if you also pay attention to these issues)--

What kind of Perl/MySQL/CGI do you guys need done over there?  (I ask
this on managers rather than privately just because somebody else might
be intersted in the discussion.)  I consider myself an accomplished Perl
programmer, a comptent (or somewhat better) CGI programmer, and a
moderately knowlegdable MySQL programmer (at least from the Perl DBD
module).  I use Perl/MySQL/CGI on both www.dramex.org and
www.fudgerpg.com (e.g. the Fudge Players Database); I've also done
Perl/CGI/Postgres (DBD, same thing basically) for work.

I tend to be pretty busy, so I'd hesitate to commit to too much; my
favorite would be if you had something relatively self-contained for me
to bash away at.  However, I might be of some help.

On another issue, I saw in your blog that a couple of weeks ago you were
getting network cards and hubs and cabling so forth to have a computer
"upstairs".  Have you already run cat-5 through your house?  I did that
(to just two rooms) in my old house, but only to one room in the new
house.  For things like hooking in a laptop, I got two wireless cards;
that was much nicer, as there are no limits on where I can be in the
house, and I didn't have to run so much bloody cable....

-Rob

-- --------------------------------------------------------------
Game(s): 
Listowner tools are found at http://www.phoenyx.net/listowners/

KarenCravens
Karen Cravens

Sun

Jan 6
2002

03:40Z

MGR: Perl/MySQL/CGI

On 5 Jan 2002 at 20:33, Robert A. Knop Jr. wrote:

> What kind of Perl/MySQL/CGI do you guys need done over there?  (I ask

All kinds.

> this on managers rather than privately just because somebody else might
> be intersted in the discussion.)  I consider myself an accomplished Perl
> programmer, a comptent (or somewhat better) CGI programmer, and a
> moderately knowlegdable MySQL programmer (at least from the Perl DBD
> module).  I use Perl/MySQL/CGI on both www.dramex.org and

DBD is all I use.  I've considered doing something more direct for 
speed reasons, but so far it hasn't been worth it.

> I tend to be pretty busy, so I'd hesitate to commit to too much; my
> favorite would be if you had something relatively self-contained for me
> to bash away at.  However, I might be of some help.

Unfortunately, mostly what I need right now is someone good at 
building interfaces.  F'rinstance, the current web interface to edit 
settings is cotton-pickin' clunky (/register.html and environs) 
because it's designed to be completely independent of the data it 
modifies (that is, you can add fields to the database without 
changing the script itself), when what we really need is something 
more specialized (i.e. it needs to have a specific interface for 
modifying alternate addresses).  I also need to do some 
friendliazation work on the login stuff.

The other hot issue is web forums.  I've been looking over IkonBoard 
and YaBB and suchlike, and it wouldn't be *too* hard to patch in code 
to pipe mailing list messages into one, and pipe web-posted messages 
the other direction.  However, I haven't had time nor inclination to 
properly evaluate the web forum package itself... I installed YaBB on 
the wirebird side and the consensus there seems to be that the 
interface sucks.  And I've looked a little bit at the IkonBoard code, 
and there's apparently *no* file locking going on (start two threads 
at the same time, and they'll stomp all over each other), and that's 
just at a first glance.  There's a whole bunch more at 
 but I haven't looked any more of them over.

What we *really* want there is not so much a "web forum" interface as 
it is a "mail/news reader" interface, such that a logged-in user can 
navigate the whole thing as if he's a mail subscriber.  That's a self-
contained app, but a big honkin' one.

> On another issue, I saw in your blog that a couple of weeks ago you were
> getting network cards and hubs and cabling so forth to have a computer
> "upstairs".  Have you already run cat-5 through your house?  I did that
> (to just two rooms) in my old house, but only to one room in the new
> house.  For things like hooking in a laptop, I got two wireless cards;
> that was much nicer, as there are no limits on where I can be in the
> house, and I didn't have to run so much bloody cable....

Considering that we're running cable for not just the network, but 
phone (when we moved in, there was one (1) phone jack installed... 
we've since run two more.  Sort of.  The second one upstairs consists 
of a 50' extension cord, which runs from the bedroom into the hall, 
down the cold-air return, out through a hole punched in the duct tape 
(perhaps the only example I've ever seen of duct tape *on* ductwork) 
and spliced into a splitter lying loose on the furnace room floor.  
It was supposed to be a temporary fix, but we've lived here seven 
years or so), speaker wire, digital cable (we have DirecTV), and so 
on.  Besides, we're only cabling from a largish furnace room into the 
living room (two drops there, though), kitchen/den, and two bedrooms. 
 It's not a large house.

In theory, since we have a full basement (well, there's a crawl space 
under the back 8' of the house, but it's relatively accessible) and 
attic access, we ought to be able to run the cable fairly easily.  In 
practice, the previous owners have done some weird stuff with 
ductwork and wallboard and things.

Still not quite as strange as my mother's house.  Now, that house is 
new construction (as opposed to our 80-year-old, added onto three 
times, renovated an unknown number of times, house) built on a 
hillside, single story, with a basement that runs from about 3' deep 
at the front to a full story on the back.  There's been a room 
extension built onto the back of the house, and subsequently the area 
underneath has been enclosed and turned into a pretty nice workshop.  
She wants a phone down there.  No problemo, right, we can just tap 
into the cable underneath the house, the only hard part is getting it 
through the former-exterior basement wall, but in a pinch we can run 
it through the existing doorway since there's plenty of now-obsolute 
weatherstripping we can cut.  So I wander 
around on the slope underneath there.  Plenty of Romex, all sorts of 
CATV, hot and cold pipes... nary a smidgen of phone line.  
Huh?  I go outside and look at the utility demarcs on the side of the 
garage.  There's a CATV box there, with conduit going down into 
the ground.  Same like electrical.  That matches up with what I saw 
under the house, yep.  But the phone does the same thing.  
Huh?  I go back underneath, poke the insulation around.  There's the 
other end of the AC conduit, the other end of the CATV 
conduit... no phone.

So I go into the garage, and go up in the attic.  Sho nuf, there's 
the phone line, peeking up for just a little bit before it dives 
under the 
insulation.  Apparently the thing goes underground, *then* they built 
it into the wall going *up*.  The kicker is, the attic *ends* way 
before the relevant end of the house, since there's a vaulted ceiling 
in the kitchen (about which I could tell a funny story involving a 
can opener, but not right now).  As near as I can tell, there *is* no 
attic access for the other side of the house.

So apparently next time I'm down there, I'm bringing the 12" drill 
extension and we're going to tap it at a jack and just drill a hole 
in the floor to run a cable down, probably violating fire code in the 
process.  What I'm thinking, though, is that she should get a pair of 
cordless phones, and plug one base unit into the phone line upstairs, 
and put its handset downstairs on the second base unit (plugged into 
AC only).  Her cordless works fine down there, she just doesn't like 
having to remember to carry it down, keep it charged, etc.

But I digress.
-- --------------------------------------------------------------
Game(s): The Whole Phoenyx
Listowner tools are found at http://www.phoenyx.net/listowners/

RobertKnop
Robert A. Knop Jr.

Sun

Jan 6
2002

04:05Z

MGR: Perl/MySQL/CGI

> What we *really* want there is not so much a "web forum" interface as 
> it is a "mail/news reader" interface, such that a logged-in user can 
> navigate the whole thing as if he's a mail subscriber.  That's a self-
> contained app, but a big honkin' one.

My friend Mike hacked together a mail reader interface, which I then
hacked on somewhat further, that we use on the Dramatic Exchange.
However, just the two of us use it; it's our administrative mailboxes
that we read via the web (since the host of www.dramex.org doesn't allow
shell sessions).  As such, it's not real bulletproof, and it only
handles mail folders, and since the probability of two people
conflicting (especially when we sometimes go many months without
updating the site) is low we've never thought about file locking.

Assuming Mike agrees, I could send you the Perl module we have; it's not
terribly pretty, but it might be of some use.

Do you have any idea what they used over at Pyramid?  The true
Uber-discussion, of course, would allow mailing list, NNTP, and Web
access all to the same discussion and messages.

(Me, I'm one of those people who has yet to meet a web-based messaging
system that I like.  NNTP lets you choose your own clients, and has
clients for that.  Web-based messaging systems require you to use the
interface the server has chosen, and require you to use the browser's
text editing, which is never as good as Your Favorite Text Editor.  The
real killer, though, in browsing is that web message boards either are
all one big unthreaded mess (for instance, the new RPG.net forums are
fine, but there's too much frilly stuff all around the messages that
make it distracting), or suffer from latency for quick browseing (even
if it takes just a couple of seconds to load the next message, that gets
real annoying when you want to page through things quickly).)

> But I digress.

Indeed.

Your mom's phone lines remind me a little bit of the cable TV (and, now,
cable modem) lines in my house.  They come in on the outside from a
raised pole, go down to a junction box (which is just a box with a cable
in it, whee) at about 3' above ground, then go back up to enter in the
attic.  It runs halfway through the house in the attic, then plunges
down throuh one room (behind the door, so you don't really notice it) to
the crawlspace, then comes back up through the floor in the next room
where the TV is.

I'm sure the explanation is historical: originally, the TV was in one
room, then moved to another, and it was easier to do the moving through
the crawlspace.  (There's a BNC junction in the room where the cable
plunges through.)  When I moved in, I moved it to yet another room,
though I just redirected the crawlspace portion of the cable.  It turns
out that the arrangement we have was relatively convenient, since the
room the cable plunged through was my office, where I wanted the cable
modem.  Of course, this does mean I ran an ugly cable which is tacked up
in the ceiling corner.  I probably should have put in a junction under
the house and run the cable there in the crawlspace, but crawling around
in the crawlspace isn't a lot of fun.  Also, it's a little challenging
to get to the back of my office in the crawlspace, in beetween all the
heating/ac ducts and the wastewater pipe from the kitchen, together with
the low overhead.

Now I digress.

-Rob

-- --------------------------------------------------------------
Game(s): 
Listowner tools are found at http://www.phoenyx.net/listowners/

KarenCravens
Karen Cravens

Sun

Jan 6
2002

04:34Z

MGR: Perl/MySQL/CGI

On 5 Jan 2002 at 22:05, Robert A. Knop Jr. wrote:

> Assuming Mike agrees, I could send you the Perl module we have; it's not
> terribly pretty, but it might be of some use.

I've got a few critters that do that; MailMan is one.
 
> Do you have any idea what they used over at Pyramid?  The true
> Uber-discussion, of course, would allow mailing list, NNTP, and Web
> access all to the same discussion and messages.

Yeah, I've been thinking about using an NNTP server as the basis for 
the whole thing, but *which* NNTP server becomes a question.  INN is 
a beast, but CNews (which the apparently-outdated Rooster Book 
addresses) seems to have died the final death, and there's not much 
else out there, at least for free.

> (Me, I'm one of those people who has yet to meet a web-based messaging
> system that I like.

That's part of why I'm having such trouble with it.  But we're 
yielding to social pressure here... more people want web-based stuff, 
because browsers is all they know.

>  NNTP lets you choose your own clients, and has
> clients for that.  Web-based messaging systems require you to use the
> interface the server has chosen, and require you to use the browser's
> text editing, which is never as good as Your Favorite Text Editor.  The
> real killer, though, in browsing is that web message boards either are
> all one big unthreaded mess (for instance, the new RPG.net forums are
> fine, but there's too much frilly stuff all around the messages that
> make it distracting), or suffer from latency for quick browseing (even
> if it takes just a couple of seconds to load the next message, that gets
> real annoying when you want to page through things quickly).)

Yeah.  Carl's talked about preloading stuff, but that would 
essentially mean turning the reader into a Java app, and nobody wants 
that.

> I'm sure the explanation is historical: originally, the TV was in one

In her house, I'm sure the explanation is "It was easy when we were 
building the place.  Who cares about ease of later modification?"

> heating/ac ducts and the wastewater pipe from the kitchen, together with

Don't even get us started on the wastewater pipe from the kitchen.  
It was bad enough that when I asked the plumber afterwards whether he 
was interested in quoting us a price to redo the bathroom tub/shower, 
he backed away quickly saying that I'd be much happier doing it 
myself... yeah, *right*.
-- --------------------------------------------------------------
Game(s): The Whole Phoenyx
Listowner tools are found at http://www.phoenyx.net/listowners/

RobertKnop
Robert A. Knop Jr.

Sun

Jan 6
2002

04:44Z

MGR: Perl/MySQL/CGI

> > (Me, I'm one of those people who has yet to meet a web-based messaging
> > system that I like.
> 
> That's part of why I'm having such trouble with it.  But we're 
> yielding to social pressure here... more people want web-based stuff, 
> because browsers is all they know.

It's so, so, so sad.  Esp. when at least most of the browsers I'm
familiar with have built in NNTP clients!  How hard can it be?!?  Does
IE not?  If not, that would explain it.  But "back in the day", when
people used Netscape, you just had to configure your server and go.  I
think you could even embed nntp links in web pages.

> Yeah.  Carl's talked about preloading stuff, but that would 
> essentially mean turning the reader into a Java app, and nobody wants 
> that.

HTTP is just not designed for reading multiple short messages in quick
succession.  There *are* protocols desinged for that.  Unfortunately,
the web browser has turned into the universal tool; it's the "I have a
hammer, everything looks like a nail" mentality.  Although, I guess in
this case, it's just as much a case of "everybody has a hammer and
nobody wants to bother learning to use a scredriver, so let us beat on
those screws".  The two feed each other.

A pity.

-Rob
-- --------------------------------------------------------------
Game(s): 
Listowner tools are found at http://www.phoenyx.net/listowners/

CarlCravens
Carl D Cravens

Mon

Jan 7
2002

02:55Z

MGR: Perl/MySQL/CGI

On Sat, 5 Jan 2002, Robert A. Knop Jr. wrote:

> > That's part of why I'm having such trouble with it.  But we're
> > yielding to social pressure here... more people want web-based stuff,
> > because browsers is all they know.
>
> It's so, so, so sad.  Esp. when at least most of the browsers I'm
> familiar with have built in NNTP clients!  How hard can it be?!?  Does
> IE not?  If not, that would explain it.

No, all the major browsers have NNTP clients.  But some folks over on
Pyramid gave a very good reason for using web clients, even when they
don't really like them... centralization and restrictive proxies.  They
can sit down anywhere that has a browser and read with their personal
settings and read-message counters.  They can read from work, home, mom's
and friend's without having to install software or muck with somebody
else's browser settings.

Then there's corporate proxy servers that let *web* traffic through, but
not NNTP or POP traffic... a *lot* of people read from work and the proxy
limitations basically force anything they want to do to go through the
web.

> this case, it's just as much a case of "everybody has a hammer and
> nobody wants to bother learning to use a scredriver, so let us beat on
> those screws".  The two feed each other.

A lot of it is "everybody has a hammer, and that's the only thing we can
count on, so let's take advantage of that".

I hate web forums for two, no, three basic reasons...

1) Lack of speed...  I skim, and every web forum I've messed with is
   painfully slow, even on a fast server.

2) Speed aside, none of them have nearly the features I require for
   reading of mail/news (some of them don't even keep track of what
   messages you've read!).

3) And probably most important to me, web forums are not "push"
   technology.  I have to remember to go out and read them... even
   when I've tried to follow RPG.net threads or other stuff, I
   eventually wind up drifting away.  Mail and news come to me through
   one common interface (I read in Pine, which handles both) and I
   don't have to go looking for it...  I just fire up my reader and
   the next batch of mail/news is there for me to read.

So, when I start looking at what I'd do if I had to design a web forum, I
get really frustrated really fast... having significant features tends to
mean impacting speed even more.  (And we don't have a lot of spare
processing power... I'm afraid I'd have to install a whole new box just to
handle the web forum server.)  But I keep thinking that there's *got* to
be a way to get the browser to pre-load a page without displaying it.
(Ah-ha!  I could open a pop-up window behind the current window and keep
the next predicted content loaded there.  Might even be able to hide that
window.  It'd take a bit of JavaScript to do it, but at least it wouldn't
be a full-blown Java client, and the thing should still work with
JavaScript turned off.)  So the next screen of messages could be loading
while you're reading the current one.

-- --------------------------------------------------------------
Game(s): Fudge, Worldmaking, Fantasy Co-Editor, Phoenyx Co-Owner
Listowner tools are found at http://www.phoenyx.net/listowners/

RobertKnop
Robert A. Knop Jr.

Tue

Jan 8
2002

20:06Z

MGR: Perl/MySQL/CGI

> No, all the major browsers have NNTP clients.  But some folks over on
> Pyramid gave a very good reason for using web clients, even when they
> don't really like them... centralization and restrictive proxies.  They
> can sit down anywhere that has a browser and read with their personal
> settings and read-message counters.  They can read from work, home, mom's
> and friend's without having to install software or muck with somebody
> else's browser settings.
> 
> Then there's corporate proxy servers that let *web* traffic through, but
> not NNTP or POP traffic... a *lot* of people read from work and the proxy
> limitations basically force anything they want to do to go through the
> web.

Hmm, true.

One possible solution: places that offer both NNTP and Web access could
allow registered users to import/export newsrc files that either give
them the state of their read messages, or allow them to send that to the
web browser.  Not something the casual user will do, but it is something
that somebody who is well-versed in computers and might usually want to
use a NNTP client might do.  I suspect that once you had the multiple
interfaces implemented, adding this feature wouldn't be too hard.

> 1) Lack of speed...  I skim, and every web forum I've messed with is
>    painfully slow, even on a fast server.

Yes.  This is my primary one.  The others are not as important to me,
since this one is so annoying to me, but I agree that the other things
you list are additional main problems with web-based forums.

> But I keep thinking that there's *got* to
> be a way to get the browser to pre-load a page without displaying it.

The closest thing I've seen is forums which let you load 40 messages on
one page.  The current RPG.net one does that.  Unfortunatley, that also
means that you lose any kind of threading. (and I don't like the layout
of the new RPG.net discussion boards; the page looks too cluttered, and
is too distracting to read.)

-Rob
-- --------------------------------------------------------------
Game(s): 
Listowner tools are found at http://www.phoenyx.net/listowners/

KarenCravens
Karen Cravens

Wed

Jan 9
2002

00:44Z

MGR: Perl/MySQL/CGI

On 8 Jan 2002 at 14:06, Robert A. Knop Jr. wrote:
> One possible solution: places that offer both NNTP and Web access could
> allow registered users to import/export newsrc files that either give
> them the state of their read messages, or allow them to send that to the
> web browser.  Not something the casual user will do, but it is something
> that somebody who is well-versed in computers and might usually want to
> use a NNTP client might do.  I suspect that once you had the multiple
> interfaces implemented, adding this feature wouldn't be too hard.

Hey, I'm in favor of submitting an RFC to modify the NNTP standards 
to put this functionality automagically in the server/client.
 
> The closest thing I've seen is forums which let you load 40 messages on
> one page.  The current RPG.net one does that.  Unfortunatley, that also
> means that you lose any kind of threading. (and I don't like the layout
> of the new RPG.net discussion boards; the page looks too cluttered, and
> is too distracting to read.)

I figured ours would have something along the lines of Slash's 
formatting, where an entire thread lives on one page (broken only as 
needed for size).

-- --------------------------------------------------------------
Game(s): The Whole Phoenyx
Listowner tools are found at http://www.phoenyx.net/listowners/

Subject (required)




 
Refresh