scot hacker’s foobar blog
Things are going to get a lot worse before they get worse.
April 13, 2008

WP-Create

My WP-Mass-Upgrade script has saved me countless hours over the past year. Making sure all Birdhouse and J-School WordPress installations are managed via subversion has meant I’ve been able to wrap them all in a single shell script. When new releases emerge, I’m able to upgrade 50+ installs in a few minutes. The most time consuming part remaining was creating new installations when customers needed them. I had the process down to around five minutes, but knew the repetitive steps could be distilled into a script, so recently wrote WP-Create:

Super fast (~30 second) way to install WordPress for clients, via subversion. Yes, users can often self-install via Fantastico or similar programs, but what guarantee do you have that they’ll upgrade as soon as new releases become available? Letting users run old versions of web software is a great way to get hacked. Take control of users’ installations by checking them out via svn (with this script) and managing them with wp-mass-upgrade.

This script performs the following tasks:

  • Gather installation info
  • Create install dir and check out a copy of WordPress
  • Create database, db user, set db privs via external .sql file
  • Create WP config file
  • Create upload dir and set filesystem permissions
  • Generate array line for wp-mass-upgrade.sh

Final setup is done via browser.

Added these tools to the WordPress codex section on managing WordPress via subversion.

Music: The Staple Singers :: For What It’s Worth
April 11, 2008

Scripts and Utils

Over time, I’ve built up a handful of shell and PHP scripts, written to satisfy various itches with WordPress, Movable Type, QuickTime Streaming Server, hosting performance, etc. I’ve been tossing them into a dorky static site in case they prove useful to anyone else.

I’ve been meaning for a while to drop them into a WordPress installation - a little software library, open for discussion. Finally got around to doing that: scot hacker’s scripts and utils. Not much different from the old site, but now includes commenting, categories, search, RSS, etc. Using the badly named but very clean WP-Candy theme.

One of these days I’ll have to dig up all my old BeOS scripts and utils and give them a permanent home.

Music: Essential Logic :: World Friction
March 12, 2008

Scalable Web Ventures

Loose notes from SXSW 2008 panel Scalable Web Ventures, with:

Chris Lea Media Temple
Joe Stump Lead Architect, Digg.com Inc
Cal Henderson Badass MC, Flickr
Matt Mullenweg Founding Dev, Automattic/WordPress
Kevin Rose Founder, Diggnation/Digg Inc

This session was about much more than load balancing - scaling orgs in all directions (personnel, technique, communication), but was focused on technical scaling techniques. Amazing to see how some of the internet’s most popular properties have faced the problem in completely different ways, and how all of them basically learned by doing. You can throw, money, software, hardware, or brains at the problem, in various combinations… and these orgs have tried everything. Juicy stuff.
(more…)

CMS Roundup

Loose notes from SXSW 2008 panel Content Management System Roundup, with:

George DeMet Owner, Palantir.net
Jeff Eaton Lullabot
Tiffany Farriss Pres, Palantir.net
Mike Essl Owner Operator, mike.essl.com
Matthew McDermott Principal Consultant, Catapult Systems

The perennial question on every web dev mailing list: What CMS should I choose? Expression Engine made a huge splash at this year’s SXSW, but the Drupalites were out in force as well. This panel basically boiled down to MS Sharepoint (missed this, but not interested), EE, Drupal, and observations on a smattering of other systems. In a software category that offers around 600 choices, it’s impossible ever to represent the whole picture with anything approaching accuracy, but the conversation was still useful.

(more…)

Building Portable Social Networks

Loose notes from SXSW 2008 session Building Portable Social Networks with:

Jeremy Keith Clearleft Ltd
Chris Messina CEO, Citizen Agency
Leslie Chicoine Experience Designer, Get Satisfaction
Joseph Smarr Chief Platform Architect, Plaxo Inc
David Recordon Open Platforms Tech Lead, Six Apart Ltd

This topic has been fresh on our minds at the Berkeley J-School in our work providing guidance to news publications who are trying to focus more on community, and wondering whether to just tap into Facebook, use Ning, or create their own. The public is rapidly approaching SN overload. Are people really willing to create yet another SN profile? Will they able to re-engage their existing networks of friends? What about all of the data they’ve already stored in their existing SNs? Will BuddyPress help? OpenSocial? SocialThing? What are the technical and privacy issues we’re facing here? Is this problem solvable, or are we erecting a tower of babel?

(more…)

March 9, 2008

Responsible Web Design

Loose notes from SXSW 2008 panel Responsible Web Design with:

Greg Rewis Adobe Systems Inc
Stephanie Sullivan Principle, W3Conversions

This session was a bit elementary, focused on basic standards-compliant development practices, but stayed with it to hoover up a few teaching tips. It’s always a dilemma at these things… by the time you realize you wish you were at a different discussion, it’s halfway over, and the one you wish you were at is two blocks away. Sometimes better just to ride it out.
(more…)

Social Design Strategies

Loose notes from SXSW 2008 panel discussion “Social Design Strategies” with:

Daniel Burka Creative Dir, Digg/Pownce
Emily Chang Co-founder, Ideacodes
Max Kiesler Co-founder, Ideacodes
Joshua Porter Founder, Bokardo Design

(more…)

March 8, 2008

Expression Engine 2.0

Loose notes from SXSW 2008. Panel session on upcoming massive update to CMS Expression Engine 2.o:

Now powered by code igniter — fully objeect-oriented OSS PHP framework. The ingredients of EE left uncooked. So now EE is built on a framework. This is a big deal. Code has merged, communities are merging. Faster, easier development for Ellis Lab and for 3rd party devs. Instant increase in capabilities of both systems.
(more…)

March 6, 2008

Can BuddyPress Break Down the Garden Walls?

Obviously, it makes more sense to implement a social network on your organization’s own web site rather than sending users off to Facebook or MySpace — but does it still make sense if users have to re-create their relationship networks on each new SN they visit? A new project from Automattic - who run Wordpress.com and have a ton of experience leveraging the power of “the hive mind” - appear to have an ace up their sleeve that could address the problem. Will BuddyPress give organizations the social networking tools they need while mitigating the “walled garden” effect?
(more…)

February 7, 2008

Notes on a Massive WordPress Migration

Cdthome At the UC Berkeley Graduate School of Journalism, we use WordPress heavily as a content management system for student and organization publications, knowledge bases, student handbooks, podcast publishing systems, online magazines, etc. Over the past couple of years, I’ve found again and again that WP is not only up to the task of serving as far more than a blogging platform, it’s a great content management system for many types of sites, once you learn a few tricks.

Just wrapped up a marathon coding session, converting one of the J-School’s most popular sites, China Digital Times (CDT), from Movable Type to WordPress. We launched the new site (with a new design by Devigal) a few days ago. This was by far the most complex WordPress installation I’ve worked on, involving around 16,000 posts and 6,000 tags. As with every site launch, I learned a few things in the process. Thought I’d post some notes here for the sake of others going through a similar process.

Nutshell version: Though SixApart (who make Movable Type) claim that their static page generation approach is great for high-performance sites, we’ve reduced the time it takes to publish a new article from almost 15 minutes to a few seconds by moving from Movable Type to WordPress.
(more…)

February 2, 2008

crestmontschool.org

Crestshot-1 Birdhouse Hosting welcomes crestmontschool.org - the web site for Miles’ K-5 cooperative in Richmond, CA. I inherited the site a few months ago, and bid for the opportunity to host it at Birdhouse. Converted the site from Joomla to WordPress a month ago, then got started on a new design. The new look is based on the excellent Mimbo theme (though the end result barely looks related). Even had the opportunity to contribute a few tidbits to the WordPress Codex in the process.

Music: Nellie McKay :: Oversure
December 12, 2007

reCAPTCHA

Fascinating project. The idea is that optical character recognition processes in place at the world’s largest book digitization projects naturally make lots of mistakes, and encounter plenty of computer-unrecognizable words - especially with older books or books printed with messier inks or using less-precise fonts. Rather than having staffers laboriously read every word of every book just to correct the clinkers, reCAPTCHA puts the hive mind to work, every time a member of the public solves a captcha.

About 60 million CAPTCHAs are solved by humans around the world every day. In each case, roughly ten seconds of human time are being spent. Individually, that’s not a lot of time, but in aggregate these little puzzles consume more than 150,000 hours of work each day. What if we could make positive use of this human effort? reCAPTCHA does exactly that by channeling the effort spent solving CAPTCHAs online into “reading” books.

I’m going to replace a few captchas I’ve got in place at the J-School with reCAPTCHAs. I’d been meaning to add audio accessibility to them anyway, and reCAPTCHA has an audio option built in. Being able to contribute to book digitization is delicious gravy.

Update: Adding this video thanks to Jeremy:

Music: Gary Wright :: Our Love Is Alive
November 21, 2007

Cheap Thrills is Back

A student happened across this blog today, and nailed me on it.

“Didn’t you tell us that light text on dark backgrounds was fatiguing to read?”

“Do as I say, not as I do” doesn’t work on 20-somethings.

I knew when I tried that Darkwater thing that it was naughty. But something about the water compelled me. And now a combination of fatigue and public humiliation has compelled me back to Cheap Thrills, with a few mods, including a wider content area. And a rare foray into the red spectrum for the bg.

Feel like my old self again.

Music: Junior Kimbrough & Charlie Feathers :: I Feel Good Again
September 19, 2007

Knight Digital Media Center, New J-School Webmaster

Posted a while ago that I was going through some transitions at work, and that we were looking for a web developer. Here’s what’s going on, in a nutshell:

The J-School runs an aggressive program of multimedia training for journalists — both for students and for working journalists. We do semester-long classes in multimedia storytelling using Photoshop, Dreamweaver, Final Cut Pro, Sound Track Pro, and a range of cameras and audio equipment. Students working in teams produce multimedia feature stories by the end of the semester — most of them excellent. We also do a compressed, one-week version of that class for working journalists who come from all over the country for training, as part of a program funded by the Knight Foundation. The program has been so successful that we’ve had trouble keeping up with its expansion.

On Monday, the Knight Foundation awarded a large grant to the J-School to build the program out into new directions and begin a new channel in internet technology training for editors and managers. And while they were at it, we also became responsible for training 600 NPR journalists in multimedia skills over the next couple of years.

On September 17, the John S. and James L. Knight Foundation unveiled a $6.7 million initiative to assist news organizations facing the daunting transition to the digital world (press release). Two Knight grants - $2.8 million to the UC Berkeley Graduate School of Journalism and $2.4 million to USC’s Annenberg School for Communications - were awarded to fund the expansion of the Knight Digital Media Center’s training program for mid-career journalists. National Public Radio was awarded a two-year grant for $1.5 million to work with the Knight Digital Media Center to fund the training of roughly 600 staff members, including executives, reporters, producers and editors.

The program is accompanied by a web site containing dozens of tutorials on multimedia production software and techniques (this is the Django-based site I mentioned a few months ago). That site is slated for a huge build-out, with tons more tutorials, social networking additions, and other goodies to come, as well as a redesign that’s just getting underway now.

The short version is that I was asked to transition from my current job as webmaster for the J-School and all of its satellite sites to working nearly full-time for the Knight multimedia site. Over the summer, my office was expanded and revamped, and I’m now sharing the space with a growing group of staffers and directors of the Knight program overall.

So that’s the summary version - all very exciting :) The rub now is in finding the right person to take my previous/current job as webmaster/manager of the J-School sites. It’s an interesting mix: PHP/HTML/CSS development of custom applications and utilities, building and maintaining content management systems for student publications (mostly with WordPress, but we use other systems as well), working closely with faculty, staff and students on special projects, training, helping out in classrooms, administering an OS X Server (which I hope to move to a cPanel system before long, but that’s another story), etc. etc. It’s a jack-of-all-things-web sort of position, and we’re still looking for the just-right person. UC benefits are great, the physical environment is great, there’s access to lots of intellectual stimulation (if you can find the time, which I never can), lots of good food nearby, and a ton of variety (but look out - all that variety may kill you).

The position is still open and we’d love to hear from qualified devs who also have strong communication skills and don’t mind spreading themselves thin. If you’re burned out on the private sector and feel ready to burn yourself out on the very different - but still amazing in its own way - academic life, give it some serious thought. If not you, please pass this on to anyone you think might be a good fit!

I can’t start my new job in earnest until the role is filled — help me out here :)

P.S.: We’re an all-Mac shop — servers too — so Mac/*nix geeks are especially encouraged.

Music: Devendra Banhart :: Owl Eyes
August 1, 2007

Here Be Anthropomorphic Dragons

Map of online communities (zoom for detail):

Online Communities

Music: Porter Wagoner :: Place to Hang My Hat
June 29, 2007

WhatTheFont?

Pretty cool: A client wanted to use a font exactly like a font they had spied in another site’s banner image. I had no idea what it was. Got thinking there must be some kind of font recognition service out there. I was thinking like a forum of fontography fanatics you could pay to analyze an image for you. Googling “What’s that font?” took me to myfonts.com/WhatTheFont, which let me upload the JPEG image directly. Seconds later, it had broken the JPEG up into constituent letters and asked me to fill in the blanks for the ones it couldn’t guess. Two seconds after that it spit back 14 possible matches - and the first few hits were dead on.

Of course, the top suggestion turned out to be a $240 font they were ready to sell me on the spot. But the second suggestion was so close as to be virtually indistinguishable. And available free.

Is there nothing that infernal interweb can’t do?

Music: Frank Zappa :: The Gumbo Variations
June 19, 2007

PHP Inside Image Files

Interesting new hack in the wild - embedding PHP (or other*) code inside an otherwise valid image file. And why would anyone do that? Think of a site that allows users to upload avatars or icons or other images, then displays those images back to the public. If the site isn’t taking sufficient precautions during the upload and display stages, a hacker could create an image file with PHP embedded in the byte stream, then name their file myfile.gif.php. A site that then sloppily displayed whatever images were uploaded to it would then display the image inline, and its embedded code would be executed.

The kicker is that even if your site is doing common checks to verify that it’s dealing with a standard image file, such as running the getimagesize() function on it first, those tests may yield a false positive, since the first n bytes check out just fine. You need to verify the filename extension as well, and not serve images from a directory that’s PHP-interpreted. Other suggestions in the article at PHP Classes.

* There’s no reason this same hack wouldn’t work with .ASP or .NET or ColdFusion sites as well, or with image formats other than GIFs.

Music: Tom Verlaine :: Rings
May 10, 2007

Screen Reader for the Sighted

O’Reilly blog entries [example] now feature a small “Listen” icon to the right of each article. Clicking it causes a widget to start reading the page to you in a very smooth/natural synthesized voice. This is all real-time — it’s not like they’re having someone read and record every article on the site. A company called ReadSpeaker provides the software that makes this possible.

The obvious application is for non-sighted users. But wait - blind users already have screen readers set up, or they wouldn’t be using the web to begin with. So who is this for? Sighted users who want to close their eyes for a few minutes? That seems like a very limited application.

While pondering this, it hit me: ReadSpeaker’s widget only works on specially enabled web sites. Imagine a FireFox plugin or browser extension that, when clicked, would run the text of any page through a voice synthesizer like the one O’Reilly is using, but pipe the output silently to MP3 in the background, then load the generated file into my podcast aggregator. All day long I could “tag for voice” various web pages that I wished I had the time to read. When I sync’d my iPod before leaving for work, I’d have all that missed content on it, ready for the road.

Yes, Young Edisons, this is a business opportunity. Run with it.

Update: MacDevCenter blogger David Battino sampled the audio output of an entry and mashed it up into a little song. Says MP3 output is on the way from ReadSpeaker.

Music: Sufjan Stevens :: Chicago (Multiple Personality Disorder version)
March 30, 2007

Web Design Horror Stories

Resurrected from archives of yore: Web Design Horror Stories from circa dot-com-boom times. Mostly a chronicle of painful developer/client interactions, e.g.

early club design client:
“more fonts. use more fonts!”
“ummm… how many do you want?”
“how many do you have?”

Interesting how many designers are balking/laughing at clients’ requesting things deemed impossible or incredibly difficult at the time, which are now easy or commonplace. Seems like a lot of the frustration comes from geeks having already become web-comfortable, with sales and marketing types struggling to replicate print and TV experiences online.

The best one that I ever heard from a potential client: “You know that game Sim City? Can you make my web site do that?”

Music: Mission of Burma :: Is This Where?
March 13, 2007

Open Content, Remix Culture and the Sharing Economy

Loose notes from SXSW 2007 panel: Open Content, Remix Culture and the Sharing Economy: Rights, Ownership and Getting Paid

Eric Steuer, Creative Commons
Glenn Otis Brown, YouTube
John Buckman, Magnatune
Laurie Racine, Eyespot and DotSub
Max Schorr, GOOD Magazine

What is the business model of the Creative Commons? How is the rise of open content and alternative licensing models playing out in terms of authors getting paid?

Technorati Tags:


(more…)