Waldo Jaquith

Waldo, can you translate into common-man English what you are doing? When I go to VPAP as an “end user”, what am I not able to do that you are now going to provide?

what does ‘bulk download” mean?

Can you give an example scenario of what someone could find out with your toll that they could not find out with VPAP?

thanks!

Posted by Larry G on 29 May 2012 @ 2pm

Does Saberva cure baldness, heartburn, or erectile dysfunction?

Posted by Michael on 29 May 2012 @ 3pm

@Larry,

Realistically, there is little Waldo (and collaborators) are doing at the moment that you (or I) will likely use. That doesn’t mean it isn’t important, however.

There are three basic steps in the process right now. First,the SBE puts out really ugly data in large quantities. VPAP currently handles steps two and three in the process, of converting that data into manageable chunks, and then doing something with it (in this case, presenting it nice and tidy so that you can see how much your neighbor gave to a campaign). That’s cool, as that’s what most people want. But let’s say I came up with another use, like integrating it into a larger app of mine for campaign work. I would have to build the campaign app, but *also* build the converter that VPAP has already done to make SBE’s data manageable. Far fewer people in this arrangement go ahead and pursue that path.

Waldo (and collaborators) are building an open-source converter, in essence. So that instead of having to handle steps two and three myself, I can now just focus on step three: useful presentation of data.

To risk oversimplifying the issue, the status quo is that each inventor has to also design and implement a set of power lines to get power from the plant to their device. Waldo and crew are building a set of free power lines, thus increasing the true accessibility for anyone who wants to do something with the power the plant puts out.

Posted by Joe on 29 May 2012 @ 5pm

Oh I’m not minimizing what Waldo is up to one bit.. I will take it on face value that once it’s done it will be just as important (and elegant) as Sunshine and DeCoded.

I just wrap my little mind around what it does…

Posted by Larry G on 29 May 2012 @ 5pm

I just CAN’T wrap my little mind……

Posted by Larry G on 29 May 2012 @ 5pm

Larry, I’ll try a metaphor, because that’s my default method of explaining anything. :) The SBE is providing tons of raw earth. VPAP is sifting through that to find the gold, extracting it, melting it down, and giving away jewelry that they make out of it. I want to give others the tools to extract and melt down their own gold.

In non-metaphorical terms, the SBE is providing very large spreadsheets of campaign finance data, spreadsheets that are kind of messy (with no descriptions for what columns contains what, unnecessary data contained in some of those columns, etc.), with information spread across dozens of spreadsheets. I’m working on creating a tool that will take those messy spreadsheets, combine them all into one, big record, clean up the inconsistencies, and let them be loaded into a database. What will people do with that data? I have no idea. And that’s the point! Other people are smarter than me. They’ll have better ideas than I will have. So rather than building a completed product, I want to give people the tools to build their own completed products.

As Joe said, this is a tool that will be useless to 99.99% of people. There can’t be one person in a thousand that visits VPAP who would have the foggiest notion of what to do with Saberva. Will anybody in Virginia use this? It’s entirely possible that I will be the only person. But my wager is that I won’t be, that at least a few other people will find that this is easy enough to use that they should give it a whirl. I hope that’s right.

Posted by Waldo Jaquith on 29 May 2012 @ 7pm

That’s a help … so you’re basically automating some of the clean-up of the data and apparently there is more data than what VPAP is extracting to the end -user level.

but I’m still not entirely clear on what that other data is…. it sounds very vague….

specifics..might be what is needed for hard heads (like me).

In terms of it being useful to others.. well.. I still don’t understand exactly what data …. but I’m suspecting that it will be as valuable as GA bills and Decoded laws.

The value of what you and VPAP have done is woefully not understood by most… Only legislators, their staff and SBE and their staff really know just what a nightmare the data is and essentially what you (and VPAP) have done is “massage” it into ….Information… valuable information… totally on the cheap …without a esoteric bureaucratic process; you’ve encapsulated it inside of a computer program and database.

You’ve undoubtedly saved thousands of trees and killed dozens of potential government jobs in the process!

the big challenge with VPAP – beyond manually dealing with both electronic and paper data is timeliness – the information becomes exceptionally useful late in the election campaigns because that’s often when last minute big money tries to outrun disclosure before the election.

Posted by Larry G on 29 May 2012 @ 7pm

That’s a help … so you’re basically automating some of the clean-up of the data and apparently there is more data than what VPAP is extracting to the end -user level.

but I’m still not entirely clear on what that other data is…. it sounds very vague….

There’s really not more data at least that I know about. VPAP isn’t holding out on us. :)

I’ll give you an example. I heard from a legislator the other day, who wanted to know where on Richmond Sunlight he could see every time that a legislator had failed to vote. Well, that’s not a feature of the site, and it’s not going to be. (I mean, I guess it could be some day, but I don’t think it’d be useful to many people, and most people would draw inaccurate conclusions from that data, by not understanding what they were looking at.) With a closed-data model, that’s the end of the road—there’s no way for somebody to get that data. With Richmond Sunlight, though, I give away the raw data. Anybody can download raw vote data from the site, load it into a spreadsheet, sort by vote, and delete every vote other than “yea,” “nay,” and “abstain.” That’s pretty great, because it lets people do things that never would have occurred to me to allow them to do, or things that I don’t have the time or the interest to add to the site.

That data is on Richmond Sunlight, but not as a single lump in one place…except as a bulk download. I want to create bulk downloads of campaign finance data, so that this sort of analysis can be done by anybody with a copy of Microsoft Excel or MySQL.

Posted by Waldo Jaquith on 29 May 2012 @ 8pm

okay.. same data… different ways to slice/dice it…

thanks… :-)

SBE must, at some point, convert paper filings to electronic , eh?

Posted by Larry G on 29 May 2012 @ 8pm

[...] background-position: 50% 0px ; background-color:#222222; background-repeat : no-repeat; } waldo.jaquith.org (via @VirginiaMinute) – Today, 7:17 [...]

Posted by Waldo Jaquith - Opening up Virginia campaign finance data with Saberva. | Campaign Finance Visualization | Scoop.it on 29 May 2012 @ 9pm