Civic Design

Monday, November 08, 2010

New York should have piloted their new voting system

It would have been so easy. So inexpensive. So quiet. Run a mock election, learn some lessons, talk with election officials from other places about how they transitioned from one voting system to another. As Larry Norden of the Brennan Center for Justice at NYU remarked on WNYC on November 2, "49 other states have done this before us." But the New York Board of Elections did none of this, and the changing of voting systems seemed to be on the legislative agenda not at all. Instead, the Board and all the counties in New York did the equivalent of live usability testing in the primary in September and November.

New York has known for several years that the state would have to ditch the generations-old mechanical lever machines for new voting systems. There was plenty of time to prepare for this historic transition. And there were plenty of people around who could have helped. Key people offered. And, there are plenty of resources the state board of elections could have tapped. There are evidence-based federal guidelines for election design. There are thousands of experts on changing voting systems across the US. Oh, and there are dozens of local design experts who the state and city boards of elections could have called on.

But none of that happened. Why? For the purposes of narrowing the discussion, let’s just focus on ballot design.


Why the New York ballot is a disaster
While on its face, ballot design seems like a simple thing to do well, it is actually a complex mix of constraints and interactions. There's the fact that the software for creating ballots is usually so difficult to use that many jurisdictions outsource it back to the voting system manufacturer. Next, most people who design ballots are not trained in design, they're trained to be election administrators. Part of that is controlling costs. Local election officials are smart, well intentioned people. But if it comes to deciding between expanding a ballot to two cards to make it easier to read and use, or keeping everything on one card because it saves the county money on printing (and mailing) by making the font smaller and the spacing tighter, many election officials are going to go with smaller, tighter type.

It would be completely unfair to blame the design of the New York ballot on local elections officials, though. In fact, a lot of ballot design is out of control of the local elections official. The responsibility here lies with regulations, history, and bureaucracy. Typefaces and wording for instructions are often specified in election regulations. Community history and norms make up traditions that are embedded in local culture. And, many ballot design decisions are made at the state level, usually without consideration of usability data. Let’s talk about just those factors for a moment.


Some design problems are embedded in legislation
According to New York election law, the ballot must be "full face". That means that everything to be voted on must appear on one side of the ballot. (The November ballot actually violated this; the ballot questions were on the back of the candidate contests.) There's some logic to this, I suppose; New Yorkers have been voting on lever machines for a long time. A major change in the look of the ballot might throw voters off completely. But I doubt that.

In addition, the instructions are legislated in the election code. This is very common across the US. Some states are more flexible on this than others, even though the wording is legislated. New York codified its instructions without regard to the final ballot design. And the final ballot design didn't take into account what the legislated ballot instructions must say. Instruction (2) reads: “To vote for a candidate whose name is printed on this ballot fill in the oval above or next to the name of the candidate.” But the bubbles for candidates appear below the names.


New York sample ballot for November 2010




Tradition also influences ballot design
New York uses fusion voting. That means that although one party nominated a candidate, other parties can endorse a candidate as theirs. For example, on the 2010 midterm ballot, Andrew Cuomo appears as the Democratic candidate for governor, but also as the nominee of the Independence party and Working Families party. If you really want Cuomo to be governor, might you mark him in all three places? That’s called a double vote. But only one counts.

Mechanical lever machines prevent double voting. Officials doubted that voters would make this mistake on paper ballots, but there’s nothing to prevent it happening. In fact in a large usability test on October 9, 2010 sponsored by UPA, AIGA's Design for Democracy project, and the Brennan Center for Justice at NYU, we found that double voting was not fiction. What about taking away fusion voting to prevent these kinds of voter errors? Fusion voting is legislated, but it is also deeply embedded tradition. Removing the option probably would have devastating effects on smaller but highly active political parties.


Bureaucracy gets in the way
The usability test on October 9 was conducted by a group of concerned volunteers, for free. Why didn’t the New York Board of Elections do a test? This is a mystery. The Brennan Center and UPA offered months ago, but the BOE declined, saying that they had spent all the money they were going to spend on the new systems. And, though the board had been warned about likely problems, the state BOE entered the state primary election in September 2010 in denial. That Election Day clearly showed the predictions of problems to be true, and fusion voting wasn’t even part of the ballot in the primary. In response to appeals for simple, inexpensive remedies, the Board said it was too late to make changes that they said required the voting system to be recertified and too late to make other changes because of how close the November federal election was.




What the design community can do about it
One of the wonderful things about working in election design is how easy it is to affect immediate, positive change. There is a woeful lack of involvement from the design community in election UX. Your country, your state, your town all need you. Here’s what to do:

Meet your local elections officials. Mayor Bloomberg and Governor Cuomo are not going to come to you. You have to go to them.  Let yourself be known. If you live outside New York County, get yourself to the county election department and introduce yourself. Ask for time with the election director. Ask questions, and then listen. Make yourself available to them without expectation of monetary profit. (There’s very little funding for design and testing in local governments right now.)

Do civic duty. Sure, you vote in every election, but have you ever worked an election? There is so much to learn by being a poll worker about how election administration works and how voters vote. Immersion holds many lessons.

In most communities, there are also citizen advisory committees that work on voter outreach and voter education. When I lived in San Francisco, I was on a committee that wrote summary digests of ballot measures for the Voter Information Pamphlet.

Yes, these things can take time away from work. But what’s more important: a little less income, or doing your part for world peace?

Read the guidelines. There’s a lot of guidance on how to design for elections. You might start with Marcia Lausen’s book, Design for Democracy. It gives a high-level very Design view of ballot design. The Brennan Center’s report, Better Ballots gives 13 case studies that show that specific ballot design elements may have affected election outcomes. AIGA’s Design for Democracy project has compiled a very good collection of tools and resources. Read through what’s there.

Get to know the LEO Usability Testing kit.
The Usability Professionals’ Association realized years ago that there weren’t enough usability specialists to test all the ballots out there. What to do? Give local election officials (LEOs) tools for doing testing on their own. The LEO Usability Testing Kit is in wide use in many counties across the US, but it’s also a great tool for volunteers to use to run mock election usability tests.

Make election UX a topic at local community meetings. After you get your feet wet in the election UX world, tell the story to other designers. Have them vote a badly designed ballot and talk about that experience. Encourage them to get involved.



Where the New York ballot is going from here
After a little media attention for sloppy design that might have prevented voters from voting as they intended, counties and states usually get the message. Florida is no longer the poster child for messy elections, Ohio inherited that honor for the 2008 presidential election. Now, its new sibling New York is competing strongly to outdo Ohio. Let’s hope that New York wakes up and reforms its election board and administration.

In the meantime, the New York State Inspector General conducted an investigation of the reported issues with the September 2010 primary. As Larry Norden of the Brennan Center for Justice wrote, "It is remarkably well-written, and it is sinister, sad and comical all at once." 

After the primary, the Brennan Center filed a law suit against the New York State Board of Elections, "over a discriminatory New York State policy for counting political party votes under a procedure known as 'double voting.' ... The policy unfairly penalizes both the voters and the minor parties they support." You can read a bit about the suit on the Brennan Center web site.

- Dana Chisnell
The opinions expressed here are Dana's only, and not the officially sanctioned position of UPA.

Labels: , , , ,

Monday, August 11, 2008

Call to action: Volunteer to test or be a poll worker

Much of the content on this blog comes from people on the Usability Professionals' Association (UPA) Usability and Voting Project. We're gearing up now to help local elections officials test their ballots and other election materials for usability for the November election.

Ballots are being defined and designed now. Most have to be completed within a few weeks.

Want to help test ballots for usability? Step up! We'd love to have you. Questions? Write to us at voting@usabilityprofessionals.org.


In the meantime, a few pointers about working on elections.

1. Usability and Voting is non-partisan
First, and most importantly, this is a non-partisan effort. Whatever our personal political beliefs, they stay separate from this work. You can read our ethics guidelines for usability and design professionals on http://www.usabilityprofessionals.org/civiclife/voting/ethics.html

2. Sign up to be a poll worker
We know that it’s hard to find time to volunteer. But there is something that everyone in the US can do that takes just a day (or part of a day) of your time. Sign up to be a poll worker. With record turnout expected this November, new poll workers are needed more than ever to meet the target of 2 million poll workers set by the EAC. To find out how to be a poll worker, contact your local elections office or visit http://www.eac.gov/voter/poll%20workers

3. Volunteer to help your local election officials with usability testing
One way to help ensure that ballots get a good usability test is to volunteer to run the test yourself. If you do:

  • Please use the LEO Usability Testing Kit. Every election official has received a printed copy of the report, and it would be useful especially in this first wave -- if we all used the materials they have already been introduced to, and spoke with one voice. Plus, your feedback will help improve the Kit. http://www.usabilityprofessionals.org/civiclife/voting/leo_testing.html

  • Remember that election officials are in the middle of their busiest, highest pressure work period – final preparations for a highly volatile presidential election. This is a time to offer to help, not offer blame.

  • Don't be discouraged if they say "not this time" offer to contact them again in the spring for the off-season elections.

  • Before you make any recommendations, take a look at the EAC's Best Practices Guidelines for ballot designs as well as the recommendations in the Brennan Center report, Better Ballots. But, don't be surprised if you are told that it "can't be done". Not only do many voting systems have limitations that can get in the way, but elections are governed by state laws and regulations, as well as expectations from current practice. See http://www.eac.gov/election/effective-polling-place-designs and http://www.brennancenter.org/content/resource/better_ballots/

4. Keep in touch
Let us know if you have any contacts with elections folks. We're trying to keep track of any usability work, so we can get a full picture of the impact of our efforts.


We'll be happy to talk to anyone who is interested, and support them in any way we can. Our goal is to make better design and usability part of every aspect of elections, integrated into the normal processes.


Links:
LEO Usability Testing Kit
http://www.usabilityprofessionals.org/civiclife/voting/leo_testing.html

Ethics guidelines for usability and design professionals working in elections
http://www.usabilityprofessionals.org/civiclife/voting/ethics.html

Information about being a poll worker
http://www.eac.gov/voter/poll%20workers

EAC Effective Polling Place Designs
http://www.eac.gov/election/effective-polling-place-designs

EAC Election Management Guidelines
http://www.eac.gov/election/quick-start-management-guides

Brennan Center for Justice report Better Ballots
http://www.brennancenter.org/content/resource/better_ballots/

UPA’s Voting and Usability Project

http://www.usabilityprofessionals.org/civiclife/voting/
voting@usabilityprofessionals.org.

Labels: , , , , ,

Friday, July 25, 2008

Brennan Center recommends usability testing of ballot designs before Election Day

In the Brennan Center's review of ballot designs and instructions for its report Better Ballots, the task force writing the report found that

  • hundreds of thousands of voters have been disenfranchised by ballot design problems
  • there has been little or no federal or state guidance on ballot design that might have been helpful to elections officials who define and design ballots at the local level
  • usability testing is the best way to ensure that voters can use ballots to vote as they intend

The recommendation to include usability testing in the ballot design process is a major revelation in the election world. The UPA Voting and Usability Project has developed the LEO Usability Test Kit to help local elections officials to do their own simple, quick usability tests of ballot designs.

Labels: , ,

Monday, May 28, 2007

Developing the LEO (local elections officials) usability testing kit

A little more than year ago, Whitney Quesenbery had a crazy idea: What if someone taught local elections officials to do their own usability testing of ballots?


The MSU-UPA working group

Whitney called together a few people who thought it was an interesting idea. In April 2006, the “LEO kit” was born. LEO stands for Local Elections Official.


We worked together over a couple of days at Michigan State University’s Usability and Accessibility Center to scope out a usability testing “kit” to be used by people who have no specific training on usability or human factors engineering.

Then we went off to work on things separately and remotely, trading drafts and review comments through a wiki.


Designing a test protocol for people who aren’t usability professionals

We had a lot of questions:

  • What do LEOs need to know to be able to conduct an effective usability test?
  • How can we help LEOs understand the immediate and rippling benefits of usability testing their ballots?
  • How can we give LEOs a great tool without adding significantly to their workloads?
  • When in the elections cycle should ballots be tested?
  • How many participants should LEOs include in each test?
  • What constraints do LEOs have?

The pieces of the kit

We eventually agreed on three pieces for the kit:

  • generic test plan that acts like a “how to” for planning usability tests of ballots
  • template session script, which provides direction for moderating individual usability testing sessions, complete with what to say, when
  • final report template to use to report results internally to elections departments or to the public.


We hope you’ll try them and send us feedback on how they worked for you. We will incorporate comments and post revisions regularly. If you want to be notified about updates to the LEO kit, let us know.

Labels: ,