IVR Challenges

From my first week at Capital Metro, I heard about the issues facing our IVR system. While there was no shortage of anecdotes, the bigger challenge was figuring out the root cause of the problems. There was no point in putting a band-aid on the IVR when there were structural problems with the system. However the way issues were reported did not immediately reveal the source of the problems. And to further complicate things the IVR is not a single computer running in a closet somewhere. The system is actually made up of multiple phone related servers, the phone system (both on your end and ours), scheduling data stored in one database, and multiple route and reservations data stored in other databases. All told, the IVR system is made up of about a dozen vendors’ products that all have to work together to present the data that Capital Metro puts into it. So when a problem occurs we have to go through the following steps before we can figure out what is causing the problem.

  1. Understand what problem is happening
  2. Reproduce the problem consistently
  3. Trace the problem back to the one or more systems causing the problem
  4. Get the vendor(s) responsible for that/those system(s) to take ownership of the problem and solve it

The easiest problems to solve are actually content problems (when we enter data wrong or incompletely). They aren’t any easier to find, but at least we are the only ones accountable for these fixes. The issue here again is the size of the system, with the tens of thousands of data elements that have to come together to make it work, we are constantly finding items that need to be fixed.

As I mentioned earlier, many of the complaints about the IVR were anecdotal (certainly valid, but not specific enough for us to reproduce and therefore be able to fix). However, in recent meetings with the riding community (both at ACCESS and Customer Service Advisory Committee group meetings) I’ve captured the specific issues I’ve heard and we’ve been prioritizing them to address the underlying issues. In my next blog I will lay out the priorities and the next steps that we will be undertaking to make sure the IVR gets better. However, in the remainder of this post I am going to list the issues that we have captured so far so that I can fufill the promise I made to the ACCESS and CSAC groups a few weeks ago (I haven’t forgotten):

http://www.capmetro.org/blog/IVR_Issue_Log.XLS

Given the length of the list and the limitations of this blog, I am going to try to link to the Excel Spreadsheet. If this process doesn’t work, we will regroup and try this a different way.

3 thoughts on “IVR Challenges

  1. M1EK

    That’s kind of glossing over the issue. IVR recognition is poor – this can be tested by simply calling in from a cell-phone on the street and running through some test scenarios and seeing how often it recognizes the correct answer.

    Very easy to reproduce (or deny).

  2. Kirk Talbott

    Won’t deny it for a minute. The speech recognition has been atrocious in some cases (the recent English/Spanish prompt was particulary bad). But in researching the cause (turns out we have the same speech recognition engine that other companies with no issues use) we uncovered the real culprits (there is more than 1 and it won’t be simple to fix). The problem is not with the technology per se, but with the way we have employed it. I hope to go into more details in my next post.

    But the most important thing is that we recognize the issue with the speech recognition and we are striving to address it.

  3. Roger

    I would LOVE a useful Cap Metro IVR system!

    I’ve tried the system at least ten times, and not once did I get anywhere close to a correct final result. The results were far worse than atrocious – they were a complete failure. As horrendous as the Spanish prompt was, the always-wrong IVR response was worse. I don’t understand why it’s so bad; the IVR systems for many other service providers (Continental Airlines, Wyndham hotels, etc.) are much, much more accurate and easier to use.

    (And, by the way, though this post is kinda rant-y, I was extremely calm, patient, and tolerant during my many attempts to use the Cap Metro IVR system.)

    Given that Cap Metro schedules (understandably) only include times for a few stops, it’s often necessary to guess, even with a schedule in hand.

    (Thank heavens for Google – when I can get Internet access – it has a much, much better / easier interface than Cap Metro’s website for getting times.)

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s