Fiserv
Thoughts & Comments
The Stress Test Is Useless. Or Worse.
Lots of possible outcomes. None of them good.

Thomas Brown  ( about me )
Posted 04/17/2009
bankstocks.com
tbrown@bankstocks.com

Are you tired of hearing about the stress test yet? I know I am.

Actually, I was tired of it from the moment Tim Geithner presented his crazy plan at the start of the year. The idea, recall, is that the administration is going to “fix” the banking system by subjecting the country’s biggest banks to a series of dire what-if scenarios that assume ballooning unemployment and further GDP contraction. The banks whose balance sheets look the weakest under those scenarios will have six months to raise new capital. If they can’t, they can convert their TARP preferred investment into common or raise new capital from the government under stringent terms. Voila!, the official thinking goes, banking system saved.

Ugh. President Obama himself is said to have hatched the idea, which is unfortunate. If it had been anyone else, then presumably Larry Summers or Tim Geithner would have pointed out that, um, regulators already stress test banks all the time in the course of overseeing the industry. And those on-site regulators already know a lot more about those banks than any stress-testers in Washington would, and can tailor their tests accordingly. What’s more, it’s a terrible idea to make the test results public, since that might cause unnecessary anxiety among depositors and even, in an extreme case, cause a run for no reason.

But the president must have hit Larry and Tim with one of those visionary-looks-off-into-the-future of his, so stress-test it was. The banks submitted their data weeks ago, and were instructed by the regulators to keep mum on the process. The entire financial industry has been on tenterhooks ever since.  

As you have perhaps gathered by now, I can’t think of a single, positive thing to say about the stress test concept, the process by which it will be carried out, or outcome it will produce, no matter what the outcome is. Nothing good can come of this and, under certain, non-far-fetched scenarios, it might end up making the banking system's problems worse.

Let’s take a look at what’s so wrong about this misbegotten idea:

  1. The underlying premise of the test is simply mistaken. From what I gather, certain economists reportedly convinced President Obama that the problem with the economy is that banks are refusing to lend, and are instead hoarding capital in order to shore up their wobbly balance sheets. The president seems to think, therefore, that if the banks are force-fed new capital, they can expand their balance sheets and resume lending, which would in turn help the economy begin to recover.

    There’s just one problem with this thread of logic: its basic premise is wrong. The problem with the economy isn’t that banks that aren’t lending, it’s that the non-banks that make up the “shadow banking system” have gone into forced hibernation. We know the administration knows this, since it has expanded the TALF program, which is designed to help jumpstart the securitization markets on which the non-banks depend for their funding.

    As for the banks, well, the chart below tells the tale. It was developed by my old partner, Robert Albertson, now the chief strategist at Sandler O’Neill, and it shows bank loan growth during the current recession compared to the four previous recessions. If anything, bank lending has stayed remarkably robust in the face of shrinking demand.



    Conclusion: the economy’s problems are not the result of banks’ unwillingness to lend. Banks are more than eager to make loans in areas they desire and understand.

    So the worst thing about the stress test is that the underlying reason for carrying it out in the first place, to give the banks new capital so they’ll re-start their lending, is simply wrong.
     
  2. The name “stress test” was poorly chosen. Say the word “test,” and you imply that there are “right” and “wrong” answers and that, in turn, some banks will pass and others will fail. But these sorts of exercises shouldn’t work that way. Those of us on the outside of banks (and even some on the inside) have a hard enough time predicting a bank’s earnings and balance sheet changes one quarter ahead of time, let alone what might happen (under hypothetical conditions, no less!) over the next eight quarters.

    Rather than refer to the exercise as a stress test, Geithner should have, in my view, described it as a “sensitivity analysis,” since its output will have none of the precision that one typically associates with a test result.

    And in fact, many bank analysts (us included) perform such sensitivity analyses all the time. But if you compare one against another in any kind of detail, you won’t be impressed with their rigor, and will quickly be struck by the fact that, of necessity, conducting them requires the piling of one assumption on to another. The table below summarizes the cumulative loss forecast for large U.S. banks, as estimated by several analyses:



    At first glance, the broad range of estimated losses may not seem like a big deal. If you throw out the high number and throw out the low number, you’re left with an estimate that centers around 9% or so, and you may come away with a sense that these numbers might actually have real meaning. That would be a mistake. The similar bottom-line numbers mask huge differences among analysts as to loss rates for the basic building blocks of the analysis: loan type.
     
    The next table illustrates what I’m talking about. It breaks the cumulative loss estimates above down by loan type.

     
     

    Yikes! There are some huge differences. For instance, S.C. Bernstein sees cumulative losses in construction and development loans of 9%, while the private equity investor assumes 25%. That’s almost three times higher. Meanwhile, Deutsche Bank’s assumption of 28% cumulative losses in home equity is quadruple Bernstein’s 7% estimate.

    Who knows which are right? Nobody, that’s who. My point is that this sort of stress test/sensitivity analysis, at this point in the cycle, is a very, very crude tool. And what makes it even worse, none of these analyses adjust for unique characteristics of individual banks, such as their geographic footprint, historical record, or current performance. Neither, presumably, will the stress-testers in Washington.

    But if the Treasury Department chooses to modify the stress test results individual banks provide to conform to industrywide averages by loan category, they will be committing a huge analytical mistake.

    We think our approach is more rigorous. In particular, we adjust for the unemployment rate in the given bank’s footprint, the historical credit experience of the bank, and differences in loss timing by type of loan.

    However, even after we do all this we’re still left with, necessarily, a very crude predictor of future losses. The only reason we go through the process at all is that it can be helpful for relative ranking purposes and for comparison as quarterly results are reported.

    In any event, the name “stress test” implies a level of precision for predicting future losses and earnings that simply does not exist. I only hope the Treasury doesn’t overly adjust the banks’ own numbers and force unneeded capital raises based on the outcome.

  1. The Treasury Department’s plan for disclosing the details of the stress test results is confused at best—and might be catastrophic. At this point, all we know is that regulators have told the banks not to talk about the stress test results on their quarterly conference calls. The Treasury and the regulators themselves seem to be confused about what they will eventually disclose.

    I don’t blame them. It’s currently illegal to disclose the results of a bank examination or a bank’s CAMELS rating—and for good reason. As former OCC head Gene Ludwig told the Wall Street Journal on Wednesday, “
    You can create a run on a bank pretty quickly," by making a bank’s test results public if they’re less than stellar. Even though, as we’ve seen, those results can be based on wildly speculative assumptions.

    I frankly don’t see why the results of individual bank stress tests should be disclosed, since those results figure to be even more arbitrary than the (already confidential) tests banks undergo as part of their annual examinations.

    Once a year, however, bank regulators do share the results of their Shared National Credit reviews in aggregate. I expect a disclosure along those lines, at the very least. As it is, the Treasury Department has painted itself into a corner with all its hullabaloo about the stress tests, and its emphasis that they are the cornerstone of the administration’s plan to help the banks and the economy. So the Treasury will have to disclose something. The more high-level and less bank-specific it is, the better. Otherwise, the government could conceivably be putting some perfectly healthy institutions at real risk.

    The stress test was a bad idea in all respects: its core premise, its misleading name, the promise of transparency, and the dilemma over the disclosure of results. My advice to the administration: disengage from the process as quickly and quietly as politically possible.

What do you think? Let me know!


  Add your comment

 

 

Staub Posted On 4/18/2009 11:18:03 PM

As always lately the handling of this "stress test" and the subsequent lack of clarity in the who what when and where of the results and makeup have been frustrating. Even more frustrating is the constant bad news that is coming out and the bank stocks continuing to go higher. Did we really solve all the problems or have clear sailing ahead in just the few last weeks?

dr. bob Posted On 4/19/2009 10:37:09 AM

As Obama said last week, rich guys like him are lucky. He is right, anyone who wrote 2 self congratulatory books before the age of 50 and made $2 million bucks, followed by a $500k rewrite for children along the lines of Main Kampf for kiddies IS lucky. Such great fortune made from very few hours of contemplating one's own short and remarkably unremarkable life has no perspective on how hard it is to actually make money. He has simply accepted money. With no business experience and very few credible jobs during his entire life it is no surprise that he has bad ideas like the stress test. What he should test is the stress on the economy created by untested ideas from inexperienced leaders who are surrounded by sycophants.

Joe Vaez Posted On 4/19/2009 1:20:14 PM

Tom, as an avid reader of your thoughts and comments, I have always found your remarks as fair, well focused and for the most part extremely accurate. I must admit; however, that there was one commentary in the past that I strongly disagreed with, and that was your personal opinion on Tim Long. As a former banker and regulator I view Mr. Long as a professional regulator with impeccable integrity and strong common sense. In regards to your observations regarding the infamous "stress test" I could not agree with you more as to the negative implications of such desriptive word and the systemic harm that publications of the results of this hypothetical guessing game could have on the banking industry as a whole.

tom brown Posted On 4/19/2009 2:55:22 PM

Joe, Aren't you a former regulator? Yours is the only positive comment about Tim Long i have ever received and i have received many!

Commoncitizen Posted On 4/20/2009 8:46:58 AM

For those of us who still have jobs which permit some discretionary spending, my priorities have been keeping debt off the books, saving for retirement, maintaining my home, doing what I can to help my kid and grandkids, and an occasional pleasure such as a long awaited hunting trip with my son. The key to recovery is to push the fear factor down - something the media seems to be unable to do, find a way to get the jobs market moving again, and create a climate of stability so that people will not be so afraid. Stress testing is a sham by the current administration to gain further control of the financial structure of this country. They have already put a muzzle on the banks themselves not to discuss what is going on which leads to more uncertainty. Thank you. Commoncitizen

Erich Riesenberg Posted On 4/20/2009 10:39:01 AM

Amen. The stress tests and mark to market accounting are destroying the world. Please keep focusing on this! Please!

jsc173 Posted On 4/20/2009 11:09:59 AM

I cannot envision a single stress test that anyone could apply to BofA, Citi or JPM (or any other insitution as diversified as they are) that could possibly result in a fair comparison of one to the other. If you've read what Treasury has said about methodology -- stress the portfolios for increases in interest rates, unemployment, etc. -- how do they that do that for the banks that lend in over 100 countries to global corporations, local businesses and millions of consumers? Would they really have us believe their model takes into consideration all the relevant variables in every country? In every portfolio? In every customer group? And, if so, who are these geniuses? The collective brainpower amongst Wall Street analysts has never gotten this one right, so we are to accept this "black box" invented by the Treasury as the ultimate risk oracle? Good grief!

Kevin H. Stecyk Posted On 4/20/2009 11:40:34 AM

Any thoughts on this blog post making the rounds: http://turnerradionetwork.blogspot.com/2009/04/leaked-bank-stress-test-reults.html The author claims to have seen the stress tests results and they are not pretty.

Chilly Posted On 4/20/2009 11:53:20 AM

I'm with jsc173. The whole debacle has stemmed from an inability to measure risk correctly. Our paternalistic regulatory approach limits market access to information, because supposedly the regulators have it all under control. It's OK to not be perfect, unless you've built a system that requires it. We're being told that THIS TIME the regulators will get it all figured out? Thanks for nothing. (Off on that tangent: there's a good case to be made that secrecy around bank health is a huge problem in the system. Protecting depositors and bondholders is a natural follow-on from that approach: if they can't see the risks, they shouldn't pay for failure. We need a "fast-fail" model that unleashes the monitoring power of the world's bond holders. Their incentive structure makes them much more appropriate as bank overseers than either regulators or equity investors. I'm speaking as a prof. bank equity investor.) I'd also like to second Commoncitizen. If you start from the premise that you want to nationalize the banking industry, you need a reason ("banks aren't lending") and a method (majority ownership). The stress test provides the method. To TB's point about width of estimates, the results are capable of declaring the banks exactly as insolvent as necessary to achieve a given level of govenment recap / ownership. I don't think I'm a conspiracy theorist, but I'm certianly watching for that outcome.

Kevin H. Stecyk Posted On 4/20/2009 12:08:24 PM

Any thoughts on this blog post making the rounds: http://turnerradionetwork.blogspot.com/2009/04/leaked-bank-stress-test-reults.html The author claims to have seen the stress tests results and they are not pretty.

Chilly Posted On 4/20/2009 1:32:14 PM

Kevin, here are my thoughts: lies. Watch out for anyone who uses the term "technically insolvent." It correlates well with ignorance. Try this: http://uk.reuters.com/article/companyNews/idUKTRE53J3BD20090420 Treasury does not yet have stress test results Mon Apr 20, 2009 5:10pm BST Email | Print | Share| Single Page[-] Text [+] The blog was picked up by some third-party news services and cited by another trader for the drop in bank shares. The Turner Radio Network is described by some monitoring groups as a white supremacist organization.

fsda Posted On 4/20/2009 4:02:01 PM

That loan chart is terrific!

Pops Posted On 4/20/2009 9:25:16 PM

It seems that you assume that the "testers" are ignorant; that they don't know as much about credit quality as you. You're ignoring the environment in recent years where examiners have been muzzled by the get the regulators off our backs, unfettered free enterprise segment. I was one of those "testers" for many, many years -- I'm familiar with what they're facing. There's a new sheriff in town -- let's give them time to do their job. And, it's not our shot to call what results they reveal.

mopedman Posted On 4/21/2009 12:23:46 AM

The stress tests are designed for one thing and one thing only..to placate the apopulace. I was in a stupor today after I didn't really lose but failed to any longer have around $17,000 dollars. Quickly dusted my britches and went for big profit banking. Set my stops tight so it only cost about $300 more. Things quickly became surrealistic as I listened to my computer fan roar. It is simply amazing how they do it here..they make the herd stampede back and forth whenever they want and it never leaves the same acre of ground. No need to try and stop them or they'll just trample you down so you jump in and run right beside them. Now if I needed a tool to make fodder for reporters and to manipulate the market, the stress-test would be one made of gold. I am in total agreement with the government naming this plan..STRESS..because it will most certainly bring about that. Stress for banks, stress for stocks, and stress for the 6 o'clock news.

boca broker Posted On 4/21/2009 1:20:23 PM

pathetic what bias you have due to your over investment in failing banks. only thing wrong with the stress tests is the results that you fear.

doug williams Posted On 4/22/2009 6:02:07 AM

Very well said... But the real elephant in the room is that the purpose of the stress testes (typo my own) is to allay and sway the public's fear about the future and to have people start spending again. How many times have we heard from them that the "event" we are having is simply a matter of sentiment or perception ? I suppose they think we wont have a bonafide crisis until they throw a few more trillion of my great - grandchidren's money around. The very best that can be said about Larry and Tim is that they are shamefully transparent in all this. Thanks boys !!!
Fiserv
Ad for Bankstocks
 

     Bankstocks.com is a public web site operated by individuals who also operate investment advisory firms that serve as investment advisers to hedge funds (the "Firms"). Some articles are authored by employees of the Firms while others are authored by third parties. Under no circumstances does any article posted on Bankstocks.com represent a recommendation to buy or sell a security. This article is intended to provide insight into the financial services industry and is not a solicitation of any kind. The Firms do not vouch for the accuracy of any information contained in any article posted herein and the views expressed in any article herein do not necessarily reflect the views of the Firms. The Firms buy and sell securities on behalf of their fund investors and may do so, before and after any particular article herein is published, with respect to the securities discussed in any article posted herein. The Firms’ appraisal of a company's prospects is only one factor that affects the Firms’ decision whether to buy or sell shares in that company. Other factors might include, but are not limited to, the presence of mandatory limits on individual positions, decisions regarding portfolio exposures, and general market conditions, and liquidity needs. As such, there may not always be consistency between the views expressed in this article and the Firms’ trading on behalf of their fund investors. There may be conflicts between the content posted on Bankstocks.com and the interests of the Firms. For an explanation of these conflicts, including an explanation of our trading policy, and how we resolve them, click here.

Neither the authors nor any Bankstocks.com team members can provide investment advice or respond to individual requests for recommendations. However, we encourage your feedback and welcome your comments on any of the articles on this site. Neither the authors nor Bankstocks.com has undertaken any responsibility to update any portion of this article in response to events which may transpire subsequent to its original publication date.