No one keen on Fatih Terim or Bruce Arena
Bruce Arena, wouldn't fix any of your problems. He's a great man manager, but he's pretty inept tactically and his teams really only play a 442, with two traditional wingers.
Overly cautious performances
Chopping and changing the team
Players and system not working as expected
Failing to win games you'd expect them to win
Publicly criticising players and fans after poor results
That's a list of criticisms about Klinsmann's tenure with the US team, and they sound familiar...
That was mostly over beginning of his tenure, when he took over a team that relied on last ditch defending and hopeful counterattacking, and decided to turn them into a team capable of being a possession based football team. Under Bob Bradley none of our hispanic talent playing in Liga MX, was ever given a shot. Under Klinnsman we've transformed into a team that plays a more latin based possession game. We've gone through an entire philosophy change since he took over, and now every one is behind Klinnsman 100%. Klinnsman moved his line up around to found out what his best team was. Clint Dempsey and Landon Donavon hadn't played together for the national team until Septembers WCQ under Klinnsman's reign. Unlike England, The United States has been rewarding inform players with call ups, and giving them a shot, instead of just using the big names, or the people who've been in national team rotation for awhile. In fact, the entire projected starting back 4 for Brazil will be 4 players that have been called up because they were playing well for their clubs. Brad Evans, Omar Gonzalez, Matt Besler, and DeMarcus Beasley.
I also would really not recommend Klinsman. He's sort of squeaked through his US managing thanks largely to the fact that Mexico has been such a spectacular bust that no one has noticed the US losing to tiny, tiny countries much. If we had to have a caretaker I'd go for Hiddink.
What tiny countries? Our only two losses during World Cup Qualifying were to Costa Rica and Honduras away, both tough games against World Cup bound teams. Even had Mexico not imploded into a team incapable of doing anything, the United States would still sit at the top of CONCACAF. We drew to Scotland 0-0 at Hampden Park, and lost to Austria 1-0, in Austria and missing 5 regular starters. We've won something like 17 out of our last 20 games. Not that it matters much, Klinnsman is the head of a big project in the United States, and won't be leaving anytime soon.
Ole Gunnar Solsjaer, would be an interesting option as well. I'm surprised he hasn't been linked with you guys yet. He's linked to almost every club that has speculation over an open manager's position. He's won 2 Norwegian League titles, and I believe Molde just won Norway's version of the FA Cup. He was my first choice to take over for Fergie, and I honestly wouldn't be surprised if Moyes' is just keeping his seat warm.
Unless they've grown. 
