In a speech this week, Mortgage Bankers Association CEO David Stevens gave some specifics as to what continues to weigh on the housing market -- the obvious being unemployment.