Downtown Manhattan office market faces more tough times