To visit someone at Rikers Island for New Yorkers?

I need to visit someone at Rikers Island. If I leave work at 6 (manhattan) do you think I could get there in time?