I'm going to say stay in mid-town Manhattan. It's much more vibrant during the day and at night for the two of you and the little one. You can easily take a yellow cab to the ferry and back. However walking over to Central Park, Times Square etc seems like is a better option and easier on the...