Jacket with knit collar and cuffs