When should baby start drinking from a cup?Toddlers have formed a certain attachment to their feeding bottles. Since they were babies, these bottles are the medium in which their milk formula is placed so they can be fed. It is not surprising to know that some toddlers are having qualms about getting their bottle replaced with a cup.