INVETERATELY is a 12 letter word that starts with I.
\In*vet"er*ate*ly\, adv. In an inveterate manner or degree. ``Inveterately tough.'' --Hawthorne.
WordNet Dictionary