HESITATINGLY is a 12 letter word that starts with H.
\Hes"i*ta`ting*ly\, adv. With hesitation or doubt.
WordNet Dictionary