Is it okay to let my 9 mo old use a sippy cup with a straw instead of a regular sippy?

That should be okay outside of the house, like car rides, family members houses, or restaurants... but at home you should probably encourage her learning to use a regular cup whenever you can. If she gets fussy and doesn't want to, then use the straw sippy cup. I cant see why it would hurt.