It should be ok to carry a guitar in addition to a handbag (at least I have not had any issues on international flights...check for domestic).
The best thing would be to simply call up the airline and find out the rules.
Oh and do not even think about checking-in your guitar without a hardcase. You'll get it back in pieces (if you're lucky).
Since the creation of the Internet, the Earth's rotation has been fueled, primarily, by the collective spinning of English teachers in their graves. (QDB #754533)