In all fairness I would be a bit miffed in the same situation, if they didn't even ask me first! I would undoubtedly say yes if they did ask, but it's just good manners to do so!!

If someone asked if they could borrow my car, I might say yes, but if they took it without saying bugger all assuming I wouldn't mind then I would be fuming!