Hi,
Maybe you have been granted the delegate permission to your husband's calendar, and you send the invitation on behalf of (or "send as") your husband. To verify this, in your husband's Outlook(take Outlook 2013 for example), go to FILE -> Info -> Account Settings -> Delegate Access -> Check if you have been added as a delegate.
Another possibility could be that your husband and you have configured both of your accounts on one Outlook client, when you send the invitation, actually the sender is selected as your husband's account:
If so, click the "From" dropdown button and select your own account to send the invitation.
Regards,
Melon Chen
TechNet Community Su