The most important characteristic of Bitcoin and what specifically differentiates it from conventional money is that it is decentralized i.e. no one particular institution has complete control over bitcoin network. Many people like this feature because they like the fact that no large bank can control their money.
