Download a software or mobile wallet if you're just getting started. Software wallets are kept on your computer, while mobile wallets are apps that you install on your smartphone. Software and mobile wallets are reasonably secure, can be downloaded for free, and are suitable for smaller amounts of Bitcoin.
Some wallets are hybrid, meaning that you can access them through software on your computer and through an app on your mobile phone.