Or if you are look for an all-in-one utility I would definately try Macromedia Studio You can use it to design and develop many different things. It includes dreamweaver, macromedia flash, fireworks, coldfusion, etc.
Yea, in terms of the programming you can just use Dreamweaver, which is a very good resource to have. Also, everyone knows that notepad/wordpad is good for quick and easy html edits
Gimp is a nice free graphics editor that used together with a textEditor like textpad or something similar produces nice websites. Of course coding it yourself...
WYSIWYG web design software are not very usefull for me. I don't usually recomend them
I use Fireworks to do my layout/editing, but dedicatedly use notepad for the actual HTML/PHP/ASP/JS. Before I started using CSS-based layouts, I was using Dreamweaver, but it's preference towards users who use tables instead of CSS has made me move away.
Besides, only people who need to use Dreamweaver's predictive tags use dreamweaver