Don't just you love when options are left off of the --help/-h/-help etc.. of a program? Well boys and girls, add wget to your list of programs with undocumented useful features (probably not in the help because they're worried about people abusing the feature I guess).

So, to get make wget ignore robots.txt rules, use:

 wget -erobots=off http://your.site.here