Something else you are overlooking, is that when robots are that ubiquitous and able to do construction and such, is that we will then be able to effectively start colonizing space. Which robots will be of course used extensively for, but at the same time all sorts of new things robots wont be able to do well will crop up.

For who could be free when every other man's humour might domineer over him? - John Locke (2nd Treatise, sect 57)