I'm not trying to be a cock here, but almost everyone doing manual labour is there because there was a lack of effort to begin with. I put up farm buildings and industrial units etc and I would say 8/10 manual workers in construction just do what they need to do to get by.
It's the same with low skilled workers in any company. Many of them aren't interested in what they are doing, or advancing - they just want to take the money home at the end of the week. That's why they don't have anything...because they have never put in 100% effort.
If you want to do well in life and actually do something about it then you will do well.