His hands are now covered with calluses, but compared to the farmers and construction workers back home, they're still somewhat lacking.
So he feels that he hasn't endured enough hardship yet, nor is his practical ability strong enough.
He wants to accomplish the simplest tasks but always gets stuck.
He doesn't need to please the primitives. He built a stone house for them, hoping they would move in, and although he's not understood, he definitely had good intentions, and the task was valuable. As for not being understood or being disliked, he doesn't need to care.
He must have the ability to pass the time while waiting. Now, he just has to wait more.
The hardest thing to deal with is this kind of boredom and dullness.
He wants to go out and play but fears the wild beasts and worries about the sheep at home. He thinks he should kill it, which would save him a lot of concerns in the future.