They ridiculed me for my luckless job, but it's not actually that bad?

One day, Reito Shirosaki is suddenly sucked into a mysterious fissure and falls through a dimensional rift, only to be reincarnated as a newly-born baby in another world. He was born as the heir to a royal family, but after hearing his father the King shout at him "What the hell is this trash?", he ends up being banished from the castle. The cause...