There's a few different ways to go about settings up your first website. I hear wix these days is all the rave. But it really depends on how deep you are willing to dive in to learning HTML and scripting languages.
Getting a domain is pretty simple, as Court mentioned there is GoDaddy, but there are a few other services as well, such as Namecheap. I believe GoDaddy will also offer web hosting. It may make sense to find a hosting provider that will help you set all of this up. DNS management can be pretty confusing, if you're not familiar with this stuff.
Wordpress isn't exactly the easiest thing, nor the most difficult. It's designed to give you a functioning site with some back end functionality. It is also a very good starting point for a would be PHP developer. So I would recommend it for that. But for me learning web stuff for the first time started with me setting up a web server locally (IIS at the time) and reading up what I needed to do to put it all together piece by piece. Until I started actually writing ASP code and seeing how it all worked.
So, by the time I saw something like Wordpress, I already had an understanding of how back end scripting languages work, what templating languages were, and how to generate a pages HTML. I think in the end, having a strong grasp of Web Technology concepts first will take you further, and then the question of Wordpress being difficult to learn will become moot.