How much experience do you have? If its little then I would say start with the 22 rifle. Reason for that and many old timers will tell you that learning the ropes on a 22lr is the best start. I would even suggest you consider a 22lr pistol like a Ruger MK or Browning Buckmark, there are others that would be good choices as well.
As to the CC piece, a Glock 19 is do-able but it is about as large as you really want to go. Mine is a CZ P07, but there is nothing wrong with the Glock 19 I had one in years past.
The revolver is a good choice as well but keep in mind good quality 357s are not cheap anymore, I don't suggest the budget brands, the S&W or Colt are good but will cost a bunch more than a Taurus or Rossi, but you get what you pay for so I suggest spending the extra on the S&W or Colt.
22lr rifles, the Ruger 10/22 is the small block chevrolet of the gun world. You can do an awful lot with them. It can go from mild to wild. There are other good choices in semi auto and bolt guns as well.
Remington 870 is a great pump shotgun, the Mossberg 500 is as well but IMO the Remington is better. But you mention that you want it for home defense. Do you live on a large piece of property? Now I know a lot of folks suggest pump shotguns for home defense, unless you have acres to deal with I don't think you need anything more than a good pistol to defend your home with. To prove a point I used to have a 26" chunk of 2X4 that I would hand someone and tell them to try and walk through their home holding it and not let anyone see the 2X4 before you can see into the room but still have it as if it was a shotgun and you are ready to fire it. In most cases if they do the exercise correctly its hard to do, you telegraph that you have the gun. Its just much easier and safer to move through out a home with a pistol, as far as being lethal, practice is the key, not a bigger gun.
One other thing on home defense, you hear someone talk about if they hear an intruder they'll rack the slide on their pistol or pump a round into the shotgun .... and most of the time they follow that with "it makes a very distinctive sound" (Thanks Clint Eastwood for the movie line.) once again you are telling the intruder that you have a gun, he may as well and kill you to take yours. After the following comments at a match I attended "I'll just rack a round into my pump shotgun" and "I'd drop the slide on my 1911" by some guys, a friend of mine made the best comment I ever heard, "I don't know about all that I just quietly flip the safety off and wait for them to come to me".
As I mentioned practice is key, I tell folks "you might shoot better with a better gun, but a better gun doesn't make you a better shooter." Also I'm a firm believer in practice with what you carry, if you use it in a specific holster always do so. Use the same ammo for practice and carry (yes that can be expensive, you life is worth the money.) Also remember USPSA, IDPA and all the other competitions are games, not real world training. Hope my words are wise for you.