If you're not the sort that needs a rush when you pull the trigger, .22 is perfect to begin with. Those of us who started young started with a .22
The complaints you hear the most are about how "boring" it is. The cure for that is a 12 gauge (channeling my childhood there)
For a pistol, personal experience suggests to buy one that was designed as a .22. I've had issues with conversion kits for pistol and rifle that go beyond accuracy.
For a target rifle, look into bolt guns. Dollar for dollar you're more likely to get a more accurate gun than you will with a semi auto, if you're buying quality.
The best way to try guns is to be a people person at the range. I personally enjoy letting new shooters try what I have if they express a curiosity.