chin_k,
Oh absolutely! Just getting out on the water, even in a "crappy" boat is a whole 'nother world. I would take the ol' Sevylor Tahiti over no boat in a heartbeat. Heck, a log

I mean, assuming you like being on the water at all. The shoreline/water interface is especially interesting, IMO, and it's usually more accessible from the water side.
If you aren't already a paddle snob, so much the better

An inflatable is easy to stow and carry, and you won't know it paddles "badly." (Sure, if you have a way to carry hard boats and want them, they are super fun too.)
If you want to delve into options, well, you have already spoken some of where. Things I'd be looking at:
1) What sort of water temps? Are these boats you want to swim from? Boats you want to keep you OUT of cold water? Both?
2) Who's going to be using it or them? Dogs, kids, more than one person per boat?
3) What kind of water (sounds like calm sheltered water is what you have in mind). But there is whitewater, open water, sheltered water, slow moving rivers, etc.
4) Any specific activities? (Fishing, photography, etc.)
5) What sort of options do you have to carry it along with (Chinook storage, Chinook roof, car roof, etc.) Also where to keep it when not using it?
6) Budget preferences.
7) What is your tolerance level for amount of time it takes to get ready and also to put things away?
Well, you get the idea. Not that there is one right answer, but there are certainly boats that do better at one thing than another, or are more general or more specific. I'm a big paddle snob, and I love sleek kayaks and fast rowboats. BUT, driving the Chinook around I'm having a blast with what amounts to a blob of inflatable fabric

Gets me out on the water, super easy to carry/deploy/store -- just fits my current mission. Other boats fit other missions (and of course the more singular your mission the easier it is to specialize, but sometimes you just want something to do a bunch of things with, even if it's not the best for any one thing).
Or, just grab something and try it if you just want to DO it without much analysis. Don't let my lists keep you from trying something if you just want to give it a go without so much thought (as long as you watch the weather, dress for the combined air and water temp, and have a decent PFD).
BG
PS: If you don't mind some potential sunk cost, you can just buy something cheap and try. I got two different people hooked with the cheapy Sevylor Tahiti. It was cheaper than renting, we were able to go out a few times (and without a time limit or having to do it on one particular day to a schedule), and the cheap companion paddle was kept for a future spare (for the future nicer boat he ended up getting). I had a loaner lifejacket for my friends, and we went in warm air/water so they didn't need a bunch of warm gear. Then when he first got a hard kayak, I just made some roof racks out of 1x that were sort of like giant popsicle sticks with holes drilled near the end that I lashed to his stock car roof rack with line. Then as he decided he was sure he wanted to boat more, he got a nice lifejacket (PFD), good paddle, booties, better roof rack, etc.
Depending on where you are, there may be someone local you can do similar with, just to try it out.