I was a first time pet owner when I got my kitten. The person who gave her to me told me she was 8 weeks and weaned. She turned out to be 2-3 weeks (vet's estimate), still on milk and infested with fleas (left me paranoid for well over 5 months). The first month with her was stressful. I had to go home during lunch to feed her ( kitten milk replacement is EXPENSIVE), "stimulate" her so she could go to the restroom, litter train her when she was old enough, pay out of pocket for her spay, vaccinations, deworming, etc (I go to a bourgeois vet though, so this will vary). She is 8 months now and a well adjusted kitty for the most part (I do think she suffers from single cat syndrome at times).
It is possible if you are willing to put in the time, effort and research. Make sure you get the cat from a reputable person/shelter. And while my cat is an indoor cat, I do take her outside occasionally on her kitty leash/harness.