It’s a mixed bag, really. Some basic apps are totally visible and a savvy kid can spot them easily.
Pro tip: You want to look for an app with a “stealth mode.” Once you install an app like Parentaler, you can make it invisible. It runs in the background without an icon on the home screen, so there’s nothing to tip them off. Works like a charm, especially on Android.