Noun Clause

Hi guys, Please clear me,

I remember that we went to the picnic with my family.

I remember we went to the picnic with my family.

My question is silly I know, but I just want to make my concept clear.

Is it important that noun clause starts with that?, I mean can we call these both sentences as noun clause? no matter it starts with that or not?

I hope you understood my question.