Text does not clearly say he was there.
Text says Eve talked to serpent.
Text does not say, Adam told her not to eat fruit. Could have been Adam or God.
Text says Eve ate fruit.
Text does not say Eve ate fruit in the presence of the serpent.
Text says Eve gave her husband the fruit and he ate. He ate it in her presence, but text does not say serpent was present or that he overheard the conversation between Eve and serpent.
Text does not indicate whether this all happened in a single day or over a period of time.
My point is: we cannot be sure he was there and we cannot accuse him of being a poor husband or family leader when God does not accuse him. We can say he willfully rebelled against God through disobedience and he along with all humanity suffer the consequences.
If interested, I recommend reading the text from a Contemporary English Torah translation. I linked one below:
When God began to create*When God began to create Others “In the beginning God created.” heaven and...
www.sefaria.org