`select("comment.*")` should omit free text (nan) columns by default

[rbyh]

[Cprakhar]

@rbyh Can you give more details about this? select("comment.*") what is this?

[rbyh]

This will give you all the columns of results that have a "comment" prefix - there is a comment field for each question. Each question other than free text includes a prompt for the agent/model to provide its reasoning for the answer. You can turn off comments if not desired.

[Cprakhar]

@rbyh Can you assign this issue to me? I want to work on it. In the issue title you wrote by default, which means user can change default by include_free_text_comments=True like result.select("comment.*", include_free_text_comments=True)

[Cprakhar]

What about other wildcard types "*.*" or "comment.some_question"?

[johnjosephhorton]

I actually added more general wild-card support recently. I wouldn't jump into this one quite yet - I'm actually not sure why comments are being including in results for free text.