Content filter to prevent mail text from being stripped

[nicolasguenther]

When using mail2most i encounter problems where mail content is stripped when it contains certain combinations of characters which are interpreted as markdown (colon, hyphen, pipe etc.).

I propose a new setting for a profile that enables me to specify certain characters which will be filtered out before posting the text in a mattermost channel.

An alternative would be to start/end escaping using the prefix/suffix settings. But it seems mattermost is lacking support for such an escape block. Using "```" blocks doesn't fix the problem for me.

[c-seeger]

hello @nicolasguenther thank you for opening an issue here. I'll take a look into this.

Is this only a problem with markdown interpreted characters? Maybe a StripMarkdown analog to StripHTML would be easier instead of a filter list.

[nicolasguenther]

Thanks @c-seeger. StripMarkdown looks convenient. I'm not sure it would solve my problem though. The problem occurs especially when the mail body contains colon characters which are used as control characters to enter emojis. I'll prepare and post an example later.

[nicolasguenther]

Example mail body 1:

test.
test: 123456

Result: Non printable characters are shown in the mattermost channe M�-

Example mail body 2:

test 
test: 123456

Result: Second line is stripped and not displayed in mattermost channel. Note: There is a space character at the end of the first line.

[c-seeger]

@nicolasguenther i actually can't reproduce the issue both mail bodys work correctly on the latest build.

[Philmod]

Hi,

I also see some text stripped from email, for example this email (in Plain Text Mode in Gmail):

The oncall rotation for ladder 'http://test' has been updated at 2021/09/28
13:30:00-0700:
Oncall until: 2021/10/05 13:30:00-0700

Oncall list (level -> contacts):
Level 1: quidam
Level 2: quidam_bis


May the queries flow and the pagers remain silent.

renders like this in Mattermost:

The oncall rotation for ladder 'http://test' has been updated at 2021/09/28
13:30:00-0700:

Oncall list (level -> contacts):


May the queries flow and the pagers remain silent.

In the mail2most config, we use StripHTML = false and ConvertToMarkdown = false.

It seems like the lines after a :\n go missing?

Any idea how to fix it?

Thanks

[c-seeger]

Thanks @Philmod for bringing this up. Interesting behavior, I'll take a look on this and check if I can reproduce this.

[Philmod]

Thanks @Philmod for bringing this up. Interesting behavior, I'll take a look on this and check if I can reproduce this.

Hey @c-seeger, were you able to reproduce this bug?

[Philmod]

Hi @c-seeger, any update on this bug?

[Philmod]

Hey @c-seeger, any update on this issue?

[c-seeger]

hello @Philmod sorry not atm will take a look as soon as i find some time