sympa icon indicating copy to clipboard operation
sympa copied to clipboard

Export subsribers with data source(s)

Open iulistadmin opened this issue 3 years ago • 12 comments

Make it possible to export (i.e., dump) subscribers/members and their data source(s).

Expected Behavior

An option to dump members with data sources could be provided in the web interface.

Current Behavior

This option does not exist. Members may be dumped as email addresses only or with names, if present.

Possible Solution

Provide an option to dump members with their data source(s).

Context

Owners would like to have access to this data to assist them with list member management.

iulistadmin avatar Apr 20 '21 19:04 iulistadmin

include_sympa_list or include_remote_sympa_list may treat the lists as data sources. See also documentation.

ikedas avatar Apr 21 '21 02:04 ikedas

Let me clarify. We hide the inclusion options from owners in the web interface. So, only the list administrator may see and edit these options. The --dump_users will export the subscriber information with the inclusion_label data for each member, but that again is only available to the list administrator via command line. Owners have no ability to acquire the data via the web interface, or am I missing something? Thanks.

iulistadmin avatar Apr 21 '21 12:04 iulistadmin

"Subscriber Table" in review (Subscribers) page includes "Sources" column that contains the name of data source if each subscriber is included.

ikedas avatar Apr 22 '21 01:04 ikedas

Yes. I know. That's not the request. The request is to have a means for the owner to export the subscribers with the source data. Also, the source field only shows one source. So, if a list has multiple sources, for example, two sublists, and the member is on both sublists, there is only one source shown, probably the last one Sympa read from which included that member. That's a separate but related issue. The point of this issue is for the owner(s) to have the ability to include the source(s) data in an export of the list's members.

iulistadmin avatar Apr 22 '21 12:04 iulistadmin

Please see #1156 about “multiple sources” (I think such thing is impossible).

BTW a subscriber can be both “subscribing” and “included”, or either of them. What is your idea about how they will be shown in the space-delimited record?

ikedas avatar Apr 23 '21 00:04 ikedas

Yes. If the member is subscribed directly to the list and the member is also included from a source, both "subscribed" and one data source appear in the Source column. Emphasis on one. If the member is subscribed to more than one source, those sources are not included in the Subscribers table displayed in the web UI. And there is no export option available to list owners to export the subscribers with their source(s) data therein. As an administrator, the --dump_users option will do this, but owners have no such option, as far as I know.

iulistadmin avatar Apr 23 '21 12:04 iulistadmin

Then, how do you think of the format of exported data for the owners?

Currently it is simple plain text containing with one person per line:

[email protected] Joan Doe
[email protected] Erika Mustermann
[email protected] Pierre Paul Jacques

If possible, we’d be better to expand this format to include other information such as "subscribing"/"included" labels.

EDIT: The owners may get dump of suscribers using "Dump" or "Dump with names" button in Admin page:

image

ikedas avatar Apr 24 '21 07:04 ikedas

I would love to see an option for an expanded format using YAML syntax.

racke avatar Apr 24 '21 08:04 racke

Sure. That would be fine, or even a simple comma delimited source list where if the subscriber is imported from more than one source, they are shown:

[email protected] Joan Doe subscribed
[email protected] Erika Mustermann sub-list1,sub-list3
[email protected] Pierre Paul Jacques MyOrg-LDAP-Group,/path/to/local/file/source/members.txt

iulistadmin avatar Apr 26 '21 12:04 iulistadmin

However, display names (a.k.a. "gecos") of subscribers may contain any characters, such as comma ",". I think that's why @racke suggested the new format such as YAML. Do you have any idea?


NB: If you need the feature to provide information of subscribers to owners right now, you may write a script to run sympa.pl --dump_users, modify the dump files reducing unneccesary information and to send them to owners.

ikedas avatar Apr 28 '21 01:04 ikedas

Oh, good point. Sure, YAML format is fine for the export.

iulistadmin avatar Apr 28 '21 13:04 iulistadmin

Yes and we can add other interesting information about the users, e.g.their preferences.

racke avatar Apr 28 '21 13:04 racke