apache/incubator-ponymail

Apache Pony Mail (Incubating) - Email for Ponies & People

incubator-ponymail's Issues

XLSX attachment corrupted

In my local installation I periodically run the import-mbox.py against Mailman's MBOX files.

I have just noticed that OpenOffice says that an XLSX attachment downloaded from PonyMail is corrupted.
Downloading the same attachment form Pipermail works fine, instead.

Bug: message added to wrong mbox file

The email with message Id
[e-mail]

appears in the downloaded mailbox for March, i.e.

https://lists.apache.org/api/[email protected]&date=2016-3

Since the mail was sent in February, that is the wrong mbox.

Enhance: archive calendar display to show the number of mails for each month

The archive calendar display on the lhs should show the number of mails for the month.

The oldest month buttons could be dropped if there is no data (e.g. list had not started).
Or at least the buttons should show a different colour if there are no mails.

Permalink should open in new window

"Reply via your own mail client" all percent-encoded with Thunderbird on Linux

When using the "Reply via your own mail client" feature from my local PonyMail installation, the content is all percent-encoded if the original e-mail was sent in HTML only, even though it looks fine in the browser.

Broken Permalink - points to wrong mailing list

The list https://lists.apache.org/[email protected] contains a message entitled "Document" dated May 12. View Source starts as follows:

Return-Path: derby-dev-return-116554-archive-asf-public=[e-mail]

However, click on "Permalink" and then use View Source, and one gets:

Return-Path: infrastructure-issues-return-70997-archive-asf-public=[e-mail]

The bodies of the mail are similar, but not identical.

I don't know if it's significant, but the email appears to contain a suspicious/malicious document.
Other derby-dev Permalinks I checked seemed to work OK.

Add "Mark all as read" feature

The first time one opens up a new mailing list, all e-mails are unread, it could be handy to add a feature for marking all messages as read / unread.

is of pony?

pony can into mail???

Composer window should default to the subject field

The compose window should default to the subject field. [Maybe even refuse to enter the body without any subject?]

Create a treeview-style list view for emails

A treeview where threads are listed as trees but not expanded into bodies would be awful nice. This would supplement the threaded/flat views.

Bug: Manage e-mail confirmation link does not work except in original browser session

The manage e-mail process sends out an e-mail with a link.
However the link does not work unless the same browser session is used.

Fix up docs, stop switching between sudo and non-sudo

The installation docs occasionally mix between using sudo and not using it. This should obviously be harmonised at some point.

Bug: download mbox function omits mails on the last day of the month

The download mbox function can omit some mails.

For example, the following e-mail:

https://lists.apache.org/thread.html/Zqh58xrfbbskrmd
was delivered to whimsical-dev dated: 2015-06-30 16:13
[The mail has the ezmlm id of 12]

However it is not in the download for June
https://lists.apache.org/api/[email protected]&date=2015-6

This appears to be because the date range in the elastic search is:

gte = ("%04d/%02d/%02d 00:00:00"):format(y,m,1),
lte = ("%04d/%02d/%02d 00:00:00"):format(y,m,d)

which obviously excludes all emails dated after the start of the final day of the month.

It might be better to select on the basis of matching YYYYMM.

Statistics should be turned off by default

By popular demand!

Bug: broken Permalink - points to wrong mailing list

#41 was closed, but the issue was not fixed

Reply only takes current mailing list into account

The various mail views only seem to show the current mailing list.

This causes a problem when using the Reply function; Reply All is usually what is needed.

There should at least be some indication that the e-mail was sent to more than 1 list.
[I know that the mail source is available, but that is hardly user-friendly]

Duplicate comments

https://github.com/quenda/ponymail/blob/master/site/js/ponymail.js#L26-L32

Have Quokka align X-tags perfectly

Currently, the X values at the bottom (the dates) don't align perfectly with the plots or the overall canvas....it should :|

Bug: Date display does not show the TZ it is in

The message date field is shown in local time.

However the TZ is not shown, which makes the date ambiguous.

Date/time fields should always show the TZ

Privacy issue: thread.html view - first email address in the list, the sender email is not obfuscated

Email addresses are generally obfuscated, except for the first email in the thread.

Expected:

The first "from:" email address in a thread should be obfuscated, like the rest of the emails in a thread.

Actual:

The first "from:" email address in a thread is not obfuscated, unlike the rest of the emails in a thread.

Steps to repro:

1. In the main view, expand a thread.
2. Click on the "Permalink" button on any email in the thread
3. Note that in the new Thread view, the first email's "From:" field is not obfuscated

Example deployment to see the bug in action:

http://ponymail.info/thread.html/Z3uzyw5jakfvdqq

Add "clear filters" option

I understand that going back a page would undo the last filter.

Ideally this should be more explicit, and it should clear all filters applied, not just the last.

hiding stats collapses thread

Repro:

1. open thread
2. hide stats
3. watch thread collapse

Back button returns too far when returning from View Source

Navigate to a mail beyond the first page.
Open the thread
Click "View Source"
Click back - the display changes back to the first page

Button thread is at the bottom of the page

From the ML: "The new thread button is at the bottom of the screen and can be hard to find if there are lots of threads open. Might be good to have another button in the menu line."

Additionally, the "Next..." button is also at the bottom of the page. It should also be at the top.

UI: Manage Email Addresses process is not clear

Clicking Associate on the Manage Email Addresses page responds with:

"Your association request has been handled. Please check your inbox! Depending on grey-listing etc, it may take up to 15 minutes before your confirmation email arrives."

This implies that there is nothing further to do. However that is not the case as the email states:

"You (or someone else) has requested to merge this email address with the account ... in Pony Mail
If you wish to complete this merge, please visit https://..."

It's also not clear what 'merge this email address' means.
It's confusing for the mail to use 'merge' when the page uses 'associate'

Bug: associate mail page does not validate the e-mail address

As the subject says: no matter what is entered in the e-mail address box, pressing the Associate button appears to be successful. No error is generated even for blank input.

UI: Manage e-mail confirmation page is a dead-end

The manage e-mail confirmation page just says:

"Email address verified! Thanks for shopping at Pony Mail!"

There is no link to return to Pony Mail.

Provide access to raw messages

UX: Distorted logo on login page

The logo on auth.html is forced into a square shape.
Since the original logo is not square, this looks wrong.

Bug: Manage e-mail addresses page hangs if not logged in

The merge.html page hangs if not logged in.

This can easily occur if one visits the page and then logs out from the page.

Date display should default to GMT or GMT-offset

For consistency, the message date should be shown in GMT by default or possibly in GMT-offset form.

e.g.
Date: Wed, 01 Jun 2016 16:23:56 GMT
or
Date: Wed, 1 Jun 2016 11:23:56 -0500

It should not be necessary to login to specify the TZ to be used.

Figure out how to properly present single-domain, multi-list view inside list view and in phonebook

It would be beneficial to discuss and work on how to better present cases where you have a single (sub)domain but > 10 (or maybe >100) lists tied to that. In list view, that would get compacted and only the 5 busiest lists are shown by default, with the rest inside a dropdown. There may also be better way of building a phonebook (the front page) for this sort of setups.

Bug: manage e-mail confirmation link does not work at all

Cannot associate mail addresses any more.

I removed the previous mail association.
Note that I had to do this multiple times, as the deletion did not appear to take.
Perhaps there were multiple entries for the same address?

Now I cannot add the association for the same e-mail address.
I get the mail, but the link is rejected with the message:

"Either you supplied an invalid hash or something else went wrong."

Same happened with an email address that I have not yet used with Pony Mail

The composer window should keep state

The compose window should be hideable and keep its state.

When composing a reply, it may be necessary to read the thread as one writes it. Hiding the composer window right now makes it lose all its contents.

Composer window should auto-hide more dynamically

Composer window should auto-hide after sending email. If it already auto-hides, then timeout should be shorter. Alternatively it should immediately auto-hide on sent, and a notification box displayed with result of sending.

New feature: allow admins to remove e-mails from archives

Would it be of interest the possibility to give administrators the possibility to hide / remove specific e-mails from archives?

Message wrap broken in Firefox

From the ML:
"Message lines that are too long are truncated in Firefox. There is a slider, but that only appears when the message is selected, so it looks like text is missing. If wrapping doesn't work on Firefox, it might be better to always display the slider if it is going to be needed; that would act as an indication that the message has more data."

Add collapse all threads option

When multiple threads are unfolded, it's difficult to find unfolded threads.

Bug: manage e-mail confirmation link does not appear to expire

As the subject says; the link in the confirmation mail seems to be re-usable.

Unicode in main body can cause duplicates when overlapping archiver with imports

When you have emails that have been archiver through the archiver.py process and then later re-import with import-mbox.py, emails that have unicode in the main body may cause the MID (message ID) to be different due to different SHA digests. This should be fixed by detecting such issues and converting to ASCII in a uniform and consistent way.

Currently, it does attempt that, but the result is not the same...

List statistics page

We should try to figure out whether it makes sense to make a statistics page for each list, and if so, what it would look like. Starting with a basic idea and a html mockup would be ideal, and then work towards implementing it as a JS-rendered page using JSON data from the backend.

Things we could show there could be stuff like:

• emails per day
• current trends (this month vs last month etc)
• no. of senders, topics, emails per topic and so on.

Move view types for list view into a drop down menu

as subject says. As the number of view types increase, this cuts down on space used in the UI

Bug: Internal Server Error when viewing e-mails

Got the following Internal Server Error when viewing mail:

/var/www/ponymail_asf/site/api/email.lua:32: attempt to get length of field 'cc' (a userdata value)

The mailbox that causes the problem is:

https://lists.apache.org/[email protected]:2016-4

Request for spefic use case documentation

I would like to setup PonyMail for my company infrastructure.
We have several mailing lists managed by Mailman 2.1 on Ubuntu 14.0.4 LTS; some of them have private archives, other are public.

Would it be possible to provide more detailed setup instructions for a use case as the one above?
I have attempted following the Ubuntu setup instructions and then the general instructions but could not figure out how to:

1. configure Mailman 2.1 (examples for Mailman 3 are provided)
2. index existing Mailman (public and private) archives

Thanks in advance, PonyMail rocks!

Mailman, pipermail and HTML attachments

We unfortunately have someone in our MLs sending e-mails in HTML only: as a result, pipermail will display a blank e-mail saying "An HTML attachment was scrubbed...", with link to such HTML attachment.

This also works in PonyMail, but I was wondering if:

1. PonyMail scans such attachment when importing from pipermail
2. Is it possible to make PonyMail display such attachment inline (only when no text version is available)

Fix: several files use the old Github address

Several files still reference the old Github address:

dockerfiles/debian/Dockerfile:21:RUN git clone https://github.com/Humbedooh/ponymail.git /var/www/ponymail
dockerfiles/debian/Dockerfile:24:ADD https://raw.githubusercontent.com/Humbedooh/ponymail/master/dockerfiles/ponymail_httpd_docker.conf /etc/apache2/sites-enabled/000-default.conf
docs/INSTALL.centos.md:100:git clone https://github.com/Humbedooh/ponymail.git
docs/INSTALL.debian.md:34:sudo git clone https://github.com/Humbedooh/ponymail.git
docs/INSTALL.fedora.md:64:sudo git clone https://github.com/Humbedooh/ponymail.git
docs/INSTALL.ubuntu.md:44:git clone https://github.com/Humbedooh/ponymail.git
docs/INSTALLING.md:25:- Download the git repo: git clone https://github.com/Humbedooh/ponymail.git
README.md:2:


README.md:11:
README.md:13:
tools/install.py:53: subprocess.check_call(('git', 'clone', 'https://github.com/Humbedooh/ponymail.git', '/var/www/ponymail'))

AFAICT there is a redirect in place, but it would be better to fix the URLs

date and # of participants should be aligned

Perhaps flushed to the right, or something along those lines. Right now they clutter everything and make it hard to read thread subjects.

Bug: date display shows the negative timezone offset

The date display has been changed to append the tz offset.
However the sign is inverted.

For example:
https://lists.apache.org/thread.html/Zfp0souj6y08k06
has the source:
Date: Wed, 1 Jun 2016 11:23:56 -0500
This is correctly shown by mail-archives as
Date Wed, 01 Jun 2016 16:23:56 GMT
However Pony Mail shows it to me as
Date: 2016-06-01 17:23 (-0100)

However I'm on GMT+1.

Seems to me that the display should use GMT and avoid any issues with time conversion, especially since DST dates vary between locales.

But if conversion to local time is done, it's important to show the correct offset.

Enhance: easier navigation among mailing lists

It's not all that easy to navigate the lists for a large site like the ASF.

There does not appear to be a way to search by list id, and the drop-down lists don't react to typing the first few letters of the name.

Allow search by ezmlm message number

It would be useful to be able to search for mails by ezmlm message number, i.e. the number ezmlm quotes in bounce messages