Issue Description
After importing mail to user account using imapsync and/or Thunderbird for imap-to-imap, on some user accounts the entire mails are imported, show the headers in Thunderbird or Nextcloud Mail but the body is not showing. So I assume the blob is not linked properly.
This happens on some accounts, others work, set up practically identical (different user names). New, incoming mail is displayed properly.
Expected Behavior
Show the e-Mail including body and attachments (blob).
Actual Behavior
No error, just the mail not being displayed. On the respective accounts it shows i.e. 3GB data (all mails obviously accounted for), the blob directory grows accordingly, but the mail shows only and exclusively the header (I assume from the postgres-data) but not the mail (I assume the blob data). Blob resides in filesystem.
Reproduction Steps
Used imapsync to move mails from old postfix/dovecot to stalwart.
Upon error, deleted all mails, restarted stalwart. Then used Thunderbird, connecting to old server and stalwart, mark the mails in old server, “move to” selecting stalwart. Same result, only the headers show. Other users work fine.
Two issues. As I deleted all mails and re-“imported” them using another tool with the same result, I guess there is something wrong with either user account or database. Unfortunately I do not really understand where what is filed and how to make sure if I deleted mails that they are properly flushed. Or to repair the links. Unfortunately, both import and repair have been removed from stalwart-cli AFAIK?
How can I either repair or safely delete an account and all links and blobs associated to it, to recreate it from scratch? As I cannot change the mail address, it’s established. I can only make a clean sweep (if I know how) and recreate it from scratch, hoping that fixes any malfunctioning stalwart-internals.
Strong recommendation: If stalwart does not deliver a blob, there must be some log and “screaming” in the system. This happened all quietly, nothing in log, no error, nothing that made me aware until the user called, rather upset, which I can understand.
Second strong recommendation: If stored in file system, it would be good to have a field in postgres to see where the blob resides?
Note. stalwart was installed from installer as per Linux / MacOS | Stalwart
Relevant Log Output
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP connection started
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Authentication successful
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ENABLE command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP STATUS command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:15 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP FETCH command
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP SELECT command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:15 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:15 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP FETCH command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP FETCH command
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP SELECT command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP ID command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: Data store iteration operation
May 18 07:12:16 mindship-syl stalwart[1039163]: Cache hit
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP SEARCH command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP input received
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP LOGOUT command
May 18 07:12:16 mindship-syl stalwart[1039163]: Raw IMAP output sent
May 18 07:12:16 mindship-syl stalwart[1039163]: IMAP connection ended
Stalwart Version
v0.16.x
Installation Method
Binary (Linux)
Database Backend
PostgreSQL
Blob Storage
Filesystem
Search Engine
Internal
Directory Backend
Internal
Additional Context
Rocky Linux 10.1, I searched for assistance and ideas before raising the issue. If duplicate I apologize and appreciate a link. Else I hope for information how to resolve this quickly. Server is a commercial Hetzner with 80GB + 1TB storage box used for the blob storage.
I have reviewed the documentation and FAQ and confirm that my issue is NOT addressed there.
on
I have searched this support forum (open and closed topics) and confirm this is not a duplicate.
on
I understand that topics in this category are triaged by a bot first but a human reply will follow up. If I’d prefer a human-only reply, I’ll add the no-ai tag to my topic.
on