IMAP Concepts

IMAP is a surprisingly simple protocol to implement, particularly in an environment like the Translator. Here are some basic concepts:

IMAP stands for Internet Message Access Protocol usually between an email client and an email server

It’s a protocol intended to let a email program communicate and get email from a email server.

It is a TCP/IP protocol which means it's over a network and consists of a stream of data back and forth

IMAP is a conversation between the client and the server. One opens up a TCP/IP stream. The server says “hello” and then the client says who they are and if the server accepts the proof of who the client says they are, then the client can ask the server to do various commands (ex. LOGIN, SELECT, FETCH, etc.)

IMAP is a conversational protocol

IMAP is a conversation between the client and the server. One opens up a TCP/IP stream.

The IMAP client connects and the IMAP server says Hello!

This is a common pattern with many TCP/IP protocols - it’s a way for the server to say - Hi - I speak your language and let’s begin a conversation.

It’s like going up to someone and saying Hola! It signals you are ready for a conversation and that you speak Spanish.

This is what we’d see say with a Gmail IMAP server:

* OK Gimap ready for requests from 69.196.142.158 ql9mb2511069qvb

This is IMAP for Hello!

Next we need to verify our identity since we don't want to give sensitive information to anyone

We need to Authenticate - usually with a user name and password. We send a LOGIN command which looks like this:

a01 LOGIN aryn.wiebe@interfaceware.com lkjllkjddkdjsfdhgh\r\n

So IMAP messages start with a unique code for each message we send to the server. In this case a01 - this unique ID that we use to track the command we have sent so when we get a reply from the server then we know what the topic was.

Notice the \r\n newline sequence? There is an interesting story behind that.

Remember that question I asked you?

Then we get the response back to what we said:

* CAPABILITY IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 UIDPLUS COMPRESS=DEFLATE ENABLE MOVE CONDSTORE ESEARCH UTF8=ACCEPT LIST-EXTENDED LIST-STATUS LITERAL- SPECIAL-USE APPENDLIMIT=35651584
a01 OK aryn.wiebe@interfaceware.com authenticated (Success)

Take special note of the a01 OK.

Each response comes back with ID plus either OK, NO or BAD

The ID matches up with the ID we sent before as the client - so this is part of the conversation of telling the client whether the last command it sent was OK or refused NO, or was formatted incorrectly - i.e. BAD an error.

So IMAP clients typically need a method of generating these IDs either randomly or in sequence.

An IMAP client also needs a routine to read the data back from the client to get the data.

Then the client can issue whatever commands they like

It’s a conversation after all - no two conversations are alike.

Select INBOX command - also tells us what the highest ID mail that we can request

Fetch an email

What other commands are possible - Chat GPT is helpful resource here

Lot’s of commands are possible like getting a summary of an email (can be helpful to avoid loading a very big email).

You can delete emails.

You can probably filter on them. Ask Chat GPT - it knows a lot about IMAP

The best way to understand the protocol is to open up the IMAPemail Feeder and look at it in the translator

You’ll never get a better way to see how IMAP really works.

Load the IMAP Email Feed and use The string viewing window and Annotation Windows you really get to see how it works.

That’s important since it’s also how you can diagnose problems.

I don’t know about you but I get very frustrated with the spinning disc I often get on my Apple Email client on my phone with no visibility as to what is going wrong.