How to search documents we can’t read | Confer Blog Confer now has folder files! You can add PDFs, Word documents, presentations, spreadsheets, HTML, Markdown, or plain text to a folder, and those files become available to every conversation inside it. Add something once, then ask about it whenever it becomes relevant.<br>An attachment stays with one conversation. A folder file is there for every conversation you start in that folder.<br>A folder full of context<br>Imagine a folder called Health. It might contain lab reports, visit summaries, imaging reports, insurance explanations of benefits, and a medication list. Before seeing a new specialist, you could ask for a single timeline of diagnoses, medications, procedures, and unusual results, with each item linked back to its source. You could ask how a lab value has moved over five years, whether it changed after a medication was introduced, or where a symptom first appeared in your record.<br>Or imagine a Finances folder with tax returns, bank statements, benefits documents, a lease, and mortgage paperwork. You could ask why your mortgage payment went up, which subscriptions and insurance premiums have quietly increased, or where to find every number your accountant requested. You could trace an unfamiliar merchant across years of statements without opening a few dozen PDFs yourself.<br>The same idea works for a house (inspection report, contractor quotes, manuals, warranties), or a long-running project (papers, books, specifications, notes, spreadsheets). Rather than repeatedly attaching the same files to unrelated conversations, the folder becomes a persistent body of context that each conversation can draw from.<br>The feature itself is simple: instead of handing the assistant one document at a time, give it a filing cabinet. The catch is that filing cabinets tend to contain exactly what people are least comfortable giving an AI company – medical histories, bank statements, tax returns, contracts – and a collection of these documents is often more revealing than any one of them.<br>How document search usually works<br>An LLM cannot read a PDF or Word document directly. Those files are binary containers full of encoded text, fonts, images, drawing instructions, page geometry, and other machinery. A multi-modal model can process raw text or images, so before it can do anything useful with a document, the file has to be translated into those forms.<br>Conventional non-private AI services begin by receiving the original file in plaintext and extracting the text embedded in it. Scanned pages require an additional OCR path (which isn’t supported by default for most services), or pages are rendered as images so the model can see things text extraction does not represent well, like tables, charts, forms, handwriting, and spatial layout.<br>The extracted text is then divided into smaller passages and indexed so that relevant sections can be found later without putting the entire document into the model’s context every time. By the time the document is ready to use, the service has several representations of it: the original file, extracted text, a search index, and – when visual processing is enabled – layout metadata and page images. All of the representations it creates are plaintext.<br>This makes retrieval easier, but it also gives the company operating the service a readable document library specifically organized to make the information inside it easy to find.<br>For Confer, we wanted the same useful result with a different privacy boundary. The original is encrypted before it leaves your device. It is decrypted only inside an attested Trusted Execution Environment (TEE), where the model also runs. Text extraction, indexing, retrieval, and inference all happen inside that boundary. The derivatives are encrypted before they leave the TEE, and are only opened there again when a later request needs them.<br>The document pipeline still works; it just never produces a durable plaintext copy that we can read.<br>Producing ciphertext from ciphertext<br>Every folder file is encrypted on your device with a fresh, random 256-bit key before it is uploaded. Object storage receives ciphertext. The filename, key, and references required to use the file are kept in the folder’s encrypted metadata, protected by the same passkey-derived key hierarchy as the rest of Confer.<br>To prepare the document for search, the client sends its key and opaque storage reference through Confer’s attested encrypted channel into the TEE. The host machine cannot read the channel or inspect the TEE’s memory.<br>Inside that environment, the document is decrypted and transformed:<br>Text is extracted, with OCR used selectively for pages that need it.<br>Page, layout, and visual information is preserved.<br>The text is divided into searchable passages.<br>A compact artifact is built with the canonical text, page references, extraction confidence, and an SQLite full-text index.<br>The canonical text and artifact are encrypted before leaving the TEE.<br>The...