JackyJacky
JackyGuideDocument & Screen Analysis

Document & Screen Analysis

Jacky is capable of analyzing files such as text documents, PDFs, spreadsheets, and images, as well as looking at specific parts of your screen.

Drag & Drop File Analysis

You can easily analyze files by dragging and dropping them directly onto Jacky. When a supported file is dropped, Jacky will process it, provide an initial summary, and open a dedicated Document Chat window for multi-turn Q&A.

Supported Formats

  • Images: .png, .jpg, .jpeg, .webp, .bmp (sent as base64 images to the model)
  • Text Documents: .txt, .log, .md, etc.
  • PDFs: .pdf (processed as text, or fallback-rendered as an image if text extraction fails)
  • Office Documents: Word (.docx) and Excel (.xlsx) spreadsheets
Info

Custom Limits: You can configure maximum file size thresholds for both text documents and images in the Features settings tab.

Document Chat Features

  • Multi-turn Conversations: Have a detailed discussion about the document context.
  • Mascot Personality Toggle: Choose whether Jacky answers with their playful personality style or in a neutral, objective tone.
  • Code & Table Copying: Easy clipboard copy button for assistant messages containing code blocks or formatted tables.

Screen Area Analysis (See Screen)

Jacky can capture and analyze specific parts of your screen on demand, opening the cropped area directly in the Document Chat window.

How to use it:

  • Option A (Shortcut): Press the Ctrl + Shift + S global hotkey on your keyboard.
  • Option B (Context Menu): Right-click on Jacky to open the Context Menu and select "Select Area of Screen".

Once triggered:

  1. The screen will freeze and display a fullscreen Region Selector.
  2. Drag a box over the specific area of your screen you want Jacky to analyze.
  3. The cropped region is automatically saved as a temporary image and loaded into the Document Chat window.
Warning

Permission Required: To use the Screen Area Selector, you must explicitly enable the See screen (allow_vision) permission in the Permissions tab.

Practical Examples & Use Cases

  • Translating Texts: Crop text from video streams, games, foreign language documents, or non-selectable UI regions to get an instant translation and explanation.
  • Extracting Code/Logs: Grab error logs or lines of code from screenshots or videos and ask Jacky to explain or debug them.
  • Explaining Visuals: Highlight a chart, graph, diagram, or UI design on your screen and ask Jacky to summarize or explain the patterns.
  • Large Document Q&A: Drop a lengthy log file or report and ask Jacky to find specific errors, lines, or extract a high-level summary.
PreviousAI Provider (LLM)NextMemory (Memoria)