AI Engineer Code 2025

Enterprise Deep Research: The Next Killer App for Enterprise AI — Ofer Mendelevitch, Vectara

Ofer Mendelevitch· Head of Developer Relations, Vectara5:19

Loading slides…

Read the talk

Enterprise Deep Research: The Next Killer App for Enterprise AI

Enterprise deep research extends autonomous investigation to private documents, combining retrieval, parallel agents and synthesis to produce grounded answers across an organization’s data.

From a talk by Ofer Mendelevitch

The platform beneath the research

What does an enterprise agent platform need to support document generation, internal and external chatbots, and deeper research? Ofer Mendelevitch opens with these adjacent applications of Vectara, then turns to the infrastructure they share. Its agent operating system is available as SaaS, in a customer’s own VPC, or on-premise in a customer’s data center.

The first requirement is making the organization’s information retrievable. Multimodal ingestion brings images and tables into retrieval-augmented generation (RAG) and agentic RAG workflows, so useful evidence need not be confined to document prose. Hybrid retrieval, metadata features and re-ranking help find and prioritize relevant material. Hallucination detection and correction address what happens when that material becomes a generated answer.

Vectara’s HHEM evaluates whether generated text is consistent with supplied source material; that does not establish whether the source itself is true. Mendelevitch reports that HHEM had passed five million downloads a couple of months earlier and tentatively estimates about 5.5 million at presentation time. Those are adoption figures, not accuracy measurements.

The surrounding enterprise requirements include security, role-based access controls, bring-your-own-model support, custom prompts, observability and monitoring. These capabilities determine where the application can run, who can use it, and how its behavior can be configured and observed.

0:000:23
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

0:00 · section reference included

Research needs reliable evidence

A comprehensive report still needs a reliable factual foundation. Hallucinations remain a problem across generative AI applications, including enterprise research. The retrieval and mitigation capabilities matter because the research process must base its answers on robust information.

Mendelevitch cites approximately 73% of LLM customers implementing use cases as naming factual accuracy their top challenge. The statistic’s survey source and methodology are not identified in the supplied material, so it serves here as his motivation for emphasizing hallucination mitigation, rather than a measured result for Vectara.

Slide titled “Why This Matters?” shows statistic cards for 50%, 3–10%, and 73%, with factual accuracy highlighted as a top challenge for LLM customers.Open full source frame
Factual accuracy and hallucinations frame the need for trustworthy research.
1:411:57
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

1:41 · section reference included

From a question to a cited report

Deep research begins with a question that requires investigation. An agent browses or searches the web autonomously, gathers results across multiple steps, and synthesizes them into a comprehensive report with citations. The output brings the findings together to answer the original question. Mendelevitch names Google’s Gemini, ChatGPT deep research, Anthropic and Perplexity as implementations of this web-based pattern.

“What is Deep Research?” slide defines multi-step investigation, autonomous browsing, and synthesis, and lists Google, ChatGPT, Perplexity, and Anthropic.Open full source frame
Deep research combines autonomous browsing with synthesis into citation-driven reports.

The recording then shows where to select deep research in Gemini and ChatGPT. These are feature-selection screenshots, rather than a completed research run. Mendelevitch estimates that a deep research task typically takes 20–30 minutes because of the work performed underneath. That is his general estimate for the workflow being discussed, not a cross-provider timing benchmark.

2:172:41
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

2:17 · section reference included

Turning the investigation toward private data

Enterprise Deep Research applies the same investigative pattern to an organization’s private information. Mendelevitch describes multiple agents executing in parallel, reflection during the research process, and synthesis of the final results. The agents query enterprise data through Vectara’s agentic RAG capabilities, carrying retrieval accuracy and hallucination mitigation into the investigation.

The additional planning capability is corpus understanding: understanding the available collection well enough to plan research around the data it actually contains. Parallel execution provides a way to pursue multiple parts of an investigation, while corpus understanding helps determine what those parts should be. The overview names these capabilities without specifying the reflection algorithm or agent orchestration details.

3:143:38
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:14 · section reference included

RFP answers, onboarding guides and investment memos

RFP responses. Mendelevitch’s RFP example involves answering 150 questions. The difficulty is assembling the right information across enterprise datasets. Enterprise research would search those datasets, select the documents relevant to each question, and use them to prepare answers. This is a proposed application of the research workflow, not a timed demonstration of a completed response.

Employee onboarding. A new employee joining a team or company may find no onboarding guide—or one last generated three years earlier. The proposed alternative is an on-demand guide assembled from documentation in Jira, Notion, Google Drive and SharePoint. Here, research turns scattered organizational information into a document intended to help someone get started.

Industry-specific outputs. In financial services, the resulting document could be an investment memo. Mendelevitch also points to healthcare and insurance as possible domains, without developing specific examples. The substantive ending broadens the output from answers and guides to documents shaped around an industry’s research needs.

“Example Use Cases” slide contains illustrated tiles labeled “Responding to an RFP,” “Employee Onboarding,” and “Generation of Investment Memo.”Open full source frame
Example applications include RFP responses, employee onboarding, and investment memos.
3:494:06
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:49 · section reference included

Resources

From the talk

  • Open hallucination-evaluation model with examples for checking generated text against source material.

  • OpenAI's launch explanation of ChatGPT deep research, including its workflow, citations and limitations.

Transcript download
Full transcript

Loading transcript…