article

DeltaV and AI Engine Upgrade: New 'Talkative' mode elevates AI to New Heights

Introducing Talkative V3, Enhanced RAG Agent Capabilities, and More
2024-02-092 min readFetch.ai

DeltaV and AI Engine v0.17 denote an era of advanced conversational AI capabilities and infrastructural enhancements. Let's dive into the new features and improvements that this version brings to the table.

Unveiling Talkative V3

Talkative V3 marks a significant leap forward in our AI-driven conversational capabilities:

  • Enhanced Task Recommendation: Leveraging a fine-tuned GPT-3.5-turbo, Talkative V3 now offers more precise task recommendations.

  • Advanced Context Building: The fine-tuning extends to context building, ensuring that conversations flow naturally - enhancing user engagement and satisfaction.

  • RAG Reranking for Task Recommendations: With RAG reranking, Talkative V3 smartly prioritizes task recommendations, optimizing user interactions for efficiency.

RAG Agent: Long Document Support and More

The RAG agent receives notable upgrades, now supporting longer documents and featuring cached document fetching for quicker response times. This enhancement significantly improves the agent's ability to provide comprehensive and accurate information.

Agent Health Check

This version introduces an agent health check feature. It displays the current status of agents and whether they are online or offline.

Opentelemetry Instrumentation and Workflow Automation

Initial support for Opentelemetry instrumentation offers insights into the performance and usage of agents, paving the way for optimized operations. Furthermore, Argo workflows for automatic finetuning of open-source models signify a move towards more autonomous and efficient model improvements.

TensorRT LLM Inference and New Chat API Endpoint

TensorRT LLM inference now supports fine-tuned sub 13B models, promising faster and more efficient model operations. Additionally, the new Chat API endpoint (/sessions/{session_id}/new-messages) improves message delivery reliability and efficiency, addressing network errors and ensuring message retention until delivery.

DeltaV Dev Mode and Improvements

DeltaV Dev mode is now available to all users, offering a sandbox environment for testing and development. This release also addresses several critical issues, including the zero credit glitch, vector database backups, DeltaV login, and more, alongside refactoring message pulling to alleviate loading problems.

Moving Forward

The new update symbolizes a significant stride in our journey to perfect conversational AI and service reliability. We'd like you to explore the new features in DeltaV v0.17.

Haven't explored DeltaV yet? Now's the perfect time to dive in and experience the forefront of conversational AI technology.


More from Fetch

light-leftellipse-orangeellipse-orange