Multimodal Chatbot - Shiny Contest Submission

Multimodal Chatbot

Authors: Soumyadipta Das

Abstract: This innovative multimodal chatbot, built using RShiny, offers a versatile and interactive platform for users to engage with various types of Large Language Models (LLMs). Users can select from different LLM types, including conversational, coding, and inferential models, to suit their specific needs. The chatbot provides the following key features:

LLM Selection: Users can choose between different LLM types:

  • Conversational: For general dialogue and customer support.
  • Coding: For programming assistance and code generation.
  • Inferential: For statistical analysis and data interpretation.

Conversation Management:

  • Copy Conversation: Users can easily copy the entire conversation for documentation or sharing purposes.
  • Clear History: Users can clear the chat history to start a fresh session.

Document Analysis:

  • Upload DOCX and PPTX: Users can upload DOCX and PPTX files for the chatbot to analyze and extract relevant information.

This multimodal chatbot leverages the power of RShiny to provide a seamless and user-friendly interface, making it an ideal tool for a wide range of applications, from customer service to data analysis and beyond.

Full Description: This innovative multimodal chatbot, built using RShiny, offers a versatile and interactive platform for users to engage with various types of Large Language Models (LLMs). Users can select from different LLM types, including conversational, coding, and inferential models, to suit their specific needs. The chatbot provides the following key features:

LLM Selection: Users can choose between different LLM types:

  • Conversational: For general dialogue and customer support.
  • Coding: For programming assistance and code generation.
  • Inferential: For statistical analysis and data interpretation.

Conversation Management:

  • Copy Conversation: Users can easily copy the entire conversation for documentation or sharing purposes.
  • Clear History: Users can clear the chat history to start a fresh session.

Document Analysis:

  • Upload DOCX and PPTX: Users can upload DOCX and PPTX files for the chatbot to analyze and extract relevant information.

This multimodal chatbot leverages the power of RShiny to provide a seamless and user-friendly interface, making it an ideal tool for a wide range of applications, from customer service to data analysis and beyond.


Shiny app: Multimodal Chatbot
Repo: GitHub - Soumyadipta2020/Chatbot_with_R

Thumbnail:

Full image: