Skip to content

PinsaraPerera/groq_app

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Groq Simple Chat App

Groq Simple Chat App is a simple chat application created using Streamlit. It utilizes a large language model (LLM) to generate responses to user input.

Features

  • Real-time user input and LLM-generated responses
  • Simple and intuitive user interface
  • Customizable LLM parameters

Getting Started

To run the Groq Simple Chat App, follow these steps:

  1. Clone the repository:
git clone https://github.com/PinsaraPerera/groq_app.git
  1. Navigate to the project directory:
cd groq_app
  1. Install the required dependencies:
pip install -r requirements.txt
  1. Run the Streamlit app:
streamlit run app.py
  1. Interact with the chat application in your web browser.

Customizing LLM Parameters

The LLM parameters can be customized by modifying the params.json file. The following parameters are available:

  • temperature: Controls the randomness of the LLM's responses.
  • max_length: Controls the maximum length of the LLM's responses.
  • top_k: Controls the number of top candidates considered for the LLM's responses.
  • top_p: Controls the cumulative probability of the top candidates considered for the LLM's responses.

About

Groq is a company that specializes in building custom processors for AI and ML workloads, while an LPU is a processing unit that is optimized for a specific type of computation or application.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages