Testing with other LLM's

[rajnavakoti]

Description
The currently framework default uses llama models. It was tested with llam2 7B, llama3 8B, llama3:instuct models. We need to test it with other popular models can seamlessly integrate with the framework

gemma
mistral
codellama
phi3