Skip to content

Fix: LlamaMLP expects only 'config' parameter during initialization#1

Open
Kartik0806 wants to merge 1 commit intodevvrit:mainfrom
Kartik0806:bugfix/LlamaMLP-init-config
Open

Fix: LlamaMLP expects only 'config' parameter during initialization#1
Kartik0806 wants to merge 1 commit intodevvrit:mainfrom
Kartik0806:bugfix/LlamaMLP-init-config

Conversation

@Kartik0806
Copy link
Copy Markdown

The initialization of LlamaMLP expects only "config" but in ModifiedLlamaMLP (subclass of LlamaMLP), it was expecting "hidden_size", "intermediate_size", and "hidden_act".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant