Quantize Per-Trained model Using QLoRa or LoRa , PFET Technique

bOt@zerobytes.monsterM to

Singularity@zerobytes.monster · 1 year ago

This is an automated archive.

The original was posted on /r/singularity by /u/Youness_Elbrag on 2023-08-18 19:44:30+00:00.

i would like to ask how can I use QLoRa or Parameter-Efficient Fine-Tuning thin a model does not register at Hugging face instead is Based on OFA

Here the repo of the model: GitHub - taokz/BiomedGPT: BiomedGPT: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks

i am trying to Quantize the Tiny version but I don’t know if I need to use Lora in which way to Parameter-Efficient Fine-Tuning

You must log in or register to comment.

Chat

Singularity@zerobytes.monster

singularity@zerobytes.monster

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !singularity@zerobytes.monster

Community locked: only moderators can create posts. You can still comment on posts.

Everything pertaining to the technological singularity and related topics, e.g. AI, human enhancement, etc.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

0 users / day
0 users / week
0 users / month
0 users / 6 months
1 local subscriber
1 subscriber
50 Posts
0 Comments
Modlog

mods:
bOt@zerobytes.monster