mini-gLM
A minimal genomic language model.
In progress. Building an encoder-only language model pre-trained on 920k human genome fragments. Implementing a minimal architecture using linear attention transformers.
A minimal genomic language model.
In progress. Building an encoder-only language model pre-trained on 920k human genome fragments. Implementing a minimal architecture using linear attention transformers.