3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Douglas HanleyandGitHub	4524290e87	Use correct type of pooling for embedding models (#5500) ... Use correct type of pooling for embedding models	2024-02-15 12:21:49 -05:00
3 people	03bf161eb6	llama : support batched embeddings (#5466) ... * batched embedding: pool outputs by sequence id. updated embedding example * bring back non-causal attention * embd : minor improvements * llama : minor --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-02-13 14:06:58 +02:00
5 people	2891c8aa9a	Add support for BERT embedding models (#5423) ... * BERT model graph construction (build_bert) * WordPiece tokenizer (llm_tokenize_wpm) * Add flag for non-causal attention models * Allow for models that only output embeddings * Support conversion of BERT models to GGUF * Based on prior work by @xyzhang626 and @skeskinen --------- Co-authored-by: Jared Van Bortel <jared@nomic.ai> Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>	2024-02-11 11:21:38 -05:00