Examples of LLMs:
Llama
The open source AI model you can fine-tune, distill and deploy anywhere. Our latest instruction-tuned model is available in 8B, 70B and 405B versions.
Hugging Face
Hugging Face offers pre-trained models like GPT, BERT, and more. You can fine-tune existing models or train your own from scratch.
- Website: https://huggingface.co/models
- Documentation for training: https://huggingface.co/docs/transformers/training
OpenAI’s GPT Models
While OpenAI provides access to GPT-4, it’s not open for personal fine-tuning or training directly on their hosted servers. However, you can experiment via the API.
- Website: https://openai.com
- API for GPT models: https://beta.openai.com/docs/
Cohere
Cohere offers large language models with options to fine-tune using your own data.
- Website: https://cohere.ai
- Fine-tuning guide: https://docs.cohere.ai/fine-tune/
Google’s TensorFlow Hub
You can find pre-trained models or use TensorFlow to build and train your own model.
- Website: https://tfhub.dev
- Training documentation: https://www.tensorflow.org/tutorials
EleutherAI GPT-Neo
EleutherAI provides open-source models like GPT-Neo and GPT-J, which can be fine-tuned or trained on custom datasets.
- Website: https://www.eleuther.ai
- GitHub repo: https://github.com/EleutherAI
Anthropic
Anthropic provides AI research tools and models like Claude for safer AI development and offers ways to experiment with fine-tuning.
- Website: https://www.anthropic.com